-- Logs begin at Mon 2021-11-29 19:42:56 UTC, end at Mon 2021-11-29 21:01:16 UTC. -- Nov 29 20:07:21.279577 dv-cinder-819669-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Nov 29 20:07:21.290905 dv-cinder-819669-1-iscsi devstack@keystone.service[79155]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Nov 29 20:07:21.291866 dv-cinder-819669-1-iscsi devstack@keystone.service[79155]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Nov 29 20:07:21 2021] *** Nov 29 20:07:21.291866 dv-cinder-819669-1-iscsi devstack@keystone.service[79155]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 29 20:07:21.291866 dv-cinder-819669-1-iscsi devstack@keystone.service[79155]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 29 20:07:21.291866 dv-cinder-819669-1-iscsi devstack@keystone.service[79155]: nodename: dv-cinder-819669-1-iscsi Nov 29 20:07:21.291866 dv-cinder-819669-1-iscsi devstack@keystone.service[79155]: machine: x86_64 Nov 29 20:07:21.291866 dv-cinder-819669-1-iscsi devstack@keystone.service[79155]: clock source: unix Nov 29 20:07:21.291866 dv-cinder-819669-1-iscsi devstack@keystone.service[79155]: pcre jit disabled Nov 29 20:07:21.291866 dv-cinder-819669-1-iscsi devstack@keystone.service[79155]: detected number of CPU cores: 4 Nov 29 20:07:21.291866 dv-cinder-819669-1-iscsi devstack@keystone.service[79155]: current working directory: / Nov 29 20:07:21.291866 dv-cinder-819669-1-iscsi devstack@keystone.service[79155]: detected binary path: /usr/bin/uwsgi-core Nov 29 20:07:21.292402 dv-cinder-819669-1-iscsi devstack@keystone.service[79155]: your processes number limit is 47680 Nov 29 20:07:21.292402 dv-cinder-819669-1-iscsi devstack@keystone.service[79155]: your memory page size is 4096 bytes Nov 29 20:07:21.292402 dv-cinder-819669-1-iscsi devstack@keystone.service[79155]: detected max file descriptor number: 2048 Nov 29 20:07:21.292402 dv-cinder-819669-1-iscsi devstack@keystone.service[79155]: lock engine: pthread robust mutexes Nov 29 20:07:21.292402 dv-cinder-819669-1-iscsi devstack@keystone.service[79155]: thunder lock: enabled Nov 29 20:07:21.292402 dv-cinder-819669-1-iscsi devstack@keystone.service[79155]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Nov 29 20:07:21.292402 dv-cinder-819669-1-iscsi devstack@keystone.service[79155]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Nov 29 20:07:21.335781 dv-cinder-819669-1-iscsi devstack@keystone.service[79155]: Python main interpreter initialized at 0x5650783b39c0 Nov 29 20:07:21.335781 dv-cinder-819669-1-iscsi devstack@keystone.service[79155]: python threads support enabled Nov 29 20:07:21.335781 dv-cinder-819669-1-iscsi devstack@keystone.service[79155]: your server socket listen backlog is limited to 100 connections Nov 29 20:07:21.335781 dv-cinder-819669-1-iscsi devstack@keystone.service[79155]: your mercy for graceful operations on workers is 90 seconds Nov 29 20:07:21.336172 dv-cinder-819669-1-iscsi devstack@keystone.service[79155]: mapped 403077 bytes (393 KB) for 2 cores Nov 29 20:07:21.336248 dv-cinder-819669-1-iscsi devstack@keystone.service[79155]: *** Operational MODE: preforking *** Nov 29 20:07:21.336501 dv-cinder-819669-1-iscsi devstack@keystone.service[79155]: *** uWSGI is running in multiple interpreter mode *** Nov 29 20:07:21.336501 dv-cinder-819669-1-iscsi devstack@keystone.service[79155]: spawned uWSGI master process (pid: 79155) Nov 29 20:07:21.336714 dv-cinder-819669-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Nov 29 20:07:21.337284 dv-cinder-819669-1-iscsi devstack@keystone.service[79155]: spawned uWSGI worker 1 (pid: 79167, cores: 1) Nov 29 20:07:21.337620 dv-cinder-819669-1-iscsi devstack@keystone.service[79155]: spawned uWSGI worker 2 (pid: 79168, cores: 1) Nov 29 20:07:21.337767 dv-cinder-819669-1-iscsi devstack@keystone.service[79155]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 29 20:07:26.604589 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 29 20:07:26.604589 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: from cryptography.utils import int_from_bytes Nov 29 20:07:26.605440 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 29 20:07:26.605440 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: from cryptography.utils import int_from_bytes Nov 29 20:07:26.618490 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 29 20:07:26.618490 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: from cryptography.utils import int_from_bytes Nov 29 20:07:26.619058 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 29 20:07:26.619058 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: from cryptography.utils import int_from_bytes Nov 29 20:07:26.653947 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 29 20:07:26.654114 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 29 20:07:26.654320 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] command line args: [] {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 29 20:07:26.654573 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 29 20:07:26.654710 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ================================================================================ {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 29 20:07:26.655025 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] admin_token = **** {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.655264 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] config_dir = [] {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.655424 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.655633 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] config_source = [] {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.655776 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] debug = True {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.655975 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.657194 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.657194 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.657194 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.657194 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.657194 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] list_limit = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.657495 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] log_config_append = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.657495 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.657725 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] log_dir = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.657872 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] log_file = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.658088 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.658325 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.658574 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.658821 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.659020 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.659201 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.659446 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.659692 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.659974 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.660205 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.660428 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.660653 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.660895 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.661141 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.661417 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.661912 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.662077 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] publish_errors = False {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.662308 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.662534 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.662708 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.662988 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.663209 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.663442 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] standard_threads = False {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.663670 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.663910 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.664085 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.664258 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] use_journal = False {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.664431 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] use_json = False {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.664602 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] use_stderr = False {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.664774 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] use_syslog = False {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.665006 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.665259 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.665342 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 29 20:07:26.665495 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.665579 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 29 20:07:26.665717 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] command line args: [] {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 29 20:07:26.665798 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.665976 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.666056 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 29 20:07:26.666158 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ================================================================================ {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 29 20:07:26.666236 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.666418 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] admin_token = **** {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.666501 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.666667 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] config_dir = [] {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.666758 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.666840 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.666948 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.667059 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] config_source = [] {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.667141 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.667242 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] debug = True {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.667390 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.667473 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.667637 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.667721 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.667849 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.667932 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.668102 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.668187 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.668332 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.668414 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.668569 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] list_limit = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.668722 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.668807 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] log_config_append = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.668878 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.668953 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.669023 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.669107 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] log_dir = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.669242 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] log_file = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.669318 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.669479 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.669556 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.669731 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.669816 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.669960 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.670035 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.670211 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.670287 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.670387 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.670471 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.670564 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.670708 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.670811 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.670982 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.671072 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.671212 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.671308 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.671440 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.671542 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.671666 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.671775 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.671897 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.672007 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.672143 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.672253 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.672387 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.672541 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.672615 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.672765 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.672850 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.673060 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.673261 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.673345 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.673446 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] publish_errors = False {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.673521 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.673679 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.673768 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.673910 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.673993 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.674089 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.674191 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.674338 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.674423 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.674573 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.674649 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.674807 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] standard_threads = False {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.674902 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.675062 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.675156 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.675322 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.675398 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.675508 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.675583 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.675686 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] use_journal = False {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.675802 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.675879 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] use_json = False {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.676024 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] use_stderr = False {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.676096 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.676198 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] use_syslog = False {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.676280 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.676435 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 29 20:07:26.676523 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.676681 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.676761 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.676920 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.677004 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.677165 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.677240 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.677392 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.677468 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.677626 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.677781 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.677855 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.677924 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.678081 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.678172 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.678314 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.678399 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.678546 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.678622 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.678773 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.678955 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.679042 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.679122 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.679273 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.679356 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.679507 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.679582 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.679737 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.679822 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.679986 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.680062 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.680218 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.680293 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.680446 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.680529 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.680680 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.680762 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.680916 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.680992 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.681170 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.681256 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.681404 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.681478 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.681650 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.681725 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.681885 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.681968 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.682134 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.682244 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.682368 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.682455 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.682606 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.682722 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.682838 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.682939 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.683112 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.683210 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.683323 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.683410 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.683555 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.683641 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.683802 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.683884 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.684033 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.684123 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.684265 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.684341 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.684494 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.684572 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.684706 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.684822 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.684944 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.685025 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.685178 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.685264 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.685406 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.685483 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.685642 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.685727 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.685874 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.685952 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.686102 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.686181 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.686332 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.686410 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.686562 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.686641 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.686802 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.686913 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.687063 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.687143 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.687292 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] auth.external = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.687372 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.687521 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.687606 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.687753 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.687831 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.687983 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.688059 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.688217 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.688305 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] auth.password = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.688453 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.688532 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] auth.token = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.688684 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.688761 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.688914 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.688991 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.689147 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.689232 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.689372 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.689450 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.689613 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.689689 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.689834 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.689908 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.690065 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.690143 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.690293 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.690370 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] credential.caching = True {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.690546 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.690623 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.690780 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.690903 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.691093 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.691213 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.691329 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.691409 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.691570 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.691657 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.691804 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.691881 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.692108 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.692204 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.692279 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.692350 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.692493 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.692573 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.692755 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.692839 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.692990 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.693077 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.693241 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.693320 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.693477 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.693562 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.693724 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.693808 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.693962 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.694040 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.694198 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.694284 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] federation.caching = True {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.694435 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.694519 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.694670 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.694749 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.694928 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.695024 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.695157 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.695234 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.695403 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.695481 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.695637 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.695723 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.695875 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.695952 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.696107 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.696196 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.696338 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.696420 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.696570 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.696657 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.696805 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.696883 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.697036 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.697114 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] identity.caching = True {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.697275 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.697369 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.697510 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.697595 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.697741 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.697819 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.697974 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.698061 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.698221 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.698299 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.698450 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.698528 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.698685 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.698771 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.698944 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] auth.external = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.699024 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.699178 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.699255 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.699420 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.699509 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.699647 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.699725 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.699874 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.699952 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] auth.password = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.700115 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.700209 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] auth.token = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.700355 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.700432 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.700589 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.700666 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.700835 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.700922 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.701063 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.701142 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.701312 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.701390 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.701551 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.701641 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.701777 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.701854 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.702002 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.702084 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] credential.caching = True {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.702235 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.702314 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.702460 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.702537 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.702690 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.702767 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.702972 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.703052 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.703178 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.703256 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.703423 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.703500 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.703649 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.703729 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.703892 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.703983 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.704136 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.704276 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.704362 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.704435 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.704591 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.704669 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.704832 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.704909 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.705063 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.705148 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.705307 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.705385 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.705535 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.705612 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.705768 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.705848 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] federation.caching = True {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.706004 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.706108 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.706240 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.706321 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.706474 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.706554 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.706731 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.706817 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.707010 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.707089 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.707241 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.707329 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.707470 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.707555 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.707698 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.707791 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.707945 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.708031 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.708191 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.708283 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.708422 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.708507 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.708654 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.708740 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] identity.caching = True {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.708886 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.708971 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.709112 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.user = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.709203 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.709348 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.709444 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.709582 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.709662 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.709818 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.709895 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.710057 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.710136 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.710297 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.710375 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.710537 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.710613 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.710766 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.710863 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.711015 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.711094 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.711245 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.711323 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.711475 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.711556 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.711707 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.711791 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.711934 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.712012 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.712176 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.712255 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.712418 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.712497 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.712659 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.712744 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.712902 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.712980 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.713143 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.713220 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.713370 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.713456 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.713597 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.713674 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.713831 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.713908 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.714057 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.714143 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.714286 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.714363 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.714517 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.714594 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.714751 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.714835 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.715023 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.715104 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.715254 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.715338 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.715500 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.715586 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.715725 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.715802 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.715963 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.716041 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.716195 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.716281 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.716425 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.716502 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.716656 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.716734 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.716904 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.716990 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.717134 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.717212 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.717360 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.717437 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.717594 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.717679 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.717829 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] resource.caching = True {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.717906 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.718065 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.718142 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.718300 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.718386 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.718530 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.718606 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.718777 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.718928 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.719045 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.719135 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.719277 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.719354 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.719520 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.719597 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.719753 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.719839 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.719988 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.720066 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.720220 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] role.caching = True {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.720297 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.720453 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.720539 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] role.driver = sql {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.720679 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.720762 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.user = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.720916 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.720993 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.721160 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.721246 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.721392 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.721475 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.721636 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.721713 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.721881 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.721967 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.722124 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.722207 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.722405 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.722484 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.722635 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.722721 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.722886 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.722985 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.723123 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.723209 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.723360 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.723462 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.723590 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.723676 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.723831 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.723918 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.724075 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.724217 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.724303 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.724453 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.724538 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.724701 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.724795 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.724953 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.725039 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.725199 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.725284 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.725444 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.725606 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.725685 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.725756 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.725894 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.725979 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.726127 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.726226 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.726364 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.726447 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.726591 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.726683 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.726820 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.726936 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.727073 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.727159 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.727319 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.727399 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.727560 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.727646 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.727794 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.727871 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.728024 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.728099 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.728257 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.728343 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.728512 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.728589 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.728744 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] token.caching = True {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.728821 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.728974 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.729058 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.729212 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.729291 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.729442 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.729518 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] resource.caching = True {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.729690 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.729773 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.729942 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.730022 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.730186 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.730282 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.730414 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.730507 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.730652 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.730729 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.730903 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.730983 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.731145 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.731234 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.731380 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.731457 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.731608 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.731691 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.731840 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] role.caching = True {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.731925 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.732085 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.732161 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] role.driver = sql {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.732311 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.732388 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.732548 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.732634 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.732796 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.732873 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.733045 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.733124 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] database.connection = **** {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.733283 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.733367 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.733526 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.733604 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.733761 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.733838 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.733997 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.734083 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.734231 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.734309 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.734460 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.734536 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.734690 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.734774 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.734951 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.735029 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.735200 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.735276 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.735443 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.735530 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.735683 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.735826 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.735904 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.736062 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.736142 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.736313 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.736399 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.736563 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.736641 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.736812 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.736889 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.737047 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.737131 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.737278 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.737355 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.737444 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79167) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 29 20:07:26.737520 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.737766 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.738029 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.738261 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.738494 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.738726 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.738998 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.739253 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.739500 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.739738 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.739978 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.740208 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.740442 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] token.caching = True {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.740678 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.740925 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.741160 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.741415 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.741677 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.741915 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.742159 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.742402 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.742650 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.742965 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.743207 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.743442 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.743689 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.743940 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.744170 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.744412 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.744677 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.744938 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] database.connection = **** {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.745180 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.745427 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.745663 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.745902 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.746136 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.746373 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.746607 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.746856 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.747137 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.747376 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.747619 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.747855 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.748102 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.748338 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.748584 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.748823 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.749064 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.749299 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 29 20:07:26.749466 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79168) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 29 20:07:26.767115 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:26.767318 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:26.767573 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:26.774638 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:26.774870 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:26.775131 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:26.777394 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:26.784980 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:26.805390 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:26.805625 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:26.811123 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:26.811322 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:26.857471 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:26.858164 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:26.907211 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:26.907449 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:26.908230 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:26.908466 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:26.971432 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:26.971585 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:26.971677 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:26.971758 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:26.971836 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:26.971909 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:26.972081 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:26.972207 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:26.972291 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:26.972374 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:26.972526 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:26.972652 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:26.995628 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:26.995863 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:26.995962 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:26.996110 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:26.996205 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:26.996352 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:26.996493 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:26.996566 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:26.996642 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:26.996743 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:26.996831 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:26.996971 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:26.997116 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:26.997225 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:27.008337 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:27.008682 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:27.021146 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:27.021422 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:27.021565 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:27.021677 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:27.021752 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:27.021814 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:27.021887 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:27.021982 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:27.022067 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:27.022202 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:27.022329 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:27.022398 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:27.022474 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79167) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:27.022667 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79168) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Nov 29 20:07:27.039887 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.040102 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 29 20:07:27.040201 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.040426 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 29 20:07:27.040551 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.040621 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 29 20:07:27.040737 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.040859 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.040938 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Nov 29 20:07:27.041142 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.041272 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.041368 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.041455 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.041651 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.041794 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.041951 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.052253 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.052529 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.054376 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.054646 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.054791 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.054903 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.054985 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.055216 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.062840 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 29 20:07:27.063168 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 29 20:07:27.066081 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 29 20:07:27.066366 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.066496 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 29 20:07:27.066650 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.066789 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.066905 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.066988 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.067212 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.067342 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.067432 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.067513 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.067726 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.067852 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.068002 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.068132 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.068217 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.068295 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.068501 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.068624 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.068888 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.069027 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.069138 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.094684 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.095063 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.096284 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 29 20:07:27.096561 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.096685 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 29 20:07:27.096928 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.101887 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 29 20:07:27.102173 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.102297 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 29 20:07:27.102419 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.102510 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.102811 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.109650 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 29 20:07:27.109874 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.110009 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 29 20:07:27.110305 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.114329 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 29 20:07:27.114615 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.114743 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 29 20:07:27.114935 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.115062 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.115178 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.115337 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.115464 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.115663 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.115827 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.115921 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.116139 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.116268 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.116431 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.116571 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.116962 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.134959 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.135240 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.135522 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.135797 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.139815 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 29 20:07:27.140409 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 29 20:07:27.143390 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.143679 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.144010 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.144340 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.148576 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 29 20:07:27.149222 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 29 20:07:27.152123 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 29 20:07:27.152785 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 29 20:07:27.155662 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.155955 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.156211 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.156333 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.156621 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.156764 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.156916 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.157040 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.157158 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.157281 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.157580 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.157869 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.175736 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 29 20:07:27.176016 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.176279 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.176539 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.176797 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 29 20:07:27.177077 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.177347 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.177613 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.184348 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.185459 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.186009 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.186288 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.187154 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.187433 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.189246 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 29 20:07:27.189525 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.189822 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.190108 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.190384 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 29 20:07:27.190522 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.190660 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.190966 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.191305 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.191580 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.203435 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 29 20:07:27.203710 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.203989 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.204266 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.204538 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.204661 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 29 20:07:27.204816 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.204899 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.205064 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.205189 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.205405 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.205681 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.205958 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.206218 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.222440 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 29 20:07:27.223820 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 29 20:07:27.225831 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 29 20:07:27.227166 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 29 20:07:27.229047 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.230388 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.230628 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.232012 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.232243 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 29 20:07:27.232515 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.232794 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.233624 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 29 20:07:27.233902 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.234186 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.240038 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.241480 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.241605 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 29 20:07:27.243091 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 29 20:07:27.244736 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.245026 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.245311 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.245602 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.246246 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.246514 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.246821 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.247131 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.254806 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 29 20:07:27.255118 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.255392 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.256361 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 29 20:07:27.256645 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.256923 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.263135 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79167) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 29 20:07:27.263413 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.263688 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.263961 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.264250 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.264521 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.264732 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79168) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Nov 29 20:07:27.264871 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.265007 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.265088 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.265277 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.265403 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.265551 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.265633 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.265787 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.265878 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.266077 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.266216 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.266301 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.266374 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.266568 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79167) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.266652 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.266841 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.267131 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.267418 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.267685 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.267949 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.268212 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79168) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Nov 29 20:07:27.304393 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5650783b39c0 pid: 79167 (default app) Nov 29 20:07:27.306082 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5650783b39c0 pid: 79168 (default app) Nov 29 20:07:27.307617 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b5d87-36b2-42de-a539-a087014b5586 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:27.307906 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b5d87-36b2-42de-a539-a087014b5586 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:27.308179 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b5d87-36b2-42de-a539-a087014b5586 None None] PATH_INFO: `/v3` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:27.315365 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 791 bytes} [Mon Nov 29 20:07:27 2021] GET /identity/v3/ => generated 255 bytes in 10 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:07:35.076865 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfbcaf-861b-42ac-9bc3-3c34fd0d8b07 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:35.077688 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfbcaf-861b-42ac-9bc3-3c34fd0d8b07 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:35.077688 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfbcaf-861b-42ac-9bc3-3c34fd0d8b07 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:35.085982 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1/2] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:07:35 2021] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:07:35.092964 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284abaf-a604-4df0-b0f4-1ff22f50457b None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:35.093688 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284abaf-a604-4df0-b0f4-1ff22f50457b None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:35.093797 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284abaf-a604-4df0-b0f4-1ff22f50457b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:35.132498 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG oslo_db.sqlalchemy.engines [None req-8284abaf-a604-4df0-b0f4-1ff22f50457b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79167) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 29 20:07:35.323913 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG passlib.handlers.bcrypt [None req-8284abaf-a604-4df0-b0f4-1ff22f50457b None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79167) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Nov 29 20:07:35.324326 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG passlib.handlers.bcrypt [None req-8284abaf-a604-4df0-b0f4-1ff22f50457b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79167) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Nov 29 20:07:35.380860 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-8284abaf-a604-4df0-b0f4-1ff22f50457b None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:07:35.382465 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-8284abaf-a604-4df0-b0f4-1ff22f50457b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:07:35.520080 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 2/3] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:07:35 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:07:35.708050 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bfbcaf-861b-42ac-9bc3-3c34fd0d8b07 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:35.752095 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG oslo_db.sqlalchemy.engines [None req-96bfbcaf-861b-42ac-9bc3-3c34fd0d8b07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79168) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 29 20:07:35.887947 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bfbcaf-861b-42ac-9bc3-3c34fd0d8b07 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:35.893461 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130bff41-2e1f-431e-ae10-fb2c70807466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:35.894110 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bff41-2e1f-431e-ae10-fb2c70807466 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:35.894390 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bff41-2e1f-431e-ae10-fb2c70807466 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:35.894658 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bff41-2e1f-431e-ae10-fb2c70807466 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:35.903355 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130bff41-2e1f-431e-ae10-fb2c70807466 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:35.953612 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.common.rbac_enforcer.enforcer [None req-130bff41-2e1f-431e-ae10-fb2c70807466 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 29 20:07:35.953946 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130bff41-2e1f-431e-ae10-fb2c70807466 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:35.963994 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 2/4] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:07:35 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:07:35.971993 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284abaf-a604-4df0-b0f4-1ff22f50457b None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:35.994887 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284abaf-a604-4df0-b0f4-1ff22f50457b None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:36.004162 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f5c6d-2bcd-42b0-a672-8786a7501f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:36.005794 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f5c6d-2bcd-42b0-a672-8786a7501f09 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:36.006166 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f5c6d-2bcd-42b0-a672-8786a7501f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:36.006523 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f5c6d-2bcd-42b0-a672-8786a7501f09 admin admin] PATH_INFO: `/v3/projects/2a13adf9036b4a4f9b01aa94a92cd3c3` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:36.009223 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f5c6d-2bcd-42b0-a672-8786a7501f09 admin admin] RBAC: Authorizing `identity:get_project(project_id=2a13adf9036b4a4f9b01aa94a92cd3c3)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:36.063850 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ce4f5c6d-2bcd-42b0-a672-8786a7501f09 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Nov 29 20:07:36.064184 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f5c6d-2bcd-42b0-a672-8786a7501f09 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:36.068701 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 3/5] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:07:35 2021] GET /identity/v3/projects/2a13adf9036b4a4f9b01aa94a92cd3c3 => generated 344 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:07:38.381330 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b633b-546f-4363-b4c3-60a651c03dd4 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:38.382262 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b633b-546f-4363-b4c3-60a651c03dd4 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:38.382262 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817b633b-546f-4363-b4c3-60a651c03dd4 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:38.386948 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 3/6] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:07:38 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:07:38.394318 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bececc-3c5e-43b1-8142-b107337ece0a None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:38.395083 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bececc-3c5e-43b1-8142-b107337ece0a None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:38.395225 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bececc-3c5e-43b1-8142-b107337ece0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:38.422459 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-26bececc-3c5e-43b1-8142-b107337ece0a None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:07:38.423989 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-26bececc-3c5e-43b1-8142-b107337ece0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:07:38.433073 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 4/7] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:07:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:07:38.456173 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b633b-546f-4363-b4c3-60a651c03dd4 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:38.471103 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817b633b-546f-4363-b4c3-60a651c03dd4 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:38.477033 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ea7d2-8e04-489d-bb59-6d6b1950fd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:38.477702 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ea7d2-8e04-489d-bb59-6d6b1950fd13 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:38.477997 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ea7d2-8e04-489d-bb59-6d6b1950fd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:38.478274 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ea7d2-8e04-489d-bb59-6d6b1950fd13 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:38.486886 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ea7d2-8e04-489d-bb59-6d6b1950fd13 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:38.488691 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ea7d2-8e04-489d-bb59-6d6b1950fd13 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:38.498128 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 4/8] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:07:38 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:07:38.505934 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bececc-3c5e-43b1-8142-b107337ece0a None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:38.515762 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bececc-3c5e-43b1-8142-b107337ece0a None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:38.521823 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee529a72-7781-4f06-a08b-fc882c3748b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:38.522689 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee529a72-7781-4f06-a08b-fc882c3748b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:38.522971 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee529a72-7781-4f06-a08b-fc882c3748b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:38.523240 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee529a72-7781-4f06-a08b-fc882c3748b0 admin admin] PATH_INFO: `/v3/users/d89548cfaf2149148790fd3546ef2b15` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:38.526635 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee529a72-7781-4f06-a08b-fc882c3748b0 admin admin] RBAC: Authorizing `identity:get_user(user_id=d89548cfaf2149148790fd3546ef2b15)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:38.528511 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee529a72-7781-4f06-a08b-fc882c3748b0 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:38.530062 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 5/9] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:07:38 2021] GET /identity/v3/users/d89548cfaf2149148790fd3546ef2b15 => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:07:40.894716 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19c9ea-3684-4c6f-bbb0-f66a202da32d None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:40.895299 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19c9ea-3684-4c6f-bbb0-f66a202da32d None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:40.895299 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19c9ea-3684-4c6f-bbb0-f66a202da32d None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:40.897045 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 5/10] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:07:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:07:40.902904 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68517b64-bf1b-4e45-8e89-6c83c303c2bc None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:40.903302 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68517b64-bf1b-4e45-8e89-6c83c303c2bc None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:40.903489 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68517b64-bf1b-4e45-8e89-6c83c303c2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:40.929523 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61871360-89e9-45ca-b8be-65673b0628ab None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:40.929782 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61871360-89e9-45ca-b8be-65673b0628ab None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:40.930084 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61871360-89e9-45ca-b8be-65673b0628ab None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:40.931916 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 6/11] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:07:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:07:40.938623 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028ffb5-394d-47bb-b6db-70909e275d9d None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:40.938906 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028ffb5-394d-47bb-b6db-70909e275d9d None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:40.939209 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028ffb5-394d-47bb-b6db-70909e275d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:40.982536 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG passlib.handlers.bcrypt [None req-1028ffb5-394d-47bb-b6db-70909e275d9d None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79168) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Nov 29 20:07:40.983012 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG passlib.handlers.bcrypt [None req-1028ffb5-394d-47bb-b6db-70909e275d9d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79168) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Nov 29 20:07:41.026199 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-68517b64-bf1b-4e45-8e89-6c83c303c2bc None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:07:41.027477 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-68517b64-bf1b-4e45-8e89-6c83c303c2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:07:41.029313 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-1028ffb5-394d-47bb-b6db-70909e275d9d None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:07:41.030918 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-1028ffb5-394d-47bb-b6db-70909e275d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:07:41.035697 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 6/12] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:07:40 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:07:41.055246 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 7/13] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:07:40 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 29 20:07:41.060215 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68517b64-bf1b-4e45-8e89-6c83c303c2bc None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:41.069589 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68517b64-bf1b-4e45-8e89-6c83c303c2bc None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:41.074425 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be99c66-f499-4aa4-ae33-92872f2f17ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:41.075242 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be99c66-f499-4aa4-ae33-92872f2f17ac admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:41.075519 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be99c66-f499-4aa4-ae33-92872f2f17ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:41.075793 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be99c66-f499-4aa4-ae33-92872f2f17ac admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:41.077403 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028ffb5-394d-47bb-b6db-70909e275d9d None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:41.086288 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028ffb5-394d-47bb-b6db-70909e275d9d None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:41.089901 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be99c66-f499-4aa4-ae33-92872f2f17ac admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:07:41.090507 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb1d30-b173-4b03-a5a6-3e33f81a0c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:41.091505 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb1d30-b173-4b03-a5a6-3e33f81a0c9f admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:41.091790 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb1d30-b173-4b03-a5a6-3e33f81a0c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:41.092063 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb1d30-b173-4b03-a5a6-3e33f81a0c9f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:41.097044 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-8be99c66-f499-4aa4-ae33-92872f2f17ac admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 29 20:07:41.098232 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 7/14] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Nov 29 20:07:41 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:07:41.099826 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb1d30-b173-4b03-a5a6-3e33f81a0c9f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:41.101687 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becb1d30-b173-4b03-a5a6-3e33f81a0c9f admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:41.104543 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be99c66-f499-4aa4-ae33-92872f2f17ac admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:41.110363 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 8/15] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:07:41 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 29 20:07:41.114160 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be99c66-f499-4aa4-ae33-92872f2f17ac admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:41.116012 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb1d30-b173-4b03-a5a6-3e33f81a0c9f admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:41.118819 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164c6d3-4880-4543-aa54-7222d4841847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:41.119752 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164c6d3-4880-4543-aa54-7222d4841847 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:41.120032 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164c6d3-4880-4543-aa54-7222d4841847 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:41.120308 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164c6d3-4880-4543-aa54-7222d4841847 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:41.121033 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3164c6d3-4880-4543-aa54-7222d4841847 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:07:41.121336 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3164c6d3-4880-4543-aa54-7222d4841847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:41.123160 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING py.warnings [None req-3164c6d3-4880-4543-aa54-7222d4841847 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 29 20:07:41.123160 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: warnings.warn(msg) Nov 29 20:07:41.123160 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: Nov 29 20:07:41.124066 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3164c6d3-4880-4543-aa54-7222d4841847 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:41.124679 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becb1d30-b173-4b03-a5a6-3e33f81a0c9f admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:41.130598 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e149d19-6f0c-4431-9332-e2ff465dccd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:41.131394 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e149d19-6f0c-4431-9332-e2ff465dccd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:41.131671 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e149d19-6f0c-4431-9332-e2ff465dccd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:41.131940 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e149d19-6f0c-4431-9332-e2ff465dccd4 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:41.133703 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e149d19-6f0c-4431-9332-e2ff465dccd4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:41.135439 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e149d19-6f0c-4431-9332-e2ff465dccd4 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:41.136998 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 9/16] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:07:41 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:07:41.137679 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 8/17] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:07:41 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:07:41.143994 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e149d19-6f0c-4431-9332-e2ff465dccd4 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:41.154038 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e149d19-6f0c-4431-9332-e2ff465dccd4 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:41.158658 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4f575-776a-49a8-ab1a-2eb66fc7a491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:41.159597 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4f575-776a-49a8-ab1a-2eb66fc7a491 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:41.159877 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4f575-776a-49a8-ab1a-2eb66fc7a491 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:41.160152 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c4f575-776a-49a8-ab1a-2eb66fc7a491 admin admin] PATH_INFO: `/v3/users/d89548cfaf2149148790fd3546ef2b15` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:41.161628 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c4f575-776a-49a8-ab1a-2eb66fc7a491 admin admin] RBAC: Authorizing `identity:get_user(user_id=d89548cfaf2149148790fd3546ef2b15)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:41.163527 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c4f575-776a-49a8-ab1a-2eb66fc7a491 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:41.165300 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 10/18] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:07:41 2021] GET /identity/v3/users/d89548cfaf2149148790fd3546ef2b15 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:07:41.171795 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164c6d3-4880-4543-aa54-7222d4841847 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:41.182424 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164c6d3-4880-4543-aa54-7222d4841847 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:41.187728 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e7c7f-0e3f-4c7c-a200-fda875982b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:41.188540 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e7c7f-0e3f-4c7c-a200-fda875982b51 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:41.188816 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e7c7f-0e3f-4c7c-a200-fda875982b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:41.189082 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e7c7f-0e3f-4c7c-a200-fda875982b51 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:41.190481 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e7c7f-0e3f-4c7c-a200-fda875982b51 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:41.192345 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e7c7f-0e3f-4c7c-a200-fda875982b51 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:41.194055 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 9/19] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:07:41 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:07:41.200714 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4f575-776a-49a8-ab1a-2eb66fc7a491 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:41.211057 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c4f575-776a-49a8-ab1a-2eb66fc7a491 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:41.216115 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370e0e5a-752e-46e5-85df-030f3a38625a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:41.216785 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e0e5a-752e-46e5-85df-030f3a38625a admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:41.217066 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e0e5a-752e-46e5-85df-030f3a38625a admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:41.217345 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370e0e5a-752e-46e5-85df-030f3a38625a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:41.218203 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370e0e5a-752e-46e5-85df-030f3a38625a admin admin] RBAC: Adding query filter params (role.id=33d95c7861b64f1a95af8a333bd626ea, scope.domain.id=default, user.id=d89548cfaf2149148790fd3546ef2b15) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:07:41.218517 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370e0e5a-752e-46e5-85df-030f3a38625a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:41.220636 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING py.warnings [None req-370e0e5a-752e-46e5-85df-030f3a38625a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 29 20:07:41.220636 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: warnings.warn(msg) Nov 29 20:07:41.220636 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: Nov 29 20:07:41.221817 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370e0e5a-752e-46e5-85df-030f3a38625a admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:41.232207 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 11/20] 10.222.0.15 () {56 vars in 1343 bytes} [Mon Nov 29 20:07:41 2021] GET /identity/v3/role_assignments?user.id=d89548cfaf2149148790fd3546ef2b15&scope.domain.id=default&role.id=33d95c7861b64f1a95af8a333bd626ea => generated 233 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:07:43.995913 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6f8c9-2616-4a6d-8341-2e8040f2dbf7 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:43.996933 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6f8c9-2616-4a6d-8341-2e8040f2dbf7 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:43.997428 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6f8c9-2616-4a6d-8341-2e8040f2dbf7 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:43.999984 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 10/21] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:07:43 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:07:44.008199 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2af03-0d75-4030-a101-acf78b56b40b None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:44.009066 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2af03-0d75-4030-a101-acf78b56b40b None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:44.009604 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2af03-0d75-4030-a101-acf78b56b40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:44.035751 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-d8e2af03-0d75-4030-a101-acf78b56b40b None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:07:44.037333 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-d8e2af03-0d75-4030-a101-acf78b56b40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:07:44.051543 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 12/22] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:07:44 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 29 20:07:44.089694 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6f8c9-2616-4a6d-8341-2e8040f2dbf7 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:44.109839 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6f8c9-2616-4a6d-8341-2e8040f2dbf7 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:44.119779 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a20f59-0441-45b7-8a4f-98d011c6575d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:44.121267 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a20f59-0441-45b7-8a4f-98d011c6575d admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:44.122005 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a20f59-0441-45b7-8a4f-98d011c6575d admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:44.122716 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a20f59-0441-45b7-8a4f-98d011c6575d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:44.141652 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a20f59-0441-45b7-8a4f-98d011c6575d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:44.145080 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a20f59-0441-45b7-8a4f-98d011c6575d admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:44.145230 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72944106-27ad-4382-8ffd-ad91c42c3303 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:44.145495 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72944106-27ad-4382-8ffd-ad91c42c3303 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:44.146004 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72944106-27ad-4382-8ffd-ad91c42c3303 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:44.148353 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 13/23] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:07:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:07:44.154558 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737c9c7-9b6c-46dc-a7fb-6707cad60b4d None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:44.155148 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737c9c7-9b6c-46dc-a7fb-6707cad60b4d None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:44.155636 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737c9c7-9b6c-46dc-a7fb-6707cad60b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:44.168274 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-21a20f59-0441-45b7-8a4f-98d011c6575d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:07:44.169772 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 11/24] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:07:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:07:44.176099 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a20f59-0441-45b7-8a4f-98d011c6575d admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:44.186236 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-4737c9c7-9b6c-46dc-a7fb-6707cad60b4d None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:07:44.187464 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-4737c9c7-9b6c-46dc-a7fb-6707cad60b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:07:44.194910 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a20f59-0441-45b7-8a4f-98d011c6575d admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:44.202177 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 14/25] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:07:44 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 29 20:07:44.208057 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e45bd1-68d9-4dd3-89b3-e06307e9445a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:44.208732 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e45bd1-68d9-4dd3-89b3-e06307e9445a admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:44.209016 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e45bd1-68d9-4dd3-89b3-e06307e9445a admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:44.209290 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e45bd1-68d9-4dd3-89b3-e06307e9445a admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:44.210040 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e45bd1-68d9-4dd3-89b3-e06307e9445a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:07:44.210346 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e45bd1-68d9-4dd3-89b3-e06307e9445a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:44.211444 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING py.warnings [None req-87e45bd1-68d9-4dd3-89b3-e06307e9445a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 29 20:07:44.211444 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: warnings.warn(msg) Nov 29 20:07:44.211444 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: Nov 29 20:07:44.212374 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e45bd1-68d9-4dd3-89b3-e06307e9445a admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:44.213536 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19156f3-ed1a-4364-a55f-8e3d3a758ec3 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:44.213823 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19156f3-ed1a-4364-a55f-8e3d3a758ec3 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:44.214095 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19156f3-ed1a-4364-a55f-8e3d3a758ec3 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:44.216154 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 15/26] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:07:44 2021] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:07:44.222034 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1e83b-66b7-43f8-ace4-b37688684594 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:44.222325 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1e83b-66b7-43f8-ace4-b37688684594 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:44.222604 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1e83b-66b7-43f8-ace4-b37688684594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:44.246181 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 12/27] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:07:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:07:44.252437 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e45bd1-68d9-4dd3-89b3-e06307e9445a admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:44.262754 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e45bd1-68d9-4dd3-89b3-e06307e9445a admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:44.264038 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-d7d1e83b-66b7-43f8-ace4-b37688684594 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:07:44.265351 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-d7d1e83b-66b7-43f8-ace4-b37688684594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:07:44.270145 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b261b61-e6e7-4b66-b1b0-17ce581d76a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:44.270969 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b261b61-e6e7-4b66-b1b0-17ce581d76a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:44.271542 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b261b61-e6e7-4b66-b1b0-17ce581d76a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:44.272108 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b261b61-e6e7-4b66-b1b0-17ce581d76a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:44.273156 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b261b61-e6e7-4b66-b1b0-17ce581d76a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:44.274414 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING py.warnings [None req-2b261b61-e6e7-4b66-b1b0-17ce581d76a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 29 20:07:44.274414 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: warnings.warn(msg) Nov 29 20:07:44.274414 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: Nov 29 20:07:44.276005 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b261b61-e6e7-4b66-b1b0-17ce581d76a8 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:44.281724 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 16/28] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:07:44 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:07:44.282517 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1e83b-66b7-43f8-ace4-b37688684594 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:44.296413 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1e83b-66b7-43f8-ace4-b37688684594 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:44.301704 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45fa2d7-1241-458f-96fa-706256599b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:44.302885 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45fa2d7-1241-458f-96fa-706256599b77 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:44.303373 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45fa2d7-1241-458f-96fa-706256599b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:44.303822 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45fa2d7-1241-458f-96fa-706256599b77 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:44.305198 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45fa2d7-1241-458f-96fa-706256599b77 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:44.306583 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING py.warnings [None req-c45fa2d7-1241-458f-96fa-706256599b77 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 29 20:07:44.306583 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: warnings.warn(msg) Nov 29 20:07:44.306583 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: Nov 29 20:07:44.307935 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45fa2d7-1241-458f-96fa-706256599b77 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:44.465258 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 13/29] 10.222.0.15 () {60 vars in 1162 bytes} [Mon Nov 29 20:07:44 2021] POST /identity/v3/projects => generated 301 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 29 20:07:44.466294 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b261b61-e6e7-4b66-b1b0-17ce581d76a8 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:44.554087 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b261b61-e6e7-4b66-b1b0-17ce581d76a8 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:44.559250 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416321f9-8401-4c79-b131-e04d4e3ceb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:44.560119 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416321f9-8401-4c79-b131-e04d4e3ceb64 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:44.560542 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416321f9-8401-4c79-b131-e04d4e3ceb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:44.560956 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416321f9-8401-4c79-b131-e04d4e3ceb64 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:44.561964 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416321f9-8401-4c79-b131-e04d4e3ceb64 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:44.563424 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING py.warnings [None req-416321f9-8401-4c79-b131-e04d4e3ceb64 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 29 20:07:44.563424 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: warnings.warn(msg) Nov 29 20:07:44.563424 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: Nov 29 20:07:44.564661 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416321f9-8401-4c79-b131-e04d4e3ceb64 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:44.584213 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 14/30] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:07:44 2021] POST /identity/v3/roles => generated 225 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:07:44.584518 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 17/31] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:07:44 2021] POST /identity/v3/roles => generated 219 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:07:44.606046 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda04d7-d573-4ff1-a717-8216b947dbe5 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:44.606404 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda04d7-d573-4ff1-a717-8216b947dbe5 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:44.606614 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda04d7-d573-4ff1-a717-8216b947dbe5 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:44.608667 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 18/32] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:07:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:07:44.616072 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cf73e-b438-4705-b39e-cd9bd42f3fc3 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:44.616393 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cf73e-b438-4705-b39e-cd9bd42f3fc3 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:44.616642 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cf73e-b438-4705-b39e-cd9bd42f3fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:44.648200 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-9c3cf73e-b438-4705-b39e-cd9bd42f3fc3 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:07:44.649851 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-9c3cf73e-b438-4705-b39e-cd9bd42f3fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:07:44.660597 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 15/33] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:07:44 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:07:44.695341 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda04d7-d573-4ff1-a717-8216b947dbe5 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:44.715738 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda04d7-d573-4ff1-a717-8216b947dbe5 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:44.720313 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301f21d-ec8c-40ac-b736-e057058e6c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:44.721135 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301f21d-ec8c-40ac-b736-e057058e6c49 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:44.721420 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301f21d-ec8c-40ac-b736-e057058e6c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:44.721729 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301f21d-ec8c-40ac-b736-e057058e6c49 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:44.739629 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a301f21d-ec8c-40ac-b736-e057058e6c49 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:07:44.746831 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-a301f21d-ec8c-40ac-b736-e057058e6c49 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 29 20:07:44.748402 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 19/34] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Nov 29 20:07:44 2021] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:07:44.755242 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3cf73e-b438-4705-b39e-cd9bd42f3fc3 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:44.765353 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3cf73e-b438-4705-b39e-cd9bd42f3fc3 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:44.770548 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2debed-2896-4952-9418-5be730cd3508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:44.771289 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2debed-2896-4952-9418-5be730cd3508 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:44.771577 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2debed-2896-4952-9418-5be730cd3508 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:44.771856 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2debed-2896-4952-9418-5be730cd3508 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:44.772656 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2debed-2896-4952-9418-5be730cd3508 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:07:44.772967 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2debed-2896-4952-9418-5be730cd3508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:44.774719 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2debed-2896-4952-9418-5be730cd3508 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:44.784544 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 16/35] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:07:44 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:07:44.791242 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301f21d-ec8c-40ac-b736-e057058e6c49 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:44.801659 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301f21d-ec8c-40ac-b736-e057058e6c49 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:44.806448 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f30f4-732b-43ad-864a-a2d9069bf5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:44.807393 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f30f4-732b-43ad-864a-a2d9069bf5ef admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:44.807677 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f30f4-732b-43ad-864a-a2d9069bf5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:44.807954 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f30f4-732b-43ad-864a-a2d9069bf5ef admin admin] PATH_INFO: `/v3/users/d89548cfaf2149148790fd3546ef2b15` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:44.811210 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f30f4-732b-43ad-864a-a2d9069bf5ef admin admin] RBAC: Authorizing `identity:get_user(user_id=d89548cfaf2149148790fd3546ef2b15)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:44.811469 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f30f4-732b-43ad-864a-a2d9069bf5ef admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:44.813214 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 20/36] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:07:44 2021] GET /identity/v3/users/d89548cfaf2149148790fd3546ef2b15 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:07:44.819347 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2debed-2896-4952-9418-5be730cd3508 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:44.831648 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2debed-2896-4952-9418-5be730cd3508 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:44.834517 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8bce1-63cd-4134-89b5-3e0ce665194d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:44.835386 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8bce1-63cd-4134-89b5-3e0ce665194d admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:44.835668 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8bce1-63cd-4134-89b5-3e0ce665194d admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:44.835944 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8bce1-63cd-4134-89b5-3e0ce665194d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:44.837321 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8bce1-63cd-4134-89b5-3e0ce665194d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:44.839137 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8bce1-63cd-4134-89b5-3e0ce665194d admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:44.840865 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 17/37] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:07:44 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:07:44.855269 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f30f4-732b-43ad-864a-a2d9069bf5ef admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:44.868228 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f30f4-732b-43ad-864a-a2d9069bf5ef admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:44.876668 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ca429-e0ce-40ab-a790-0c7c43edeeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:44.877570 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ca429-e0ce-40ab-a790-0c7c43edeeab admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:44.877849 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ca429-e0ce-40ab-a790-0c7c43edeeab admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:44.878123 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ca429-e0ce-40ab-a790-0c7c43edeeab admin admin] PATH_INFO: `/v3/domains/default/users/d89548cfaf2149148790fd3546ef2b15/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:44.883840 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ca429-e0ce-40ab-a790-0c7c43edeeab admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=d89548cfaf2149148790fd3546ef2b15, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:44.884977 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING py.warnings [None req-860ca429-e0ce-40ab-a790-0c7c43edeeab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 29 20:07:44.884977 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: warnings.warn(msg) Nov 29 20:07:44.884977 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: Nov 29 20:07:44.887062 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ca429-e0ce-40ab-a790-0c7c43edeeab admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:44.911574 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 21/38] 10.222.0.15 () {58 vars in 1382 bytes} [Mon Nov 29 20:07:44 2021] PUT /identity/v3/domains/default/users/d89548cfaf2149148790fd3546ef2b15/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:07:45.376860 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866471c-85cd-41d5-b0d9-8f36f27f1dcb None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:45.377378 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866471c-85cd-41d5-b0d9-8f36f27f1dcb None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:45.377485 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866471c-85cd-41d5-b0d9-8f36f27f1dcb None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:45.379262 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 18/39] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:07:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:07:45.385580 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5f385-5ea2-4c78-934f-e089f32e7a7e None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:45.386002 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5f385-5ea2-4c78-934f-e089f32e7a7e None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:45.386169 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5f385-5ea2-4c78-934f-e089f32e7a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:45.405470 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-afd5f385-5ea2-4c78-934f-e089f32e7a7e None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:07:45.407059 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-afd5f385-5ea2-4c78-934f-e089f32e7a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:07:45.485080 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 22/40] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:07:45 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:07:45.509362 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9866471c-85cd-41d5-b0d9-8f36f27f1dcb None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:45.521581 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9866471c-85cd-41d5-b0d9-8f36f27f1dcb None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:45.526550 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895fae66-3882-4f03-a241-b43c508268c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:45.527321 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fae66-3882-4f03-a241-b43c508268c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:45.527673 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fae66-3882-4f03-a241-b43c508268c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:45.528018 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fae66-3882-4f03-a241-b43c508268c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:45.528853 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895fae66-3882-4f03-a241-b43c508268c2 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:45.530561 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895fae66-3882-4f03-a241-b43c508268c2 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:45.544476 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 19/41] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:07:45 2021] POST /identity/v3/roles => generated 223 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:07:45.858977 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039e4d3-b941-4f1d-8ef7-029dd8c2f2c9 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:45.859266 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039e4d3-b941-4f1d-8ef7-029dd8c2f2c9 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:45.859546 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a039e4d3-b941-4f1d-8ef7-029dd8c2f2c9 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:45.861347 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 23/42] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:07:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:07:45.867137 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608e310-cd65-4ccb-8670-746c455d1870 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:45.867427 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608e310-cd65-4ccb-8670-746c455d1870 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:45.867730 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b608e310-cd65-4ccb-8670-746c455d1870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:45.885993 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-b608e310-cd65-4ccb-8670-746c455d1870 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:07:45.887213 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-b608e310-cd65-4ccb-8670-746c455d1870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:07:45.895312 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 20/43] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:07:45 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 29 20:07:45.918605 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a039e4d3-b941-4f1d-8ef7-029dd8c2f2c9 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:45.931289 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a039e4d3-b941-4f1d-8ef7-029dd8c2f2c9 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:45.935956 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77566e08-31ef-42b4-8d2c-7cb3c9390035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:45.936727 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77566e08-31ef-42b4-8d2c-7cb3c9390035 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:45.937006 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77566e08-31ef-42b4-8d2c-7cb3c9390035 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:45.937276 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77566e08-31ef-42b4-8d2c-7cb3c9390035 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:45.938468 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77566e08-31ef-42b4-8d2c-7cb3c9390035 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:45.940198 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77566e08-31ef-42b4-8d2c-7cb3c9390035 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:45.941768 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 24/44] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:07:45 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:07:45.947538 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b608e310-cd65-4ccb-8670-746c455d1870 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:45.956513 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b608e310-cd65-4ccb-8670-746c455d1870 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:45.961332 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730af7d-2e7f-4f1d-8ea5-587123bf32ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:45.962006 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730af7d-2e7f-4f1d-8ea5-587123bf32ec admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:45.962284 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730af7d-2e7f-4f1d-8ea5-587123bf32ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:45.962559 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730af7d-2e7f-4f1d-8ea5-587123bf32ec admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:45.963325 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2730af7d-2e7f-4f1d-8ea5-587123bf32ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:45.965254 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2730af7d-2e7f-4f1d-8ea5-587123bf32ec admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:45.990204 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 21/45] 10.222.0.15 () {60 vars in 1162 bytes} [Mon Nov 29 20:07:45 2021] POST /identity/v3/projects => generated 312 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:07:47.252373 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01501099-d950-4470-9bff-c1d64c5275d7 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:47.252914 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01501099-d950-4470-9bff-c1d64c5275d7 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:47.252914 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01501099-d950-4470-9bff-c1d64c5275d7 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:47.254738 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 25/46] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:07:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:07:47.260915 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41ed3c-0e33-471e-80dd-c8e9af1d6da4 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:47.261346 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41ed3c-0e33-471e-80dd-c8e9af1d6da4 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:47.261432 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41ed3c-0e33-471e-80dd-c8e9af1d6da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:47.280105 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-6e41ed3c-0e33-471e-80dd-c8e9af1d6da4 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:07:47.281317 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-6e41ed3c-0e33-471e-80dd-c8e9af1d6da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:07:47.343807 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 22/47] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:07:47 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:07:47.367772 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01501099-d950-4470-9bff-c1d64c5275d7 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:47.380747 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01501099-d950-4470-9bff-c1d64c5275d7 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:47.385794 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51aa57-6665-49de-9137-c42f8307d048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:47.386583 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51aa57-6665-49de-9137-c42f8307d048 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:47.386896 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51aa57-6665-49de-9137-c42f8307d048 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:47.387176 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51aa57-6665-49de-9137-c42f8307d048 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:47.398281 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e51aa57-6665-49de-9137-c42f8307d048 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:07:47.405063 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-8e51aa57-6665-49de-9137-c42f8307d048 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 29 20:07:47.406215 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 26/48] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Nov 29 20:07:47 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:07:47.412499 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41ed3c-0e33-471e-80dd-c8e9af1d6da4 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:47.421894 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41ed3c-0e33-471e-80dd-c8e9af1d6da4 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:47.427676 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52311d-85ba-4f15-89ad-134826bf76f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:47.428338 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52311d-85ba-4f15-89ad-134826bf76f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:47.428643 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52311d-85ba-4f15-89ad-134826bf76f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:47.428894 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52311d-85ba-4f15-89ad-134826bf76f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:47.429663 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52311d-85ba-4f15-89ad-134826bf76f5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:07:47.429972 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52311d-85ba-4f15-89ad-134826bf76f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:47.431649 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52311d-85ba-4f15-89ad-134826bf76f5 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:47.440331 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 23/49] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:07:47 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:07:47.446085 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51aa57-6665-49de-9137-c42f8307d048 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:47.456537 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51aa57-6665-49de-9137-c42f8307d048 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:47.462357 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d107ef8-3dd5-4787-830f-1753532870ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:47.463244 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d107ef8-3dd5-4787-830f-1753532870ee admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:47.463524 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d107ef8-3dd5-4787-830f-1753532870ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:47.463799 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d107ef8-3dd5-4787-830f-1753532870ee admin admin] PATH_INFO: `/v3/users/d89548cfaf2149148790fd3546ef2b15` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:47.465192 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d107ef8-3dd5-4787-830f-1753532870ee admin admin] RBAC: Authorizing `identity:get_user(user_id=d89548cfaf2149148790fd3546ef2b15)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:47.467050 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d107ef8-3dd5-4787-830f-1753532870ee admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:47.468624 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 27/50] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:07:47 2021] GET /identity/v3/users/d89548cfaf2149148790fd3546ef2b15 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:07:47.474531 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52311d-85ba-4f15-89ad-134826bf76f5 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:47.485020 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52311d-85ba-4f15-89ad-134826bf76f5 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:47.490755 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc70f0-924e-42ac-9453-e4dd240faa87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:47.491576 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc70f0-924e-42ac-9453-e4dd240faa87 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:47.491860 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc70f0-924e-42ac-9453-e4dd240faa87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:47.492135 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc70f0-924e-42ac-9453-e4dd240faa87 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:47.493470 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc70f0-924e-42ac-9453-e4dd240faa87 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:47.495195 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc70f0-924e-42ac-9453-e4dd240faa87 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:47.496845 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 24/51] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:07:47 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:07:47.503114 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d107ef8-3dd5-4787-830f-1753532870ee admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:47.513385 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d107ef8-3dd5-4787-830f-1753532870ee admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:47.518187 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae99f7-094a-44e3-b554-31506251f989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:47.518820 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae99f7-094a-44e3-b554-31506251f989 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:47.519140 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae99f7-094a-44e3-b554-31506251f989 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:47.519421 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae99f7-094a-44e3-b554-31506251f989 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:47.520273 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae99f7-094a-44e3-b554-31506251f989 admin admin] RBAC: Adding query filter params (role.id=33d95c7861b64f1a95af8a333bd626ea, scope.domain.id=default, user.id=d89548cfaf2149148790fd3546ef2b15) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:07:47.520581 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae99f7-094a-44e3-b554-31506251f989 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:47.522445 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae99f7-094a-44e3-b554-31506251f989 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:47.528321 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 28/52] 10.222.0.15 () {56 vars in 1343 bytes} [Mon Nov 29 20:07:47 2021] GET /identity/v3/role_assignments?user.id=d89548cfaf2149148790fd3546ef2b15&scope.domain.id=default&role.id=33d95c7861b64f1a95af8a333bd626ea => generated 530 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:07:48.272922 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1741c-ba42-490b-9962-591656ecef4b None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:48.273748 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1741c-ba42-490b-9962-591656ecef4b None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:48.273748 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b1741c-ba42-490b-9962-591656ecef4b None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:48.276634 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 25/53] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:07:48 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:07:48.286145 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38f1d4-da88-4e91-a51d-387d85a304dc None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:48.286565 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38f1d4-da88-4e91-a51d-387d85a304dc None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:48.286769 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38f1d4-da88-4e91-a51d-387d85a304dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:48.307413 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-6e38f1d4-da88-4e91-a51d-387d85a304dc None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:07:48.308636 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-6e38f1d4-da88-4e91-a51d-387d85a304dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:07:48.317816 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 29/54] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:07:48 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:07:48.341123 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b1741c-ba42-490b-9962-591656ecef4b None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:48.354242 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b1741c-ba42-490b-9962-591656ecef4b None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:48.359587 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091afd7c-c20c-4067-a92a-9aa5af9540d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:48.360360 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091afd7c-c20c-4067-a92a-9aa5af9540d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:48.360642 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091afd7c-c20c-4067-a92a-9aa5af9540d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:48.360916 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091afd7c-c20c-4067-a92a-9aa5af9540d6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:48.362227 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091afd7c-c20c-4067-a92a-9aa5af9540d6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:48.363951 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091afd7c-c20c-4067-a92a-9aa5af9540d6 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:48.365503 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 26/55] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:07:48 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:07:48.371886 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38f1d4-da88-4e91-a51d-387d85a304dc None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:48.385875 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38f1d4-da88-4e91-a51d-387d85a304dc None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:48.391987 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd75c22-e711-45d2-98a3-359fe39e9be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:48.392698 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd75c22-e711-45d2-98a3-359fe39e9be2 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:48.392978 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd75c22-e711-45d2-98a3-359fe39e9be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:48.393248 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd75c22-e711-45d2-98a3-359fe39e9be2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:48.393962 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd75c22-e711-45d2-98a3-359fe39e9be2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:48.394992 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING py.warnings [None req-ddd75c22-e711-45d2-98a3-359fe39e9be2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 29 20:07:48.394992 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: warnings.warn(msg) Nov 29 20:07:48.394992 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: Nov 29 20:07:48.396207 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd75c22-e711-45d2-98a3-359fe39e9be2 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:48.428940 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 30/56] 10.222.0.15 () {60 vars in 1161 bytes} [Mon Nov 29 20:07:48 2021] POST /identity/v3/projects => generated 298 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:07:50.758073 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15064d-eec9-46e4-bca3-9e809619df30 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:50.758622 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15064d-eec9-46e4-bca3-9e809619df30 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:50.758622 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15064d-eec9-46e4-bca3-9e809619df30 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:50.760476 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 27/57] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:07:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:07:50.767286 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f564a1-fbda-4172-92ed-63a040bdb358 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:50.767968 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f564a1-fbda-4172-92ed-63a040bdb358 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:50.768222 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f564a1-fbda-4172-92ed-63a040bdb358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:50.789996 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-b4f564a1-fbda-4172-92ed-63a040bdb358 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:07:50.791220 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-b4f564a1-fbda-4172-92ed-63a040bdb358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:07:50.851797 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 31/58] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:07:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:07:50.877123 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a15064d-eec9-46e4-bca3-9e809619df30 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:50.891333 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a15064d-eec9-46e4-bca3-9e809619df30 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:50.896426 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f9f64-9efa-40ab-9449-b93ad29e7651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:50.897211 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f9f64-9efa-40ab-9449-b93ad29e7651 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:50.897495 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f9f64-9efa-40ab-9449-b93ad29e7651 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:50.897776 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f9f64-9efa-40ab-9449-b93ad29e7651 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:50.899105 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20f9f64-9efa-40ab-9449-b93ad29e7651 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:50.900863 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20f9f64-9efa-40ab-9449-b93ad29e7651 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:50.902418 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 28/59] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:07:50 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:07:50.908050 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f564a1-fbda-4172-92ed-63a040bdb358 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:50.918004 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f564a1-fbda-4172-92ed-63a040bdb358 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:50.924048 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ab588-0605-46c8-95c9-bc0037a02842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:50.924712 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ab588-0605-46c8-95c9-bc0037a02842 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:50.924998 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ab588-0605-46c8-95c9-bc0037a02842 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:50.925273 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ab588-0605-46c8-95c9-bc0037a02842 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:50.926007 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ab588-0605-46c8-95c9-bc0037a02842 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:50.927060 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING py.warnings [None req-5e7ab588-0605-46c8-95c9-bc0037a02842 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 29 20:07:50.927060 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: warnings.warn(msg) Nov 29 20:07:50.927060 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: Nov 29 20:07:50.928310 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ab588-0605-46c8-95c9-bc0037a02842 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:50.960202 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 32/60] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Nov 29 20:07:50 2021] POST /identity/v3/users => generated 275 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:07:54.315243 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39170a-fee6-47f9-b71b-a185076a91ad None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:54.315823 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39170a-fee6-47f9-b71b-a185076a91ad None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:54.315823 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39170a-fee6-47f9-b71b-a185076a91ad None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:54.317846 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 29/61] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:07:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:07:54.323520 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43999f7-850a-483d-adf6-e601007f4890 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:54.323940 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43999f7-850a-483d-adf6-e601007f4890 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:54.324135 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43999f7-850a-483d-adf6-e601007f4890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:54.346674 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-c43999f7-850a-483d-adf6-e601007f4890 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:07:54.347948 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-c43999f7-850a-483d-adf6-e601007f4890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:07:54.361815 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 33/62] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:07:54 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:07:54.385925 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39170a-fee6-47f9-b71b-a185076a91ad None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:54.404457 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39170a-fee6-47f9-b71b-a185076a91ad None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:54.412300 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8852a-3b58-4969-807b-db93966bd781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:54.413107 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8852a-3b58-4969-807b-db93966bd781 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:54.413389 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8852a-3b58-4969-807b-db93966bd781 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:54.413663 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8852a-3b58-4969-807b-db93966bd781 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:54.427613 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc8852a-3b58-4969-807b-db93966bd781 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:07:54.434493 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-fcc8852a-3b58-4969-807b-db93966bd781 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 29 20:07:54.435732 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 30/63] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:07:54 2021] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:07:54.442178 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43999f7-850a-483d-adf6-e601007f4890 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:54.455813 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43999f7-850a-483d-adf6-e601007f4890 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:54.462827 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9416b6f-59a7-4d7a-ae18-2fe5be0bd5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:54.463527 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9416b6f-59a7-4d7a-ae18-2fe5be0bd5c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:54.463809 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9416b6f-59a7-4d7a-ae18-2fe5be0bd5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:54.464086 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9416b6f-59a7-4d7a-ae18-2fe5be0bd5c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:54.464857 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9416b6f-59a7-4d7a-ae18-2fe5be0bd5c5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:07:54.465174 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9416b6f-59a7-4d7a-ae18-2fe5be0bd5c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:54.466172 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING py.warnings [None req-e9416b6f-59a7-4d7a-ae18-2fe5be0bd5c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 29 20:07:54.466172 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: warnings.warn(msg) Nov 29 20:07:54.466172 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: Nov 29 20:07:54.467118 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9416b6f-59a7-4d7a-ae18-2fe5be0bd5c5 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:54.493449 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 34/64] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Nov 29 20:07:54 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:07:54.499281 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8852a-3b58-4969-807b-db93966bd781 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:54.510181 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8852a-3b58-4969-807b-db93966bd781 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:54.525865 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73449e-7b99-4be9-9f8c-2ded4f64a979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:54.526741 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73449e-7b99-4be9-9f8c-2ded4f64a979 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:54.527050 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73449e-7b99-4be9-9f8c-2ded4f64a979 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:54.527327 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73449e-7b99-4be9-9f8c-2ded4f64a979 admin admin] PATH_INFO: `/v3/users/c91aa55f3c094ec2b5eed7180bc6fd6e` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:54.547579 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73449e-7b99-4be9-9f8c-2ded4f64a979 admin admin] RBAC: Authorizing `identity:get_user(user_id=c91aa55f3c094ec2b5eed7180bc6fd6e)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:54.549778 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73449e-7b99-4be9-9f8c-2ded4f64a979 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:54.551534 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 31/65] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:07:54 2021] GET /identity/v3/users/c91aa55f3c094ec2b5eed7180bc6fd6e => generated 275 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:07:54.557680 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9416b6f-59a7-4d7a-ae18-2fe5be0bd5c5 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:54.572051 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9416b6f-59a7-4d7a-ae18-2fe5be0bd5c5 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:54.583991 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9e325-eadf-4736-9d46-f20fd71bf1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:54.584653 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9e325-eadf-4736-9d46-f20fd71bf1f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:54.584933 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9e325-eadf-4736-9d46-f20fd71bf1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:54.585209 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9e325-eadf-4736-9d46-f20fd71bf1f4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:54.598639 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df9e325-eadf-4736-9d46-f20fd71bf1f4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:54.600489 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df9e325-eadf-4736-9d46-f20fd71bf1f4 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:54.612473 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 35/66] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:07:54 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:07:54.618513 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73449e-7b99-4be9-9f8c-2ded4f64a979 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:54.628441 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73449e-7b99-4be9-9f8c-2ded4f64a979 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:54.639023 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84644f7c-0742-4de9-98cc-2320b6fc376e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:54.639897 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84644f7c-0742-4de9-98cc-2320b6fc376e admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:54.640184 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84644f7c-0742-4de9-98cc-2320b6fc376e admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:54.640462 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84644f7c-0742-4de9-98cc-2320b6fc376e admin admin] PATH_INFO: `/v3/projects/4facf8265b034e41b65929b2699eb944` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:54.647978 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84644f7c-0742-4de9-98cc-2320b6fc376e admin admin] RBAC: Authorizing `identity:get_project(project_id=4facf8265b034e41b65929b2699eb944)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:54.650027 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84644f7c-0742-4de9-98cc-2320b6fc376e admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:54.651850 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 32/67] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:07:54 2021] GET /identity/v3/projects/4facf8265b034e41b65929b2699eb944 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:07:54.658718 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9e325-eadf-4736-9d46-f20fd71bf1f4 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:54.670247 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e89cb-27b9-41ee-9d3a-049e7f6cf59d None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:54.670824 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e89cb-27b9-41ee-9d3a-049e7f6cf59d None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:54.671323 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e89cb-27b9-41ee-9d3a-049e7f6cf59d None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:54.671891 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9e325-eadf-4736-9d46-f20fd71bf1f4 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:54.673467 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 33/68] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:07:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 29 20:07:54.678862 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4bbcdf-566f-4d84-9c05-40bec47530d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:54.679518 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bbcdf-566f-4d84-9c05-40bec47530d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:54.679802 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bbcdf-566f-4d84-9c05-40bec47530d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:54.680064 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a0bb5-fae3-461c-8aac-533562e9efbb None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:54.680163 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bbcdf-566f-4d84-9c05-40bec47530d1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:54.680609 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a0bb5-fae3-461c-8aac-533562e9efbb None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:54.680915 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4bbcdf-566f-4d84-9c05-40bec47530d1 admin admin] RBAC: Adding query filter params (role.id=88a0e2c4c85c4449ad4681edcdc57835, scope.project.id=4facf8265b034e41b65929b2699eb944, user.id=c91aa55f3c094ec2b5eed7180bc6fd6e) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:07:54.681227 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4bbcdf-566f-4d84-9c05-40bec47530d1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:54.681412 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a0bb5-fae3-461c-8aac-533562e9efbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:54.683269 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4bbcdf-566f-4d84-9c05-40bec47530d1 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:54.691846 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 36/69] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:07:54 2021] GET /identity/v3/role_assignments?user.id=c91aa55f3c094ec2b5eed7180bc6fd6e&scope.project.id=4facf8265b034e41b65929b2699eb944&role.id=88a0e2c4c85c4449ad4681edcdc57835 => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:07:54.716139 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-8a8a0bb5-fae3-461c-8aac-533562e9efbb None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:07:54.717692 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-8a8a0bb5-fae3-461c-8aac-533562e9efbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:07:54.725930 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 34/70] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:07:54 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 29 20:07:54.754282 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4bbcdf-566f-4d84-9c05-40bec47530d1 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:54.768256 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4bbcdf-566f-4d84-9c05-40bec47530d1 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:54.776693 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16460b-69ab-414a-a8dc-1d4fb6b06cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:54.777845 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16460b-69ab-414a-a8dc-1d4fb6b06cf8 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:54.778294 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16460b-69ab-414a-a8dc-1d4fb6b06cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:54.778715 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16460b-69ab-414a-a8dc-1d4fb6b06cf8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:54.793945 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c16460b-69ab-414a-a8dc-1d4fb6b06cf8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:07:54.797463 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9711b12-34d6-4630-9285-856c8e15d5fe None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:54.798001 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9711b12-34d6-4630-9285-856c8e15d5fe None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:54.798452 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9711b12-34d6-4630-9285-856c8e15d5fe None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:54.800480 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 35/71] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:07:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 29 20:07:54.804485 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-9c16460b-69ab-414a-a8dc-1d4fb6b06cf8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 29 20:07:54.805768 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 37/72] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Nov 29 20:07:54 2021] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:07:54.812818 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9711b12-34d6-4630-9285-856c8e15d5fe None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:54.815797 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889a7d8-4e41-47ee-a10b-e9744351d335 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:54.816091 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889a7d8-4e41-47ee-a10b-e9744351d335 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:54.816373 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2889a7d8-4e41-47ee-a10b-e9744351d335 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:54.818226 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 38/73] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:07:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 29 20:07:54.822202 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011bcf5c-fd5f-4e71-8fde-e60aaaa18f5f None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:54.822426 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011bcf5c-fd5f-4e71-8fde-e60aaaa18f5f None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:54.822710 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011bcf5c-fd5f-4e71-8fde-e60aaaa18f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:54.830838 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9711b12-34d6-4630-9285-856c8e15d5fe None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:54.835668 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba409bc8-f3dd-4bde-ac93-c74eb60ebac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:54.836677 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba409bc8-f3dd-4bde-ac93-c74eb60ebac5 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:54.837170 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba409bc8-f3dd-4bde-ac93-c74eb60ebac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:54.837662 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba409bc8-f3dd-4bde-ac93-c74eb60ebac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:54.838719 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba409bc8-f3dd-4bde-ac93-c74eb60ebac5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:07:54.839285 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba409bc8-f3dd-4bde-ac93-c74eb60ebac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:54.841166 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba409bc8-f3dd-4bde-ac93-c74eb60ebac5 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:54.847395 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-011bcf5c-fd5f-4e71-8fde-e60aaaa18f5f None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:07:54.848628 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-011bcf5c-fd5f-4e71-8fde-e60aaaa18f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:07:54.851494 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 36/74] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:07:54 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:07:54.853062 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355eec7a-be79-4ed5-a99a-a7af334c7507 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:54.853611 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355eec7a-be79-4ed5-a99a-a7af334c7507 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:54.854087 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355eec7a-be79-4ed5-a99a-a7af334c7507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:54.857074 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 39/75] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:07:54 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 29 20:07:54.862898 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011bcf5c-fd5f-4e71-8fde-e60aaaa18f5f None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:54.868885 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011bcf5c-fd5f-4e71-8fde-e60aaaa18f5f None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:54.873740 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9063f59-7032-4214-ac80-388e2a7a5be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:54.874663 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9063f59-7032-4214-ac80-388e2a7a5be5 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:54.874977 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9063f59-7032-4214-ac80-388e2a7a5be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:54.875257 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9063f59-7032-4214-ac80-388e2a7a5be5 admin admin] PATH_INFO: `/v3/users/d89548cfaf2149148790fd3546ef2b15` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:54.876653 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9063f59-7032-4214-ac80-388e2a7a5be5 admin admin] RBAC: Authorizing `identity:get_user(user_id=d89548cfaf2149148790fd3546ef2b15)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:54.878604 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9063f59-7032-4214-ac80-388e2a7a5be5 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:54.880847 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 40/76] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:07:54 2021] GET /identity/v3/users/d89548cfaf2149148790fd3546ef2b15 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:07:54.889685 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9063f59-7032-4214-ac80-388e2a7a5be5 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:54.891087 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-355eec7a-be79-4ed5-a99a-a7af334c7507 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:07:54.892780 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-355eec7a-be79-4ed5-a99a-a7af334c7507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:07:54.904740 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9063f59-7032-4214-ac80-388e2a7a5be5 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:54.910365 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 37/77] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:07:54 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:07:54.911322 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355eec7a-be79-4ed5-a99a-a7af334c7507 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:54.911794 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb1393-a047-4ebe-89bc-2ade89869403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:54.912700 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb1393-a047-4ebe-89bc-2ade89869403 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:54.913180 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb1393-a047-4ebe-89bc-2ade89869403 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:54.913642 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb1393-a047-4ebe-89bc-2ade89869403 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:54.920995 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355eec7a-be79-4ed5-a99a-a7af334c7507 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:54.924060 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb1393-a047-4ebe-89bc-2ade89869403 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:54.926026 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff659d-b62d-4b88-87d3-bd1e178a8886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:54.926222 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cb1393-a047-4ebe-89bc-2ade89869403 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:54.927186 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff659d-b62d-4b88-87d3-bd1e178a8886 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:54.927606 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff659d-b62d-4b88-87d3-bd1e178a8886 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:54.928037 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff659d-b62d-4b88-87d3-bd1e178a8886 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:54.937494 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 41/78] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:07:54 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:07:54.939955 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff659d-b62d-4b88-87d3-bd1e178a8886 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:07:54.943529 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb1393-a047-4ebe-89bc-2ade89869403 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:54.947808 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-fdff659d-b62d-4b88-87d3-bd1e178a8886 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 29 20:07:54.949503 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 38/79] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Nov 29 20:07:54 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:07:54.954337 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff659d-b62d-4b88-87d3-bd1e178a8886 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:54.957158 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb1393-a047-4ebe-89bc-2ade89869403 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:54.962873 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6041e-9683-4b70-a67e-ddcf66e4fd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:54.964014 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6041e-9683-4b70-a67e-ddcf66e4fd0e admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:54.964513 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6041e-9683-4b70-a67e-ddcf66e4fd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:54.964969 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6041e-9683-4b70-a67e-ddcf66e4fd0e admin admin] PATH_INFO: `/v3/projects/4facf8265b034e41b65929b2699eb944` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:54.965150 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff659d-b62d-4b88-87d3-bd1e178a8886 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:54.966721 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6041e-9683-4b70-a67e-ddcf66e4fd0e admin admin] RBAC: Authorizing `identity:get_project(project_id=4facf8265b034e41b65929b2699eb944)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:54.969202 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6041e-9683-4b70-a67e-ddcf66e4fd0e admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:54.969623 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d5429-1f40-4bd0-a8d4-78c1e07a4135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:54.970409 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d5429-1f40-4bd0-a8d4-78c1e07a4135 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:54.970695 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d5429-1f40-4bd0-a8d4-78c1e07a4135 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:54.971014 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d5429-1f40-4bd0-a8d4-78c1e07a4135 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:54.971961 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 42/80] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:07:54 2021] GET /identity/v3/projects/4facf8265b034e41b65929b2699eb944 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:07:54.972994 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6041e-9683-4b70-a67e-ddcf66e4fd0e admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:54.982539 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6041e-9683-4b70-a67e-ddcf66e4fd0e admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:54.983312 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d5429-1f40-4bd0-a8d4-78c1e07a4135 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:07:54.987444 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ed80a-f423-48cf-a3c6-d9ed2c33db99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:54.988360 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ed80a-f423-48cf-a3c6-d9ed2c33db99 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:54.988864 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ed80a-f423-48cf-a3c6-d9ed2c33db99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:54.989334 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ed80a-f423-48cf-a3c6-d9ed2c33db99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:54.990274 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43ed80a-f423-48cf-a3c6-d9ed2c33db99 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:07:54.990764 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43ed80a-f423-48cf-a3c6-d9ed2c33db99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:54.990898 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-c87d5429-1f40-4bd0-a8d4-78c1e07a4135 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 29 20:07:54.992020 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 39/81] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:07:54 2021] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:07:54.992899 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d5429-1f40-4bd0-a8d4-78c1e07a4135 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:54.993007 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43ed80a-f423-48cf-a3c6-d9ed2c33db99 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:55.005527 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 43/82] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:07:54 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:07:55.005914 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d5429-1f40-4bd0-a8d4-78c1e07a4135 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:55.007369 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ed80a-f423-48cf-a3c6-d9ed2c33db99 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:55.011038 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae9afcb-40e2-4916-bfd8-867a1a387ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:55.011691 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9afcb-40e2-4916-bfd8-867a1a387ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:55.011975 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9afcb-40e2-4916-bfd8-867a1a387ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:55.012251 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9afcb-40e2-4916-bfd8-867a1a387ca8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:55.013110 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae9afcb-40e2-4916-bfd8-867a1a387ca8 admin admin] RBAC: Adding query filter params (role.id=33d95c7861b64f1a95af8a333bd626ea, scope.project.id=4facf8265b034e41b65929b2699eb944, user.id=d89548cfaf2149148790fd3546ef2b15) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:07:55.013421 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae9afcb-40e2-4916-bfd8-867a1a387ca8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:55.014671 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING py.warnings [None req-5ae9afcb-40e2-4916-bfd8-867a1a387ca8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 29 20:07:55.014671 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: warnings.warn(msg) Nov 29 20:07:55.014671 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: Nov 29 20:07:55.016529 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae9afcb-40e2-4916-bfd8-867a1a387ca8 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:55.019273 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ed80a-f423-48cf-a3c6-d9ed2c33db99 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:55.023885 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a2419-1d2c-4a7c-a7d2-8955c7ee4bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:55.024376 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 40/83] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:07:54 2021] GET /identity/v3/role_assignments?user.id=d89548cfaf2149148790fd3546ef2b15&scope.project.id=4facf8265b034e41b65929b2699eb944&role.id=33d95c7861b64f1a95af8a333bd626ea => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:07:55.024974 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a2419-1d2c-4a7c-a7d2-8955c7ee4bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:55.025568 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a2419-1d2c-4a7c-a7d2-8955c7ee4bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:55.026040 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a2419-1d2c-4a7c-a7d2-8955c7ee4bd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:55.027057 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a2419-1d2c-4a7c-a7d2-8955c7ee4bd2 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:07:55.027569 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a2419-1d2c-4a7c-a7d2-8955c7ee4bd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:55.029392 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a2419-1d2c-4a7c-a7d2-8955c7ee4bd2 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:55.032628 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae9afcb-40e2-4916-bfd8-867a1a387ca8 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:55.041379 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 44/84] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Nov 29 20:07:55 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:07:55.046177 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae9afcb-40e2-4916-bfd8-867a1a387ca8 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:55.053694 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a2419-1d2c-4a7c-a7d2-8955c7ee4bd2 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:55.056233 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c44303-95a7-4474-b593-abc297ba83be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:55.057175 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c44303-95a7-4474-b593-abc297ba83be admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:55.057460 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c44303-95a7-4474-b593-abc297ba83be admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:55.057737 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c44303-95a7-4474-b593-abc297ba83be admin admin] PATH_INFO: `/v3/users/c91aa55f3c094ec2b5eed7180bc6fd6e` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:55.059003 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c44303-95a7-4474-b593-abc297ba83be admin admin] RBAC: Authorizing `identity:get_user(user_id=c91aa55f3c094ec2b5eed7180bc6fd6e)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:55.066917 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c44303-95a7-4474-b593-abc297ba83be admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:55.066917 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 41/85] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:07:55 2021] GET /identity/v3/users/c91aa55f3c094ec2b5eed7180bc6fd6e => generated 275 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:07:55.069885 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c44303-95a7-4474-b593-abc297ba83be admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:55.079029 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a2419-1d2c-4a7c-a7d2-8955c7ee4bd2 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:55.089237 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f45fb7-3d69-40be-93e0-99d0cd2441ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:55.090140 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f45fb7-3d69-40be-93e0-99d0cd2441ec admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:55.090420 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f45fb7-3d69-40be-93e0-99d0cd2441ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:55.090696 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f45fb7-3d69-40be-93e0-99d0cd2441ec admin admin] PATH_INFO: `/v3/users/c91aa55f3c094ec2b5eed7180bc6fd6e` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:55.091841 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c44303-95a7-4474-b593-abc297ba83be admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:55.093705 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f45fb7-3d69-40be-93e0-99d0cd2441ec admin admin] RBAC: Authorizing `identity:get_user(user_id=c91aa55f3c094ec2b5eed7180bc6fd6e)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:55.095927 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f45fb7-3d69-40be-93e0-99d0cd2441ec admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:55.097637 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 45/86] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:07:55 2021] GET /identity/v3/users/c91aa55f3c094ec2b5eed7180bc6fd6e => generated 275 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:07:55.101425 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6fd518-43a5-4d53-825c-ebf679a9343c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:55.102097 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fd518-43a5-4d53-825c-ebf679a9343c admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:55.102382 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fd518-43a5-4d53-825c-ebf679a9343c admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:55.102660 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fd518-43a5-4d53-825c-ebf679a9343c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:55.114146 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f45fb7-3d69-40be-93e0-99d0cd2441ec admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:55.125990 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6fd518-43a5-4d53-825c-ebf679a9343c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:55.129390 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f45fb7-3d69-40be-93e0-99d0cd2441ec admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:55.131254 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6fd518-43a5-4d53-825c-ebf679a9343c admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:55.140827 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b960a-851b-44e7-8176-d866c3e0b338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:55.141508 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b960a-851b-44e7-8176-d866c3e0b338 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:55.141957 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b960a-851b-44e7-8176-d866c3e0b338 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:55.142244 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b960a-851b-44e7-8176-d866c3e0b338 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:55.147086 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 42/87] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:07:55 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:07:55.151416 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972b960a-851b-44e7-8176-d866c3e0b338 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:55.152112 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6fd518-43a5-4d53-825c-ebf679a9343c admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:55.153615 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972b960a-851b-44e7-8176-d866c3e0b338 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:55.164558 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 46/88] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:07:55 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:07:55.170526 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6fd518-43a5-4d53-825c-ebf679a9343c admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:55.175105 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de67ad-daaa-4799-8a62-d31606daf9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:55.176311 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de67ad-daaa-4799-8a62-d31606daf9c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:55.176737 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de67ad-daaa-4799-8a62-d31606daf9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:55.176990 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b960a-851b-44e7-8176-d866c3e0b338 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:55.177313 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83de67ad-daaa-4799-8a62-d31606daf9c7 admin admin] PATH_INFO: `/v3/projects/4facf8265b034e41b65929b2699eb944` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:55.178752 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de67ad-daaa-4799-8a62-d31606daf9c7 admin admin] RBAC: Authorizing `identity:get_project(project_id=4facf8265b034e41b65929b2699eb944)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:55.181077 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83de67ad-daaa-4799-8a62-d31606daf9c7 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:55.183440 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 43/89] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:07:55 2021] GET /identity/v3/projects/4facf8265b034e41b65929b2699eb944 => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:07:55.189946 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de67ad-daaa-4799-8a62-d31606daf9c7 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:55.196416 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b960a-851b-44e7-8176-d866c3e0b338 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:55.202523 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83de67ad-daaa-4799-8a62-d31606daf9c7 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:55.207019 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874ccd8-a1c6-49df-92e4-1b06afbcb0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:55.208157 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874ccd8-a1c6-49df-92e4-1b06afbcb0d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:55.209157 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874ccd8-a1c6-49df-92e4-1b06afbcb0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:55.209939 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874ccd8-a1c6-49df-92e4-1b06afbcb0d2 admin admin] PATH_INFO: `/v3/projects/cdcd751220ba4b99976025fa89d35abd` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:55.212347 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f874ccd8-a1c6-49df-92e4-1b06afbcb0d2 admin admin] RBAC: Authorizing `identity:get_project(project_id=cdcd751220ba4b99976025fa89d35abd)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:55.216350 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f874ccd8-a1c6-49df-92e4-1b06afbcb0d2 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:55.217320 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35ee0b-b0ce-4745-9f58-24fd19df1874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:55.218153 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35ee0b-b0ce-4745-9f58-24fd19df1874 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:55.218587 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35ee0b-b0ce-4745-9f58-24fd19df1874 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:55.220305 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35ee0b-b0ce-4745-9f58-24fd19df1874 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:55.221403 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35ee0b-b0ce-4745-9f58-24fd19df1874 admin admin] RBAC: Adding query filter params (role.id=d63eb17a7e7d455ea5f2c6696d92978c, scope.project.id=4facf8265b034e41b65929b2699eb944, user.id=c91aa55f3c094ec2b5eed7180bc6fd6e) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:07:55.222311 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 47/90] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:07:55 2021] GET /identity/v3/projects/cdcd751220ba4b99976025fa89d35abd => generated 312 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:07:55.222880 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35ee0b-b0ce-4745-9f58-24fd19df1874 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:55.225016 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35ee0b-b0ce-4745-9f58-24fd19df1874 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:55.232695 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 44/91] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:07:55 2021] GET /identity/v3/role_assignments?user.id=c91aa55f3c094ec2b5eed7180bc6fd6e&scope.project.id=4facf8265b034e41b65929b2699eb944&role.id=d63eb17a7e7d455ea5f2c6696d92978c => generated 259 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:07:55.234025 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874ccd8-a1c6-49df-92e4-1b06afbcb0d2 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:55.249864 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874ccd8-a1c6-49df-92e4-1b06afbcb0d2 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:55.264102 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea363599-ee74-4ffd-8b57-0dcec9f7385c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:55.265091 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea363599-ee74-4ffd-8b57-0dcec9f7385c admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:55.265538 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea363599-ee74-4ffd-8b57-0dcec9f7385c admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:55.265960 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea363599-ee74-4ffd-8b57-0dcec9f7385c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:55.267028 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea363599-ee74-4ffd-8b57-0dcec9f7385c admin admin] RBAC: Adding query filter params (role.id=88a0e2c4c85c4449ad4681edcdc57835, scope.project.id=cdcd751220ba4b99976025fa89d35abd, user.id=c91aa55f3c094ec2b5eed7180bc6fd6e) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:07:55.267499 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea363599-ee74-4ffd-8b57-0dcec9f7385c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:55.269602 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea363599-ee74-4ffd-8b57-0dcec9f7385c admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:55.276378 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 48/92] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:07:55 2021] GET /identity/v3/role_assignments?user.id=c91aa55f3c094ec2b5eed7180bc6fd6e&scope.project.id=cdcd751220ba4b99976025fa89d35abd&role.id=88a0e2c4c85c4449ad4681edcdc57835 => generated 259 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:07:55.369615 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db2b94-6259-430b-863f-35c67c66443d None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:55.370114 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db2b94-6259-430b-863f-35c67c66443d None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:55.370114 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db2b94-6259-430b-863f-35c67c66443d None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:55.371940 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 45/93] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:07:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:07:55.378489 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bd62f-0e57-4293-902f-397ff11b7fea None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:55.379084 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bd62f-0e57-4293-902f-397ff11b7fea None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:55.379084 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445bd62f-0e57-4293-902f-397ff11b7fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:55.405979 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-445bd62f-0e57-4293-902f-397ff11b7fea None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:07:55.411500 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-445bd62f-0e57-4293-902f-397ff11b7fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:07:55.423493 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 49/94] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:07:55 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 29 20:07:55.468536 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db2b94-6259-430b-863f-35c67c66443d None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:55.488257 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db2b94-6259-430b-863f-35c67c66443d None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:55.493319 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a96993-9c9e-4a28-8466-e220776222d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:55.494544 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a96993-9c9e-4a28-8466-e220776222d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:55.495058 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a96993-9c9e-4a28-8466-e220776222d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:55.495583 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a96993-9c9e-4a28-8466-e220776222d9 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:55.499714 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a96993-9c9e-4a28-8466-e220776222d9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:55.501856 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a96993-9c9e-4a28-8466-e220776222d9 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:55.504272 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 46/95] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:07:55 2021] GET /identity/v3/domains/default => generated 199 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:07:55.511281 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445bd62f-0e57-4293-902f-397ff11b7fea None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:55.521175 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445bd62f-0e57-4293-902f-397ff11b7fea None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:55.530735 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1900f-aec0-4765-b18f-96c0496b0bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:55.531468 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1900f-aec0-4765-b18f-96c0496b0bfa admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:55.531749 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1900f-aec0-4765-b18f-96c0496b0bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:55.532027 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1900f-aec0-4765-b18f-96c0496b0bfa admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:55.532775 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa1900f-aec0-4765-b18f-96c0496b0bfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:55.534725 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa1900f-aec0-4765-b18f-96c0496b0bfa admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:55.562903 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 50/96] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Nov 29 20:07:55 2021] POST /identity/v3/users => generated 289 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:07:57.397640 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f8490-123a-4cf6-9bcf-aa803f339f17 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:57.398159 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f8490-123a-4cf6-9bcf-aa803f339f17 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:57.398231 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f8490-123a-4cf6-9bcf-aa803f339f17 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:57.400019 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 47/97] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:07:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:07:57.406041 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecd2e1-66a1-4e22-b406-dd2e9c5bfb5f None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:57.406925 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecd2e1-66a1-4e22-b406-dd2e9c5bfb5f None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:57.407422 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecd2e1-66a1-4e22-b406-dd2e9c5bfb5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:57.428696 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-d8ecd2e1-66a1-4e22-b406-dd2e9c5bfb5f None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:07:57.430172 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-d8ecd2e1-66a1-4e22-b406-dd2e9c5bfb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:07:57.445348 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 51/98] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:07:57 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:07:57.468537 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f8490-123a-4cf6-9bcf-aa803f339f17 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:57.487634 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f8490-123a-4cf6-9bcf-aa803f339f17 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:57.492529 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7396995-1035-412e-8476-52530218a29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:57.493351 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7396995-1035-412e-8476-52530218a29b admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:57.493634 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7396995-1035-412e-8476-52530218a29b admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:57.493909 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7396995-1035-412e-8476-52530218a29b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:57.514397 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7396995-1035-412e-8476-52530218a29b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:07:57.521472 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-a7396995-1035-412e-8476-52530218a29b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 29 20:07:57.522738 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 48/99] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:07:57 2021] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:07:57.529434 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ecd2e1-66a1-4e22-b406-dd2e9c5bfb5f None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:57.543980 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ecd2e1-66a1-4e22-b406-dd2e9c5bfb5f None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:57.559901 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e6c16-7ecd-494e-88e8-45bf16995eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:57.561090 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e6c16-7ecd-494e-88e8-45bf16995eab admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:57.561629 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e6c16-7ecd-494e-88e8-45bf16995eab admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:57.562089 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e6c16-7ecd-494e-88e8-45bf16995eab admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:57.563067 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e6c16-7ecd-494e-88e8-45bf16995eab admin admin] RBAC: Adding query filter params (name=member) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:07:57.563559 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e6c16-7ecd-494e-88e8-45bf16995eab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:57.565338 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e6c16-7ecd-494e-88e8-45bf16995eab admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:57.578306 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 52/100] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Nov 29 20:07:57 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:07:57.584632 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7396995-1035-412e-8476-52530218a29b admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:57.599228 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7396995-1035-412e-8476-52530218a29b admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:57.607473 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95570c33-201b-4a3d-ae3e-95bf3c07d65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:57.608356 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95570c33-201b-4a3d-ae3e-95bf3c07d65c admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:57.608648 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95570c33-201b-4a3d-ae3e-95bf3c07d65c admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:57.608931 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95570c33-201b-4a3d-ae3e-95bf3c07d65c admin admin] PATH_INFO: `/v3/users/c91aa55f3c094ec2b5eed7180bc6fd6e` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:57.610186 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95570c33-201b-4a3d-ae3e-95bf3c07d65c admin admin] RBAC: Authorizing `identity:get_user(user_id=c91aa55f3c094ec2b5eed7180bc6fd6e)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:57.612397 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95570c33-201b-4a3d-ae3e-95bf3c07d65c admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:57.614023 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 49/101] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:07:57 2021] GET /identity/v3/users/c91aa55f3c094ec2b5eed7180bc6fd6e => generated 275 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:07:57.620551 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e6c16-7ecd-494e-88e8-45bf16995eab admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:57.636251 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e6c16-7ecd-494e-88e8-45bf16995eab admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:57.646568 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13c4e2-be4b-4811-88c0-a4cf3b62dd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:57.647775 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13c4e2-be4b-4811-88c0-a4cf3b62dd7b admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:57.648235 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13c4e2-be4b-4811-88c0-a4cf3b62dd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:57.648695 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13c4e2-be4b-4811-88c0-a4cf3b62dd7b admin admin] PATH_INFO: `/v3/projects/4facf8265b034e41b65929b2699eb944` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:57.655620 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c13c4e2-be4b-4811-88c0-a4cf3b62dd7b admin admin] RBAC: Authorizing `identity:get_project(project_id=4facf8265b034e41b65929b2699eb944)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:57.657881 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c13c4e2-be4b-4811-88c0-a4cf3b62dd7b admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:57.659840 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 53/102] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:07:57 2021] GET /identity/v3/projects/4facf8265b034e41b65929b2699eb944 => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:07:57.666212 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95570c33-201b-4a3d-ae3e-95bf3c07d65c admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:57.680102 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95570c33-201b-4a3d-ae3e-95bf3c07d65c admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:57.690734 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de04fb-d133-4755-acbf-2cbceec04730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:57.691669 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de04fb-d133-4755-acbf-2cbceec04730 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:57.691951 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de04fb-d133-4755-acbf-2cbceec04730 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:57.692229 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de04fb-d133-4755-acbf-2cbceec04730 admin admin] PATH_INFO: `/v3/projects/4facf8265b034e41b65929b2699eb944/users/c91aa55f3c094ec2b5eed7180bc6fd6e/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:57.700325 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de04fb-d133-4755-acbf-2cbceec04730 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4facf8265b034e41b65929b2699eb944, user_id=c91aa55f3c094ec2b5eed7180bc6fd6e, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:57.701374 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING py.warnings [None req-91de04fb-d133-4755-acbf-2cbceec04730 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 29 20:07:57.701374 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: warnings.warn(msg) Nov 29 20:07:57.701374 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: Nov 29 20:07:57.703391 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de04fb-d133-4755-acbf-2cbceec04730 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:57.725657 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 50/103] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Nov 29 20:07:57 2021] PUT /identity/v3/projects/4facf8265b034e41b65929b2699eb944/users/c91aa55f3c094ec2b5eed7180bc6fd6e/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:07:58.195995 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033aedfd-b9e3-4fb8-97e7-f7357713aa8e None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:58.196740 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033aedfd-b9e3-4fb8-97e7-f7357713aa8e None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:58.197234 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033aedfd-b9e3-4fb8-97e7-f7357713aa8e None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:58.199330 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 54/104] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:07:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:07:58.206036 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe240b6-e28b-431b-81be-7318ad2ebab9 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:58.206330 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe240b6-e28b-431b-81be-7318ad2ebab9 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:58.206614 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe240b6-e28b-431b-81be-7318ad2ebab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:58.231858 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-afe240b6-e28b-431b-81be-7318ad2ebab9 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:07:58.233074 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-afe240b6-e28b-431b-81be-7318ad2ebab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:07:58.257324 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12952f-20f4-4fcb-84f9-0735bc809b4c None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:58.257925 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12952f-20f4-4fcb-84f9-0735bc809b4c None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:58.258413 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a12952f-20f4-4fcb-84f9-0735bc809b4c None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:58.260473 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 55/105] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:07:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 29 20:07:58.266822 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1c770-d0c8-433a-a331-050397a21737 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:58.267367 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1c770-d0c8-433a-a331-050397a21737 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:58.267857 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1c770-d0c8-433a-a331-050397a21737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:58.297203 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-4ed1c770-d0c8-433a-a331-050397a21737 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:07:58.297731 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 51/106] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:07:58 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:07:58.298828 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-4ed1c770-d0c8-433a-a331-050397a21737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:07:58.310071 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 56/107] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:07:58 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 29 20:07:58.327632 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe240b6-e28b-431b-81be-7318ad2ebab9 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:58.337231 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe240b6-e28b-431b-81be-7318ad2ebab9 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:58.342177 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310a09c-ffc4-4be6-8cf8-37c25fc89b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:58.343321 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310a09c-ffc4-4be6-8cf8-37c25fc89b84 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:58.343804 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310a09c-ffc4-4be6-8cf8-37c25fc89b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:58.344302 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310a09c-ffc4-4be6-8cf8-37c25fc89b84 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:58.346816 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1c770-d0c8-433a-a331-050397a21737 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:58.357250 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1c770-d0c8-433a-a331-050397a21737 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:58.365177 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f1f3f-f93e-4ddd-8224-37fe8ecbfe7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:58.366327 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f1f3f-f93e-4ddd-8224-37fe8ecbfe7e admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:58.367043 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f1f3f-f93e-4ddd-8224-37fe8ecbfe7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:58.368613 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f1f3f-f93e-4ddd-8224-37fe8ecbfe7e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:58.377472 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8310a09c-ffc4-4be6-8cf8-37c25fc89b84 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:07:58.387823 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-8310a09c-ffc4-4be6-8cf8-37c25fc89b84 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 29 20:07:58.394886 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 52/108] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Nov 29 20:07:58 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:07:58.395694 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f1f3f-f93e-4ddd-8224-37fe8ecbfe7e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:07:58.403091 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-867f1f3f-f93e-4ddd-8224-37fe8ecbfe7e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 29 20:07:58.404570 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 57/109] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Nov 29 20:07:58 2021] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:07:58.410880 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310a09c-ffc4-4be6-8cf8-37c25fc89b84 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:58.412602 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f1f3f-f93e-4ddd-8224-37fe8ecbfe7e admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:58.426193 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310a09c-ffc4-4be6-8cf8-37c25fc89b84 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:58.427308 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f1f3f-f93e-4ddd-8224-37fe8ecbfe7e admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:58.433938 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f0328-1a60-45c0-893d-51fbbc35af13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:58.434820 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f0328-1a60-45c0-893d-51fbbc35af13 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:58.435368 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f0328-1a60-45c0-893d-51fbbc35af13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:58.435818 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f0328-1a60-45c0-893d-51fbbc35af13 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:58.436817 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f0328-1a60-45c0-893d-51fbbc35af13 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:07:58.437296 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f0328-1a60-45c0-893d-51fbbc35af13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:58.439173 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f0328-1a60-45c0-893d-51fbbc35af13 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:58.440500 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5e4bb-7cc9-41ed-9f06-4a5e575b52c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:58.446933 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5e4bb-7cc9-41ed-9f06-4a5e575b52c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:58.446933 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5e4bb-7cc9-41ed-9f06-4a5e575b52c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:58.446933 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5e4bb-7cc9-41ed-9f06-4a5e575b52c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:58.446933 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5e4bb-7cc9-41ed-9f06-4a5e575b52c0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:07:58.446933 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5e4bb-7cc9-41ed-9f06-4a5e575b52c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:58.446933 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5e4bb-7cc9-41ed-9f06-4a5e575b52c0 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:58.456879 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 58/110] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:07:58 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:07:58.462640 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f0328-1a60-45c0-893d-51fbbc35af13 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:58.463789 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 53/111] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:07:58 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:07:58.469921 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5e4bb-7cc9-41ed-9f06-4a5e575b52c0 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:58.476613 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f0328-1a60-45c0-893d-51fbbc35af13 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:58.483091 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d5557b-3130-4ed0-9624-5ea08d744e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:58.484190 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5557b-3130-4ed0-9624-5ea08d744e59 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:58.484532 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5557b-3130-4ed0-9624-5ea08d744e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:58.484812 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5557b-3130-4ed0-9624-5ea08d744e59 admin admin] PATH_INFO: `/v3/users/c91aa55f3c094ec2b5eed7180bc6fd6e` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:58.486094 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d5557b-3130-4ed0-9624-5ea08d744e59 admin admin] RBAC: Authorizing `identity:get_user(user_id=c91aa55f3c094ec2b5eed7180bc6fd6e)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:58.488487 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d5557b-3130-4ed0-9624-5ea08d744e59 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:58.489235 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5e4bb-7cc9-41ed-9f06-4a5e575b52c0 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:58.490326 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 59/112] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:07:58 2021] GET /identity/v3/users/c91aa55f3c094ec2b5eed7180bc6fd6e => generated 275 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:07:58.495685 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f620f-5f8a-4c90-b5e7-95828b81b397 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:58.496034 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f620f-5f8a-4c90-b5e7-95828b81b397 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:58.496318 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f620f-5f8a-4c90-b5e7-95828b81b397 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:58.498377 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 60/113] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:07:58 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:07:58.504381 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f620f-5f8a-4c90-b5e7-95828b81b397 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:58.512136 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f1b5f-4c4d-425c-99f2-72bd14ddfa4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:58.513035 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f1b5f-4c4d-425c-99f2-72bd14ddfa4b admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:58.513314 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f1b5f-4c4d-425c-99f2-72bd14ddfa4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:58.513583 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f1b5f-4c4d-425c-99f2-72bd14ddfa4b admin admin] PATH_INFO: `/v3/users/d89548cfaf2149148790fd3546ef2b15` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:58.518803 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f620f-5f8a-4c90-b5e7-95828b81b397 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:58.519667 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746f1b5f-4c4d-425c-99f2-72bd14ddfa4b admin admin] RBAC: Authorizing `identity:get_user(user_id=d89548cfaf2149148790fd3546ef2b15)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:58.521742 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746f1b5f-4c4d-425c-99f2-72bd14ddfa4b admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:58.523436 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 54/114] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:07:58 2021] GET /identity/v3/users/d89548cfaf2149148790fd3546ef2b15 => generated 247 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:07:58.523762 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c32cd9c-93a6-4a8a-9ba5-40deaa5c6678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:58.524619 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32cd9c-93a6-4a8a-9ba5-40deaa5c6678 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:58.524992 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32cd9c-93a6-4a8a-9ba5-40deaa5c6678 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:58.525317 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c32cd9c-93a6-4a8a-9ba5-40deaa5c6678 admin admin] PATH_INFO: `/v3/projects/4facf8265b034e41b65929b2699eb944` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:58.528040 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3965e-f8ba-44e2-bb0f-be2972d4acff None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:58.528332 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3965e-f8ba-44e2-bb0f-be2972d4acff None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:58.528607 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3965e-f8ba-44e2-bb0f-be2972d4acff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:58.531525 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c32cd9c-93a6-4a8a-9ba5-40deaa5c6678 admin admin] RBAC: Authorizing `identity:get_project(project_id=4facf8265b034e41b65929b2699eb944)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:58.533765 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c32cd9c-93a6-4a8a-9ba5-40deaa5c6678 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:58.535703 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 61/115] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:07:58 2021] GET /identity/v3/projects/4facf8265b034e41b65929b2699eb944 => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:07:58.536545 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c32cd9c-93a6-4a8a-9ba5-40deaa5c6678 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:58.551830 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c32cd9c-93a6-4a8a-9ba5-40deaa5c6678 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:58.556654 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62807cd6-18ee-49e9-bc6c-844dcbb07dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:58.557657 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62807cd6-18ee-49e9-bc6c-844dcbb07dcb admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:58.558036 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62807cd6-18ee-49e9-bc6c-844dcbb07dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:58.558319 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62807cd6-18ee-49e9-bc6c-844dcbb07dcb admin admin] PATH_INFO: `/v3/projects/4facf8265b034e41b65929b2699eb944` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:58.559636 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62807cd6-18ee-49e9-bc6c-844dcbb07dcb admin admin] RBAC: Authorizing `identity:get_project(project_id=4facf8265b034e41b65929b2699eb944)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:58.561859 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62807cd6-18ee-49e9-bc6c-844dcbb07dcb admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:58.563939 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 62/116] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:07:58 2021] GET /identity/v3/projects/4facf8265b034e41b65929b2699eb944 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:07:58.564564 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62807cd6-18ee-49e9-bc6c-844dcbb07dcb admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:58.566999 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-1ba3965e-f8ba-44e2-bb0f-be2972d4acff None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:07:58.568196 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-1ba3965e-f8ba-44e2-bb0f-be2972d4acff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:07:58.575334 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62807cd6-18ee-49e9-bc6c-844dcbb07dcb admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:58.580319 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667a56a-d5ad-4119-96f4-300163aaa8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:58.581265 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667a56a-d5ad-4119-96f4-300163aaa8f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:58.581550 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667a56a-d5ad-4119-96f4-300163aaa8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:58.581868 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667a56a-d5ad-4119-96f4-300163aaa8f1 admin admin] PATH_INFO: `/v3/projects/4facf8265b034e41b65929b2699eb944/users/c91aa55f3c094ec2b5eed7180bc6fd6e/roles/d63eb17a7e7d455ea5f2c6696d92978c` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:58.584484 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667a56a-d5ad-4119-96f4-300163aaa8f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4facf8265b034e41b65929b2699eb944, user_id=c91aa55f3c094ec2b5eed7180bc6fd6e, role_id=d63eb17a7e7d455ea5f2c6696d92978c)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:58.587537 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667a56a-d5ad-4119-96f4-300163aaa8f1 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:58.592841 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 55/117] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:07:58 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:07:58.594091 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3965e-f8ba-44e2-bb0f-be2972d4acff None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:58.610752 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3965e-f8ba-44e2-bb0f-be2972d4acff None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:58.613664 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 63/118] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Nov 29 20:07:58 2021] PUT /identity/v3/projects/4facf8265b034e41b65929b2699eb944/users/c91aa55f3c094ec2b5eed7180bc6fd6e/roles/d63eb17a7e7d455ea5f2c6696d92978c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:07:58.650747 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667a56a-d5ad-4119-96f4-300163aaa8f1 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:58.753876 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251a51b-046a-4545-bb2a-98eaaecbf147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:58.755189 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251a51b-046a-4545-bb2a-98eaaecbf147 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:58.755778 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251a51b-046a-4545-bb2a-98eaaecbf147 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:58.756251 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251a51b-046a-4545-bb2a-98eaaecbf147 admin admin] PATH_INFO: `/v3/projects/4facf8265b034e41b65929b2699eb944/users/d89548cfaf2149148790fd3546ef2b15/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:58.762910 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667a56a-d5ad-4119-96f4-300163aaa8f1 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:58.764886 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d251a51b-046a-4545-bb2a-98eaaecbf147 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4facf8265b034e41b65929b2699eb944, user_id=d89548cfaf2149148790fd3546ef2b15, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:58.767889 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d251a51b-046a-4545-bb2a-98eaaecbf147 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:58.776763 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823208bf-d4d1-4496-b5fb-b2630a530e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:58.777601 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823208bf-d4d1-4496-b5fb-b2630a530e83 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:58.777889 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823208bf-d4d1-4496-b5fb-b2630a530e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:58.778272 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823208bf-d4d1-4496-b5fb-b2630a530e83 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:58.803826 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823208bf-d4d1-4496-b5fb-b2630a530e83 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:07:58.807334 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 56/119] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Nov 29 20:07:58 2021] PUT /identity/v3/projects/4facf8265b034e41b65929b2699eb944/users/d89548cfaf2149148790fd3546ef2b15/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:07:58.815042 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-823208bf-d4d1-4496-b5fb-b2630a530e83 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 29 20:07:58.816545 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 64/120] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:07:58 2021] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:07:58.823043 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251a51b-046a-4545-bb2a-98eaaecbf147 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:58.939510 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251a51b-046a-4545-bb2a-98eaaecbf147 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:58.947110 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d4dff-2202-498f-aa95-4f410f50073d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:58.947866 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d4dff-2202-498f-aa95-4f410f50073d admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:58.948153 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d4dff-2202-498f-aa95-4f410f50073d admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:58.948434 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d4dff-2202-498f-aa95-4f410f50073d admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:58.949214 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60d4dff-2202-498f-aa95-4f410f50073d admin admin] RBAC: Adding query filter params (name=member) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:07:58.949525 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60d4dff-2202-498f-aa95-4f410f50073d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:58.951201 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60d4dff-2202-498f-aa95-4f410f50073d admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:58.967548 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 57/121] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Nov 29 20:07:58 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:07:58.973670 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823208bf-d4d1-4496-b5fb-b2630a530e83 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:58.997574 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823208bf-d4d1-4496-b5fb-b2630a530e83 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:59.006366 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7457f-4f10-4709-906e-d59f10ea4690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:59.007527 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7457f-4f10-4709-906e-d59f10ea4690 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:59.007805 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7457f-4f10-4709-906e-d59f10ea4690 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:59.008077 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7457f-4f10-4709-906e-d59f10ea4690 admin admin] PATH_INFO: `/v3/users/c91aa55f3c094ec2b5eed7180bc6fd6e` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:59.009294 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c7457f-4f10-4709-906e-d59f10ea4690 admin admin] RBAC: Authorizing `identity:get_user(user_id=c91aa55f3c094ec2b5eed7180bc6fd6e)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:59.012621 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c7457f-4f10-4709-906e-d59f10ea4690 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:59.014249 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 65/122] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:07:58 2021] GET /identity/v3/users/c91aa55f3c094ec2b5eed7180bc6fd6e => generated 275 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:07:59.020644 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d4dff-2202-498f-aa95-4f410f50073d admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:59.036367 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d4dff-2202-498f-aa95-4f410f50073d admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:59.047340 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf1b024-1158-4fa0-ad53-a93f874d9a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:59.048239 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1b024-1158-4fa0-ad53-a93f874d9a22 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:59.048523 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1b024-1158-4fa0-ad53-a93f874d9a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:59.048803 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1b024-1158-4fa0-ad53-a93f874d9a22 admin admin] PATH_INFO: `/v3/projects/cdcd751220ba4b99976025fa89d35abd` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:59.055881 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf1b024-1158-4fa0-ad53-a93f874d9a22 admin admin] RBAC: Authorizing `identity:get_project(project_id=cdcd751220ba4b99976025fa89d35abd)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:59.058138 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf1b024-1158-4fa0-ad53-a93f874d9a22 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:59.060405 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 58/123] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:07:59 2021] GET /identity/v3/projects/cdcd751220ba4b99976025fa89d35abd => generated 312 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:07:59.066599 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7457f-4f10-4709-906e-d59f10ea4690 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:59.079934 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7457f-4f10-4709-906e-d59f10ea4690 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:59.090235 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c630a30-c239-404d-a884-10e4c05af3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:59.091162 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c630a30-c239-404d-a884-10e4c05af3cc admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:59.091441 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c630a30-c239-404d-a884-10e4c05af3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:59.091715 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c630a30-c239-404d-a884-10e4c05af3cc admin admin] PATH_INFO: `/v3/projects/cdcd751220ba4b99976025fa89d35abd/users/c91aa55f3c094ec2b5eed7180bc6fd6e/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:59.093676 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c630a30-c239-404d-a884-10e4c05af3cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdcd751220ba4b99976025fa89d35abd, user_id=c91aa55f3c094ec2b5eed7180bc6fd6e, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:59.096515 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c630a30-c239-404d-a884-10e4c05af3cc admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:59.120578 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 66/124] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Nov 29 20:07:59 2021] PUT /identity/v3/projects/cdcd751220ba4b99976025fa89d35abd/users/c91aa55f3c094ec2b5eed7180bc6fd6e/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:07:59.156801 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9430ffb-970c-4069-9ea1-229fb4bab9da None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:59.157125 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9430ffb-970c-4069-9ea1-229fb4bab9da None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:59.157365 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9430ffb-970c-4069-9ea1-229fb4bab9da None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:59.159445 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 59/125] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:07:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:07:59.166299 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d1060-8ecf-4919-856a-8ee778c7f077 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:59.166643 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d1060-8ecf-4919-856a-8ee778c7f077 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:59.166919 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d1060-8ecf-4919-856a-8ee778c7f077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:59.187260 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-1c3d1060-8ecf-4919-856a-8ee778c7f077 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:07:59.188463 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-1c3d1060-8ecf-4919-856a-8ee778c7f077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:07:59.256638 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 67/126] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:07:59 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:07:59.299910 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9430ffb-970c-4069-9ea1-229fb4bab9da None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:59.312900 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9430ffb-970c-4069-9ea1-229fb4bab9da None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:59.317477 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0a43b-0e82-45a1-a35f-524bbe7a3798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:59.318292 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0a43b-0e82-45a1-a35f-524bbe7a3798 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:59.318576 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0a43b-0e82-45a1-a35f-524bbe7a3798 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:59.318870 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0a43b-0e82-45a1-a35f-524bbe7a3798 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:59.330739 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0a43b-0e82-45a1-a35f-524bbe7a3798 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:07:59.337811 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-fec0a43b-0e82-45a1-a35f-524bbe7a3798 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 29 20:07:59.339433 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 60/127] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:07:59 2021] GET /identity/v3/roles/reader => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:07:59.345888 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d1060-8ecf-4919-856a-8ee778c7f077 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:59.355522 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d1060-8ecf-4919-856a-8ee778c7f077 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:59.363141 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce90e64-2011-4db2-b22a-deca6e2e64b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:59.363842 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce90e64-2011-4db2-b22a-deca6e2e64b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:59.364132 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce90e64-2011-4db2-b22a-deca6e2e64b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:59.364413 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce90e64-2011-4db2-b22a-deca6e2e64b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:59.365205 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce90e64-2011-4db2-b22a-deca6e2e64b3 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:07:59.365517 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce90e64-2011-4db2-b22a-deca6e2e64b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:59.367166 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce90e64-2011-4db2-b22a-deca6e2e64b3 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:59.378865 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 68/128] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Nov 29 20:07:59 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:07:59.385723 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0a43b-0e82-45a1-a35f-524bbe7a3798 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:59.398134 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0a43b-0e82-45a1-a35f-524bbe7a3798 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:59.408315 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3cc9d-0ee7-49f6-9ad6-c0cb2853bd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:59.409223 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3cc9d-0ee7-49f6-9ad6-c0cb2853bd83 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:59.409511 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3cc9d-0ee7-49f6-9ad6-c0cb2853bd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:59.409790 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3cc9d-0ee7-49f6-9ad6-c0cb2853bd83 admin admin] PATH_INFO: `/v3/users/5dca3dd74e8244cfa8753241936d87f7` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:59.424961 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3cc9d-0ee7-49f6-9ad6-c0cb2853bd83 admin admin] RBAC: Authorizing `identity:get_user(user_id=5dca3dd74e8244cfa8753241936d87f7)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:59.427218 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3cc9d-0ee7-49f6-9ad6-c0cb2853bd83 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:59.429323 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 61/129] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:07:59 2021] GET /identity/v3/users/5dca3dd74e8244cfa8753241936d87f7 => generated 289 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:07:59.435483 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce90e64-2011-4db2-b22a-deca6e2e64b3 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:59.448246 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce90e64-2011-4db2-b22a-deca6e2e64b3 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:59.456324 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979d022-0472-446b-9e6c-ac8192c91187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:59.457304 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979d022-0472-446b-9e6c-ac8192c91187 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:59.457801 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979d022-0472-446b-9e6c-ac8192c91187 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:59.458259 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979d022-0472-446b-9e6c-ac8192c91187 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:59.471139 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979d022-0472-446b-9e6c-ac8192c91187 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:59.473230 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979d022-0472-446b-9e6c-ac8192c91187 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:59.488431 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 69/130] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:07:59 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:07:59.495104 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3cc9d-0ee7-49f6-9ad6-c0cb2853bd83 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:59.512625 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3cc9d-0ee7-49f6-9ad6-c0cb2853bd83 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:59.523076 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8fbe4-26aa-4efb-b75a-099db63e441e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:59.523956 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8fbe4-26aa-4efb-b75a-099db63e441e admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:59.524243 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8fbe4-26aa-4efb-b75a-099db63e441e admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:59.524529 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8fbe4-26aa-4efb-b75a-099db63e441e admin admin] PATH_INFO: `/v3/projects/4facf8265b034e41b65929b2699eb944` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:59.531667 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed8fbe4-26aa-4efb-b75a-099db63e441e admin admin] RBAC: Authorizing `identity:get_project(project_id=4facf8265b034e41b65929b2699eb944)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:59.533794 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed8fbe4-26aa-4efb-b75a-099db63e441e admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:59.535919 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 62/131] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:07:59 2021] GET /identity/v3/projects/4facf8265b034e41b65929b2699eb944 => generated 298 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:07:59.542371 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979d022-0472-446b-9e6c-ac8192c91187 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:07:59.556476 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979d022-0472-446b-9e6c-ac8192c91187 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:07:59.567158 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da23e6-3ada-49a8-83f5-561cc04f8640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:07:59.568200 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da23e6-3ada-49a8-83f5-561cc04f8640 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:07:59.568675 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da23e6-3ada-49a8-83f5-561cc04f8640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:07:59.569137 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da23e6-3ada-49a8-83f5-561cc04f8640 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:07:59.570203 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65da23e6-3ada-49a8-83f5-561cc04f8640 admin admin] RBAC: Adding query filter params (role.id=26a400f146c54b26a90d5afef23446e8, scope.project.id=4facf8265b034e41b65929b2699eb944, user.id=5dca3dd74e8244cfa8753241936d87f7) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:07:59.570712 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65da23e6-3ada-49a8-83f5-561cc04f8640 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:07:59.572841 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65da23e6-3ada-49a8-83f5-561cc04f8640 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:07:59.581814 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 70/132] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:07:59 2021] GET /identity/v3/role_assignments?user.id=5dca3dd74e8244cfa8753241936d87f7&scope.project.id=4facf8265b034e41b65929b2699eb944&role.id=26a400f146c54b26a90d5afef23446e8 => generated 259 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:00.423549 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b23dd-287a-4250-bff4-38e872ce632c None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:00.423957 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b23dd-287a-4250-bff4-38e872ce632c None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:00.424138 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b23dd-287a-4250-bff4-38e872ce632c None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:00.426083 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 63/133] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:00.432029 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65ad91-2490-4976-8e91-f1a1768d39e2 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:00.432674 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65ad91-2490-4976-8e91-f1a1768d39e2 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:00.433163 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65ad91-2490-4976-8e91-f1a1768d39e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:00.455874 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-6d65ad91-2490-4976-8e91-f1a1768d39e2 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:00.457832 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-6d65ad91-2490-4976-8e91-f1a1768d39e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:00.466162 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 71/134] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:00 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:00.502252 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b23dd-287a-4250-bff4-38e872ce632c None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:00.524135 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b23dd-287a-4250-bff4-38e872ce632c None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:00.528650 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b1c08-20b2-41bd-a58c-84f81a960474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:00.529458 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b1c08-20b2-41bd-a58c-84f81a960474 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:00.529736 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b1c08-20b2-41bd-a58c-84f81a960474 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:00.530015 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b1c08-20b2-41bd-a58c-84f81a960474 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:00.535626 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b1c08-20b2-41bd-a58c-84f81a960474 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:00.537364 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b1c08-20b2-41bd-a58c-84f81a960474 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:00.539392 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 64/135] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:00 2021] GET /identity/v3/domains/default => generated 199 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:00.545482 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65ad91-2490-4976-8e91-f1a1768d39e2 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:00.555639 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65ad91-2490-4976-8e91-f1a1768d39e2 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:00.562875 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3954cc-5484-4cef-aaa8-34d80263d289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:00.563791 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3954cc-5484-4cef-aaa8-34d80263d289 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:00.564265 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3954cc-5484-4cef-aaa8-34d80263d289 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:00.564746 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3954cc-5484-4cef-aaa8-34d80263d289 admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:00.565660 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3954cc-5484-4cef-aaa8-34d80263d289 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:00.567807 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3954cc-5484-4cef-aaa8-34d80263d289 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:00.614129 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 72/136] 10.222.0.15 () {60 vars in 1162 bytes} [Mon Nov 29 20:08:00 2021] POST /identity/v3/projects => generated 302 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:08:01.168012 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bd62c-6ce7-4a14-bbaa-31a512e6946a None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:01.168340 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bd62c-6ce7-4a14-bbaa-31a512e6946a None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:01.168503 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4bd62c-6ce7-4a14-bbaa-31a512e6946a None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:01.170433 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 65/137] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:01.176397 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c611d5-a594-4190-a8cb-ffed64157646 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:01.176914 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c611d5-a594-4190-a8cb-ffed64157646 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:01.177409 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c611d5-a594-4190-a8cb-ffed64157646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:01.207632 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-b9c611d5-a594-4190-a8cb-ffed64157646 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:01.209147 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-b9c611d5-a594-4190-a8cb-ffed64157646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:01.278946 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 73/138] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:01 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 29 20:08:01.298731 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4bd62c-6ce7-4a14-bbaa-31a512e6946a None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:01.318774 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4bd62c-6ce7-4a14-bbaa-31a512e6946a None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:01.324206 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582bb13-a85d-4ec4-a2cc-2924a66125b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:01.325169 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582bb13-a85d-4ec4-a2cc-2924a66125b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:01.325589 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582bb13-a85d-4ec4-a2cc-2924a66125b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:01.326082 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582bb13-a85d-4ec4-a2cc-2924a66125b8 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:01.339625 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9582bb13-a85d-4ec4-a2cc-2924a66125b8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:01.346824 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-9582bb13-a85d-4ec4-a2cc-2924a66125b8 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 29 20:08:01.348239 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 66/139] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:08:01 2021] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:01.354920 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c611d5-a594-4190-a8cb-ffed64157646 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:01.365598 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c611d5-a594-4190-a8cb-ffed64157646 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:01.373833 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631b3e4-6c5c-4e8f-98c4-9fa2ca859856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:01.374524 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631b3e4-6c5c-4e8f-98c4-9fa2ca859856 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:01.374809 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631b3e4-6c5c-4e8f-98c4-9fa2ca859856 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:01.375118 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631b3e4-6c5c-4e8f-98c4-9fa2ca859856 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:01.375908 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631b3e4-6c5c-4e8f-98c4-9fa2ca859856 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:01.376218 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631b3e4-6c5c-4e8f-98c4-9fa2ca859856 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:01.377856 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631b3e4-6c5c-4e8f-98c4-9fa2ca859856 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:01.393513 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 74/140] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Nov 29 20:08:01 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:01.400261 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582bb13-a85d-4ec4-a2cc-2924a66125b8 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:01.416861 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582bb13-a85d-4ec4-a2cc-2924a66125b8 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:01.423413 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f311ff-2a82-4ddf-8ce0-77f52c88a69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:01.424571 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f311ff-2a82-4ddf-8ce0-77f52c88a69e admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:01.425032 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f311ff-2a82-4ddf-8ce0-77f52c88a69e admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:01.425435 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f311ff-2a82-4ddf-8ce0-77f52c88a69e admin admin] PATH_INFO: `/v3/users/c91aa55f3c094ec2b5eed7180bc6fd6e` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:01.431515 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f311ff-2a82-4ddf-8ce0-77f52c88a69e admin admin] RBAC: Authorizing `identity:get_user(user_id=c91aa55f3c094ec2b5eed7180bc6fd6e)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:01.434406 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f311ff-2a82-4ddf-8ce0-77f52c88a69e admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:01.436600 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 67/141] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:08:01 2021] GET /identity/v3/users/c91aa55f3c094ec2b5eed7180bc6fd6e => generated 275 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:01.442932 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631b3e4-6c5c-4e8f-98c4-9fa2ca859856 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:01.452808 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631b3e4-6c5c-4e8f-98c4-9fa2ca859856 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:01.462870 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd147892-f675-4f2a-9e48-9240b56e43bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:01.463522 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd147892-f675-4f2a-9e48-9240b56e43bc admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:01.463860 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd147892-f675-4f2a-9e48-9240b56e43bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:01.464141 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd147892-f675-4f2a-9e48-9240b56e43bc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:01.478539 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd147892-f675-4f2a-9e48-9240b56e43bc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:01.480390 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd147892-f675-4f2a-9e48-9240b56e43bc admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:01.489355 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 75/142] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:08:01 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:08:01.495706 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f311ff-2a82-4ddf-8ce0-77f52c88a69e admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:01.505900 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f311ff-2a82-4ddf-8ce0-77f52c88a69e admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:01.516354 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03791e8e-27fb-48af-95b3-31210df2286d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:01.517226 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03791e8e-27fb-48af-95b3-31210df2286d admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:01.517513 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03791e8e-27fb-48af-95b3-31210df2286d admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:01.517789 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03791e8e-27fb-48af-95b3-31210df2286d admin admin] PATH_INFO: `/v3/projects/4facf8265b034e41b65929b2699eb944` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:01.519013 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03791e8e-27fb-48af-95b3-31210df2286d admin admin] RBAC: Authorizing `identity:get_project(project_id=4facf8265b034e41b65929b2699eb944)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:01.521096 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03791e8e-27fb-48af-95b3-31210df2286d admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:01.522770 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 68/143] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:08:01 2021] GET /identity/v3/projects/4facf8265b034e41b65929b2699eb944 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:01.529818 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd147892-f675-4f2a-9e48-9240b56e43bc admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:01.538835 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd147892-f675-4f2a-9e48-9240b56e43bc admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:01.546369 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a3147-1a16-4bd3-8a13-7e25c6921c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:01.547050 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a3147-1a16-4bd3-8a13-7e25c6921c9a admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:01.547337 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a3147-1a16-4bd3-8a13-7e25c6921c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:01.547613 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a3147-1a16-4bd3-8a13-7e25c6921c9a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:01.548468 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a3147-1a16-4bd3-8a13-7e25c6921c9a admin admin] RBAC: Adding query filter params (role.id=88a0e2c4c85c4449ad4681edcdc57835, scope.project.id=4facf8265b034e41b65929b2699eb944, user.id=c91aa55f3c094ec2b5eed7180bc6fd6e) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:01.548779 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a3147-1a16-4bd3-8a13-7e25c6921c9a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:01.550658 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a3147-1a16-4bd3-8a13-7e25c6921c9a admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:01.557071 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 76/144] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:08:01 2021] GET /identity/v3/role_assignments?user.id=c91aa55f3c094ec2b5eed7180bc6fd6e&scope.project.id=4facf8265b034e41b65929b2699eb944&role.id=88a0e2c4c85c4449ad4681edcdc57835 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:02.414866 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f43fb-2363-4818-b529-4ebb2a24dcdb None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:02.415236 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f43fb-2363-4818-b529-4ebb2a24dcdb None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:02.415437 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f43fb-2363-4818-b529-4ebb2a24dcdb None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:02.417760 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 69/145] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:02.423547 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd4b994-e03f-481d-9069-9cedd4623d29 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:02.423839 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd4b994-e03f-481d-9069-9cedd4623d29 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:02.424125 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd4b994-e03f-481d-9069-9cedd4623d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:02.428868 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73d4b0-9fee-4d29-a3e6-36341c1239a6 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:02.429139 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73d4b0-9fee-4d29-a3e6-36341c1239a6 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:02.429423 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73d4b0-9fee-4d29-a3e6-36341c1239a6 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:02.431386 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 70/146] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 29 20:08:02.436811 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e166f-8cf7-4c65-bf10-02944dea4949 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:02.437364 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e166f-8cf7-4c65-bf10-02944dea4949 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:02.437364 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858e166f-8cf7-4c65-bf10-02944dea4949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:02.467782 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-858e166f-8cf7-4c65-bf10-02944dea4949 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:02.468985 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-858e166f-8cf7-4c65-bf10-02944dea4949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:02.470745 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-bfd4b994-e03f-481d-9069-9cedd4623d29 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:02.471977 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-bfd4b994-e03f-481d-9069-9cedd4623d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:02.486219 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 77/148] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:02 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:02.486527 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 71/148] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:02 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:02.497443 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4128d-ba13-478a-9141-9c6335e4d2ce None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:02.497733 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4128d-ba13-478a-9141-9c6335e4d2ce None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:02.498011 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4128d-ba13-478a-9141-9c6335e4d2ce None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:02.499802 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 78/149] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:02.507979 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f272498-b564-42d8-9c86-adfbc07c6806 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:02.508284 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f272498-b564-42d8-9c86-adfbc07c6806 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:02.508543 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f272498-b564-42d8-9c86-adfbc07c6806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:02.526813 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4128d-ba13-478a-9141-9c6335e4d2ce None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:02.529711 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-9f272498-b564-42d8-9c86-adfbc07c6806 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:02.531013 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-9f272498-b564-42d8-9c86-adfbc07c6806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:02.541700 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4128d-ba13-478a-9141-9c6335e4d2ce None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:02.546402 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dedc4b4-067a-41cc-b37a-5f3ee9c8bc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:02.546916 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 72/150] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:02 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 29 20:08:02.547677 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dedc4b4-067a-41cc-b37a-5f3ee9c8bc25 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:02.547779 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f272498-b564-42d8-9c86-adfbc07c6806 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:02.548342 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dedc4b4-067a-41cc-b37a-5f3ee9c8bc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:02.548814 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dedc4b4-067a-41cc-b37a-5f3ee9c8bc25 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:02.556946 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f272498-b564-42d8-9c86-adfbc07c6806 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:02.566098 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c12d43-e7da-4737-bce9-e016c80bc8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:02.566911 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c12d43-e7da-4737-bce9-e016c80bc8c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:02.567193 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c12d43-e7da-4737-bce9-e016c80bc8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:02.567464 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c12d43-e7da-4737-bce9-e016c80bc8c4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:02.572682 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dedc4b4-067a-41cc-b37a-5f3ee9c8bc25 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:02.579620 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-3dedc4b4-067a-41cc-b37a-5f3ee9c8bc25 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 29 20:08:02.580339 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c12d43-e7da-4737-bce9-e016c80bc8c4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:02.585619 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 79/151] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:08:02 2021] GET /identity/v3/roles/member => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:08:02.585619 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dedc4b4-067a-41cc-b37a-5f3ee9c8bc25 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:02.590066 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-13c12d43-e7da-4737-bce9-e016c80bc8c4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 29 20:08:02.591414 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 73/152] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Nov 29 20:08:02 2021] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:02.592282 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c12d43-e7da-4737-bce9-e016c80bc8c4 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:02.601902 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dedc4b4-067a-41cc-b37a-5f3ee9c8bc25 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:02.602554 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c12d43-e7da-4737-bce9-e016c80bc8c4 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:02.607219 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e60795-0dfb-440c-a902-9817d4fd20d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:02.607415 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ddce3-bef5-49e3-9ce5-e3f9a39760b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:02.608014 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ddce3-bef5-49e3-9ce5-e3f9a39760b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:02.608295 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ddce3-bef5-49e3-9ce5-e3f9a39760b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:02.608571 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ddce3-bef5-49e3-9ce5-e3f9a39760b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:02.608987 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e60795-0dfb-440c-a902-9817d4fd20d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:02.609442 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e60795-0dfb-440c-a902-9817d4fd20d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:02.609537 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ddce3-bef5-49e3-9ce5-e3f9a39760b8 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:02.609799 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ddce3-bef5-49e3-9ce5-e3f9a39760b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:02.610176 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e60795-0dfb-440c-a902-9817d4fd20d8 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:02.611630 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ddce3-bef5-49e3-9ce5-e3f9a39760b8 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:02.620745 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 74/153] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Nov 29 20:08:02 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:02.621706 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ddce3-bef5-49e3-9ce5-e3f9a39760b8 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:02.623940 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e60795-0dfb-440c-a902-9817d4fd20d8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:02.631260 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ddce3-bef5-49e3-9ce5-e3f9a39760b8 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:02.633502 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-30e60795-0dfb-440c-a902-9817d4fd20d8 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 29 20:08:02.635135 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 80/154] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Nov 29 20:08:02 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:02.640849 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b650eb-a050-448e-8b75-71382ffd14d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:02.640849 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b650eb-a050-448e-8b75-71382ffd14d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:02.640849 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b650eb-a050-448e-8b75-71382ffd14d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:02.640849 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b650eb-a050-448e-8b75-71382ffd14d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:02.641165 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b650eb-a050-448e-8b75-71382ffd14d5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:02.641165 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b650eb-a050-448e-8b75-71382ffd14d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:02.641165 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b650eb-a050-448e-8b75-71382ffd14d5 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:02.642074 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e60795-0dfb-440c-a902-9817d4fd20d8 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:02.649057 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 75/155] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:08:02 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:02.650059 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b650eb-a050-448e-8b75-71382ffd14d5 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:02.659744 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e60795-0dfb-440c-a902-9817d4fd20d8 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:02.661664 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b650eb-a050-448e-8b75-71382ffd14d5 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:02.664419 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bea8e0-0006-46f4-8bb0-c43dc5db3bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:02.665357 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bea8e0-0006-46f4-8bb0-c43dc5db3bde admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:02.665572 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bea8e0-0006-46f4-8bb0-c43dc5db3bde admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:02.665836 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bea8e0-0006-46f4-8bb0-c43dc5db3bde admin admin] PATH_INFO: `/v3/users/c91aa55f3c094ec2b5eed7180bc6fd6e` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:02.667242 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bea8e0-0006-46f4-8bb0-c43dc5db3bde admin admin] RBAC: Authorizing `identity:get_user(user_id=c91aa55f3c094ec2b5eed7180bc6fd6e)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:02.667804 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf5d6e-7304-486e-92e2-6429577c0bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:02.668665 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf5d6e-7304-486e-92e2-6429577c0bcd admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:02.669132 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf5d6e-7304-486e-92e2-6429577c0bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:02.669384 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bea8e0-0006-46f4-8bb0-c43dc5db3bde admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:02.669785 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf5d6e-7304-486e-92e2-6429577c0bcd admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:02.670725 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf5d6e-7304-486e-92e2-6429577c0bcd admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:02.671132 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 81/156] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:08:02 2021] GET /identity/v3/users/c91aa55f3c094ec2b5eed7180bc6fd6e => generated 275 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:02.671628 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf5d6e-7304-486e-92e2-6429577c0bcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:02.671802 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bea8e0-0006-46f4-8bb0-c43dc5db3bde admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:02.673771 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf5d6e-7304-486e-92e2-6429577c0bcd admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:02.680903 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bea8e0-0006-46f4-8bb0-c43dc5db3bde admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:02.684357 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 76/157] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:08:02 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:02.689945 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94dea6d-6f3f-45cf-a7bf-83ce0e4a97a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:02.689945 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94dea6d-6f3f-45cf-a7bf-83ce0e4a97a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:02.689945 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94dea6d-6f3f-45cf-a7bf-83ce0e4a97a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:02.689945 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94dea6d-6f3f-45cf-a7bf-83ce0e4a97a7 admin admin] PATH_INFO: `/v3/users/d89548cfaf2149148790fd3546ef2b15` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:02.690340 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94dea6d-6f3f-45cf-a7bf-83ce0e4a97a7 admin admin] RBAC: Authorizing `identity:get_user(user_id=d89548cfaf2149148790fd3546ef2b15)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:02.690340 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94dea6d-6f3f-45cf-a7bf-83ce0e4a97a7 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:02.690712 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf5d6e-7304-486e-92e2-6429577c0bcd admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:02.691964 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 82/158] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:08:02 2021] GET /identity/v3/users/d89548cfaf2149148790fd3546ef2b15 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:02.692810 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94dea6d-6f3f-45cf-a7bf-83ce0e4a97a7 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:02.706814 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf5d6e-7304-486e-92e2-6429577c0bcd admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:02.709506 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94dea6d-6f3f-45cf-a7bf-83ce0e4a97a7 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:02.716965 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec59429-9406-4026-9bdf-d9b311d4f650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:02.717826 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec59429-9406-4026-9bdf-d9b311d4f650 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:02.718104 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec59429-9406-4026-9bdf-d9b311d4f650 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:02.718366 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec59429-9406-4026-9bdf-d9b311d4f650 admin admin] PATH_INFO: `/v3/users/c91aa55f3c094ec2b5eed7180bc6fd6e` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:02.719421 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ed0d9-3d8b-4cb3-8c6d-92884842f73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:02.720067 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ed0d9-3d8b-4cb3-8c6d-92884842f73d admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:02.720340 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ed0d9-3d8b-4cb3-8c6d-92884842f73d admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:02.720606 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ed0d9-3d8b-4cb3-8c6d-92884842f73d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:02.721820 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec59429-9406-4026-9bdf-d9b311d4f650 admin admin] RBAC: Authorizing `identity:get_user(user_id=c91aa55f3c094ec2b5eed7180bc6fd6e)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:02.723985 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec59429-9406-4026-9bdf-d9b311d4f650 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:02.730768 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 83/159] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:08:02 2021] GET /identity/v3/users/c91aa55f3c094ec2b5eed7180bc6fd6e => generated 275 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:02.730768 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec59429-9406-4026-9bdf-d9b311d4f650 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:02.739233 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ed0d9-3d8b-4cb3-8c6d-92884842f73d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:02.741525 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ed0d9-3d8b-4cb3-8c6d-92884842f73d admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:02.742068 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec59429-9406-4026-9bdf-d9b311d4f650 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:02.746646 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a4145-4e6f-4c37-baa5-d065dc27a19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:02.747335 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a4145-4e6f-4c37-baa5-d065dc27a19d admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:02.747611 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a4145-4e6f-4c37-baa5-d065dc27a19d admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:02.747876 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a4145-4e6f-4c37-baa5-d065dc27a19d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:02.753389 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 77/160] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:08:02 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:08:02.754406 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ed0d9-3d8b-4cb3-8c6d-92884842f73d admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:02.762140 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a4145-4e6f-4c37-baa5-d065dc27a19d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:02.764037 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a4145-4e6f-4c37-baa5-d065dc27a19d admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:02.765133 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ed0d9-3d8b-4cb3-8c6d-92884842f73d admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:02.770472 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf47a0-72ad-4b00-a8fb-8e7ee1cbc67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:02.771608 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf47a0-72ad-4b00-a8fb-8e7ee1cbc67b admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:02.772062 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf47a0-72ad-4b00-a8fb-8e7ee1cbc67b admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:02.772545 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf47a0-72ad-4b00-a8fb-8e7ee1cbc67b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:02.774105 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 84/161] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:08:02 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:08:02.774976 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a4145-4e6f-4c37-baa5-d065dc27a19d admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:02.782505 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cf47a0-72ad-4b00-a8fb-8e7ee1cbc67b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:02.784458 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cf47a0-72ad-4b00-a8fb-8e7ee1cbc67b admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:02.784782 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a4145-4e6f-4c37-baa5-d065dc27a19d admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:02.789003 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d40aaa-9292-4a0f-a8e7-6a84a45d443a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:02.789839 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d40aaa-9292-4a0f-a8e7-6a84a45d443a admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:02.790112 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d40aaa-9292-4a0f-a8e7-6a84a45d443a admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:02.790379 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d40aaa-9292-4a0f-a8e7-6a84a45d443a admin admin] PATH_INFO: `/v3/projects/cdcd751220ba4b99976025fa89d35abd` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:02.791562 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d40aaa-9292-4a0f-a8e7-6a84a45d443a admin admin] RBAC: Authorizing `identity:get_project(project_id=cdcd751220ba4b99976025fa89d35abd)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:02.793627 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 78/162] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:08:02 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:08:02.793727 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d40aaa-9292-4a0f-a8e7-6a84a45d443a admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:02.794230 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf47a0-72ad-4b00-a8fb-8e7ee1cbc67b admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:02.795452 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 85/163] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:08:02 2021] GET /identity/v3/projects/cdcd751220ba4b99976025fa89d35abd => generated 312 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:02.800477 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ee4d4-87d6-4ecf-a9d6-23f4c81726c8 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:02.800754 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ee4d4-87d6-4ecf-a9d6-23f4c81726c8 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:02.801026 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ee4d4-87d6-4ecf-a9d6-23f4c81726c8 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:02.802668 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 86/164] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:02.805186 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ee4d4-87d6-4ecf-a9d6-23f4c81726c8 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:02.809313 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf47a0-72ad-4b00-a8fb-8e7ee1cbc67b admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:02.814369 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909f397-5435-4643-b80a-dea79e5f8b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:02.815461 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909f397-5435-4643-b80a-dea79e5f8b0a admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:02.815741 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909f397-5435-4643-b80a-dea79e5f8b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:02.816015 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909f397-5435-4643-b80a-dea79e5f8b0a admin admin] PATH_INFO: `/v3/projects/4facf8265b034e41b65929b2699eb944` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:02.817196 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b909f397-5435-4643-b80a-dea79e5f8b0a admin admin] RBAC: Authorizing `identity:get_project(project_id=4facf8265b034e41b65929b2699eb944)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:02.819319 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b909f397-5435-4643-b80a-dea79e5f8b0a admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:02.819610 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ee4d4-87d6-4ecf-a9d6-23f4c81726c8 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:02.821181 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 79/165] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:08:02 2021] GET /identity/v3/projects/4facf8265b034e41b65929b2699eb944 => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:02.824069 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b19f0-7afd-4545-9244-eb64411914a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:02.826335 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b19f0-7afd-4545-9244-eb64411914a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:02.826335 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b19f0-7afd-4545-9244-eb64411914a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:02.826335 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b19f0-7afd-4545-9244-eb64411914a8 admin admin] PATH_INFO: `/v3/projects/4facf8265b034e41b65929b2699eb944` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:02.827346 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909f397-5435-4643-b80a-dea79e5f8b0a admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:02.827464 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b19f0-7afd-4545-9244-eb64411914a8 admin admin] RBAC: Authorizing `identity:get_project(project_id=4facf8265b034e41b65929b2699eb944)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:02.829569 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b19f0-7afd-4545-9244-eb64411914a8 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:02.835019 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 87/166] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:08:02 2021] GET /identity/v3/projects/4facf8265b034e41b65929b2699eb944 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:02.835019 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d398382-ed02-41e6-880f-61c52d832f99 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:02.835019 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d398382-ed02-41e6-880f-61c52d832f99 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:02.835019 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d398382-ed02-41e6-880f-61c52d832f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:02.837699 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909f397-5435-4643-b80a-dea79e5f8b0a admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:02.842290 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766903d3-957b-4133-9cde-1432440fec2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:02.843499 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766903d3-957b-4133-9cde-1432440fec2e admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:02.843499 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766903d3-957b-4133-9cde-1432440fec2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:02.843499 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766903d3-957b-4133-9cde-1432440fec2e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:02.844365 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766903d3-957b-4133-9cde-1432440fec2e admin admin] RBAC: Adding query filter params (role.id=88a0e2c4c85c4449ad4681edcdc57835, scope.project.id=cdcd751220ba4b99976025fa89d35abd, user.id=c91aa55f3c094ec2b5eed7180bc6fd6e) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:02.844678 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766903d3-957b-4133-9cde-1432440fec2e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:02.846550 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766903d3-957b-4133-9cde-1432440fec2e admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:02.852957 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 80/167] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:08:02 2021] GET /identity/v3/role_assignments?user.id=c91aa55f3c094ec2b5eed7180bc6fd6e&scope.project.id=cdcd751220ba4b99976025fa89d35abd&role.id=88a0e2c4c85c4449ad4681edcdc57835 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:02.853562 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766903d3-957b-4133-9cde-1432440fec2e admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:02.855747 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-3d398382-ed02-41e6-880f-61c52d832f99 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:02.857228 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-3d398382-ed02-41e6-880f-61c52d832f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:02.863570 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766903d3-957b-4133-9cde-1432440fec2e admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:02.878877 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 88/168] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:02 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:02.878877 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d398382-ed02-41e6-880f-61c52d832f99 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:02.879127 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d50943-0a71-480a-bf6e-8453341ed130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:02.879127 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d50943-0a71-480a-bf6e-8453341ed130 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:02.879127 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d50943-0a71-480a-bf6e-8453341ed130 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:02.879127 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d50943-0a71-480a-bf6e-8453341ed130 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:02.879398 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d50943-0a71-480a-bf6e-8453341ed130 admin admin] RBAC: Adding query filter params (role.id=33d95c7861b64f1a95af8a333bd626ea, scope.project.id=4facf8265b034e41b65929b2699eb944, user.id=d89548cfaf2149148790fd3546ef2b15) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:02.879732 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d50943-0a71-480a-bf6e-8453341ed130 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:02.885305 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d50943-0a71-480a-bf6e-8453341ed130 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:02.893932 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d398382-ed02-41e6-880f-61c52d832f99 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:02.898606 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 81/169] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:08:02 2021] GET /identity/v3/role_assignments?user.id=d89548cfaf2149148790fd3546ef2b15&scope.project.id=4facf8265b034e41b65929b2699eb944&role.id=33d95c7861b64f1a95af8a333bd626ea => generated 608 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:02.903549 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d50943-0a71-480a-bf6e-8453341ed130 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:02.915449 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d50943-0a71-480a-bf6e-8453341ed130 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:02.917044 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f1516-2a8d-4f17-bc92-e8db158df655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:02.917834 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f1516-2a8d-4f17-bc92-e8db158df655 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:02.918109 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f1516-2a8d-4f17-bc92-e8db158df655 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:02.918383 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f1516-2a8d-4f17-bc92-e8db158df655 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:02.919289 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f1516-2a8d-4f17-bc92-e8db158df655 admin admin] RBAC: Adding query filter params (role.id=d63eb17a7e7d455ea5f2c6696d92978c, scope.project.id=4facf8265b034e41b65929b2699eb944, user.id=c91aa55f3c094ec2b5eed7180bc6fd6e) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:02.919616 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f1516-2a8d-4f17-bc92-e8db158df655 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:02.921520 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f1516-2a8d-4f17-bc92-e8db158df655 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:02.922497 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894272c-9265-43a9-8e91-1dd325565585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:02.923592 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894272c-9265-43a9-8e91-1dd325565585 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:02.924155 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894272c-9265-43a9-8e91-1dd325565585 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:02.924626 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894272c-9265-43a9-8e91-1dd325565585 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:02.936030 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 89/170] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:08:02 2021] GET /identity/v3/role_assignments?user.id=c91aa55f3c094ec2b5eed7180bc6fd6e&scope.project.id=4facf8265b034e41b65929b2699eb944&role.id=d63eb17a7e7d455ea5f2c6696d92978c => generated 608 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:02.945597 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9894272c-9265-43a9-8e91-1dd325565585 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:02.953510 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-9894272c-9265-43a9-8e91-1dd325565585 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 29 20:08:02.963881 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 82/171] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:08:02 2021] GET /identity/v3/roles/reader => generated 84 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:02.970667 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f1516-2a8d-4f17-bc92-e8db158df655 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:02.985407 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f1516-2a8d-4f17-bc92-e8db158df655 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:03.000611 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d986c-44a5-415f-a492-5205be9a4056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:03.001312 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d986c-44a5-415f-a492-5205be9a4056 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:03.001592 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d986c-44a5-415f-a492-5205be9a4056 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:03.001866 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d986c-44a5-415f-a492-5205be9a4056 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:03.002688 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d986c-44a5-415f-a492-5205be9a4056 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:03.003008 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d986c-44a5-415f-a492-5205be9a4056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:03.004674 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644d986c-44a5-415f-a492-5205be9a4056 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:03.023395 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 90/172] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Nov 29 20:08:02 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:03.030228 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894272c-9265-43a9-8e91-1dd325565585 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:03.049934 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894272c-9265-43a9-8e91-1dd325565585 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:03.055090 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d63f4-7ffb-4135-b3cc-320ffcab4f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:03.056525 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d63f4-7ffb-4135-b3cc-320ffcab4f73 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:03.057001 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d63f4-7ffb-4135-b3cc-320ffcab4f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:03.057509 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d63f4-7ffb-4135-b3cc-320ffcab4f73 admin admin] PATH_INFO: `/v3/users/5dca3dd74e8244cfa8753241936d87f7` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:03.060422 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d63f4-7ffb-4135-b3cc-320ffcab4f73 admin admin] RBAC: Authorizing `identity:get_user(user_id=5dca3dd74e8244cfa8753241936d87f7)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:03.067200 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d63f4-7ffb-4135-b3cc-320ffcab4f73 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:03.069900 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 83/173] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:08:03 2021] GET /identity/v3/users/5dca3dd74e8244cfa8753241936d87f7 => generated 289 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:03.076034 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d986c-44a5-415f-a492-5205be9a4056 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:03.089184 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d986c-44a5-415f-a492-5205be9a4056 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:03.099187 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a2e87-9a17-4f36-865b-c4cfc40b9ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:03.100078 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a2e87-9a17-4f36-865b-c4cfc40b9ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:03.100352 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a2e87-9a17-4f36-865b-c4cfc40b9ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:03.100619 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a2e87-9a17-4f36-865b-c4cfc40b9ab3 admin admin] PATH_INFO: `/v3/projects/4facf8265b034e41b65929b2699eb944` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:03.107914 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a2e87-9a17-4f36-865b-c4cfc40b9ab3 admin admin] RBAC: Authorizing `identity:get_project(project_id=4facf8265b034e41b65929b2699eb944)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:03.110023 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a2e87-9a17-4f36-865b-c4cfc40b9ab3 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:03.111877 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 91/174] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:08:03 2021] GET /identity/v3/projects/4facf8265b034e41b65929b2699eb944 => generated 298 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:03.118425 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d63f4-7ffb-4135-b3cc-320ffcab4f73 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:03.129391 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d63f4-7ffb-4135-b3cc-320ffcab4f73 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:03.135801 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7c222-8d9d-4941-b058-3d582f8d8d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:03.136933 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7c222-8d9d-4941-b058-3d582f8d8d2c admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:03.137307 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7c222-8d9d-4941-b058-3d582f8d8d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:03.137677 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7c222-8d9d-4941-b058-3d582f8d8d2c admin admin] PATH_INFO: `/v3/projects/4facf8265b034e41b65929b2699eb944/users/5dca3dd74e8244cfa8753241936d87f7/roles/26a400f146c54b26a90d5afef23446e8` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:03.140197 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7c222-8d9d-4941-b058-3d582f8d8d2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4facf8265b034e41b65929b2699eb944, user_id=5dca3dd74e8244cfa8753241936d87f7, role_id=26a400f146c54b26a90d5afef23446e8)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:03.143356 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7c222-8d9d-4941-b058-3d582f8d8d2c admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:03.162133 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 84/175] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Nov 29 20:08:03 2021] PUT /identity/v3/projects/4facf8265b034e41b65929b2699eb944/users/5dca3dd74e8244cfa8753241936d87f7/roles/26a400f146c54b26a90d5afef23446e8 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:08:04.062189 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d7b38-d21f-486e-9257-b1fdd2cce666 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:04.062762 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d7b38-d21f-486e-9257-b1fdd2cce666 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:04.062762 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d7b38-d21f-486e-9257-b1fdd2cce666 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:04.064754 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 92/176] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:04.070245 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f1a61-7dbb-4e80-b65f-0da640e6239f None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:04.070658 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f1a61-7dbb-4e80-b65f-0da640e6239f None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:04.070921 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f1a61-7dbb-4e80-b65f-0da640e6239f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:04.089686 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-f90f1a61-7dbb-4e80-b65f-0da640e6239f None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:04.090795 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-f90f1a61-7dbb-4e80-b65f-0da640e6239f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:04.147638 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 85/177] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:04 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:04.172238 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d7b38-d21f-486e-9257-b1fdd2cce666 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:04.184691 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d7b38-d21f-486e-9257-b1fdd2cce666 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:04.189020 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3fa7c-7951-4770-b15d-ba9e3bf5903d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:04.189881 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3fa7c-7951-4770-b15d-ba9e3bf5903d admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:04.190230 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3fa7c-7951-4770-b15d-ba9e3bf5903d admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:04.190567 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3fa7c-7951-4770-b15d-ba9e3bf5903d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:04.191909 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b3fa7c-7951-4770-b15d-ba9e3bf5903d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:04.193754 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b3fa7c-7951-4770-b15d-ba9e3bf5903d admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:04.195600 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 93/178] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:04 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:04.201341 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f1a61-7dbb-4e80-b65f-0da640e6239f None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:04.210394 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f1a61-7dbb-4e80-b65f-0da640e6239f None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:04.215177 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7437c5-b63f-44bd-a832-80f984b7b282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:04.215826 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7437c5-b63f-44bd-a832-80f984b7b282 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:04.216176 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7437c5-b63f-44bd-a832-80f984b7b282 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:04.216445 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7437c5-b63f-44bd-a832-80f984b7b282 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:04.217161 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7437c5-b63f-44bd-a832-80f984b7b282 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:04.218160 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING py.warnings [None req-ee7437c5-b63f-44bd-a832-80f984b7b282 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 29 20:08:04.218160 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: warnings.warn(msg) Nov 29 20:08:04.218160 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: Nov 29 20:08:04.219985 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7437c5-b63f-44bd-a832-80f984b7b282 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:04.247332 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 86/179] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Nov 29 20:08:04 2021] POST /identity/v3/users => generated 283 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:08:05.540454 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e4cb0-abf6-4167-b263-192e0ca644d4 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:05.541322 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e4cb0-abf6-4167-b263-192e0ca644d4 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:05.541764 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e4cb0-abf6-4167-b263-192e0ca644d4 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:05.543794 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 94/180] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:05.549849 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499715b-cd52-4dcd-9c73-82654935ea29 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:05.550615 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499715b-cd52-4dcd-9c73-82654935ea29 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:05.551053 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499715b-cd52-4dcd-9c73-82654935ea29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:05.577437 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-f499715b-cd52-4dcd-9c73-82654935ea29 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:05.578881 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-f499715b-cd52-4dcd-9c73-82654935ea29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:05.588997 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 87/181] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:05 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 29 20:08:05.631839 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e4cb0-abf6-4167-b263-192e0ca644d4 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:05.648787 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e4cb0-abf6-4167-b263-192e0ca644d4 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:05.658463 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8269820-9e05-45a0-9b04-e64b52d1d977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:05.659302 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8269820-9e05-45a0-9b04-e64b52d1d977 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:05.659579 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8269820-9e05-45a0-9b04-e64b52d1d977 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:05.659952 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8269820-9e05-45a0-9b04-e64b52d1d977 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:05.676134 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8269820-9e05-45a0-9b04-e64b52d1d977 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:05.683049 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-a8269820-9e05-45a0-9b04-e64b52d1d977 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 29 20:08:05.684608 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 95/182] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:08:05 2021] GET /identity/v3/roles/reader => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:05.690568 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499715b-cd52-4dcd-9c73-82654935ea29 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:05.700584 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499715b-cd52-4dcd-9c73-82654935ea29 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:05.714500 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9efe3-ff3d-48ba-b288-fb0dd8ce9144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:05.715704 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9efe3-ff3d-48ba-b288-fb0dd8ce9144 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:05.716177 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9efe3-ff3d-48ba-b288-fb0dd8ce9144 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:05.716640 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9efe3-ff3d-48ba-b288-fb0dd8ce9144 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:05.717620 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9efe3-ff3d-48ba-b288-fb0dd8ce9144 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:05.718149 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9efe3-ff3d-48ba-b288-fb0dd8ce9144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:05.720072 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9efe3-ff3d-48ba-b288-fb0dd8ce9144 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:05.734268 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 88/183] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Nov 29 20:08:05 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:05.740291 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8269820-9e05-45a0-9b04-e64b52d1d977 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:05.755736 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8269820-9e05-45a0-9b04-e64b52d1d977 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:05.762783 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e70fad2-f3db-42d7-bf70-58e8a96c1bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:05.763676 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70fad2-f3db-42d7-bf70-58e8a96c1bbc admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:05.763952 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70fad2-f3db-42d7-bf70-58e8a96c1bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:05.764220 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70fad2-f3db-42d7-bf70-58e8a96c1bbc admin admin] PATH_INFO: `/v3/users/5dca3dd74e8244cfa8753241936d87f7` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:05.771576 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e70fad2-f3db-42d7-bf70-58e8a96c1bbc admin admin] RBAC: Authorizing `identity:get_user(user_id=5dca3dd74e8244cfa8753241936d87f7)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:05.773708 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e70fad2-f3db-42d7-bf70-58e8a96c1bbc admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:05.775652 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 96/184] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:08:05 2021] GET /identity/v3/users/5dca3dd74e8244cfa8753241936d87f7 => generated 289 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:05.781344 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9efe3-ff3d-48ba-b288-fb0dd8ce9144 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:05.791501 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9efe3-ff3d-48ba-b288-fb0dd8ce9144 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:05.801749 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee2805-758d-475c-9cc7-eb404d32fffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:05.802726 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee2805-758d-475c-9cc7-eb404d32fffb admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:05.803222 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee2805-758d-475c-9cc7-eb404d32fffb admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:05.803700 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee2805-758d-475c-9cc7-eb404d32fffb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:05.815252 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee2805-758d-475c-9cc7-eb404d32fffb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:05.817363 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee2805-758d-475c-9cc7-eb404d32fffb admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:05.834086 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 89/185] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:08:05 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:08:05.840498 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e70fad2-f3db-42d7-bf70-58e8a96c1bbc admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:05.859643 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e70fad2-f3db-42d7-bf70-58e8a96c1bbc admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:05.871464 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c20a86-47b1-41b7-81ae-e4f1dd99ea78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:05.872332 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c20a86-47b1-41b7-81ae-e4f1dd99ea78 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:05.872605 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c20a86-47b1-41b7-81ae-e4f1dd99ea78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:05.872875 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c20a86-47b1-41b7-81ae-e4f1dd99ea78 admin admin] PATH_INFO: `/v3/projects/4facf8265b034e41b65929b2699eb944` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:05.874080 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c20a86-47b1-41b7-81ae-e4f1dd99ea78 admin admin] RBAC: Authorizing `identity:get_project(project_id=4facf8265b034e41b65929b2699eb944)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:05.876149 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c20a86-47b1-41b7-81ae-e4f1dd99ea78 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:05.878037 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 97/186] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:08:05 2021] GET /identity/v3/projects/4facf8265b034e41b65929b2699eb944 => generated 298 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:05.884786 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee2805-758d-475c-9cc7-eb404d32fffb admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:05.894114 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee2805-758d-475c-9cc7-eb404d32fffb admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:05.903111 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e6e51-e37b-4a8e-b2a3-b319779345b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:05.903812 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e6e51-e37b-4a8e-b2a3-b319779345b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:05.904091 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e6e51-e37b-4a8e-b2a3-b319779345b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:05.904364 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e6e51-e37b-4a8e-b2a3-b319779345b7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:05.905211 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e6e51-e37b-4a8e-b2a3-b319779345b7 admin admin] RBAC: Adding query filter params (role.id=26a400f146c54b26a90d5afef23446e8, scope.project.id=4facf8265b034e41b65929b2699eb944, user.id=5dca3dd74e8244cfa8753241936d87f7) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:05.905571 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e6e51-e37b-4a8e-b2a3-b319779345b7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:05.907525 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e6e51-e37b-4a8e-b2a3-b319779345b7 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:05.913982 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 90/187] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:08:05 2021] GET /identity/v3/role_assignments?user.id=5dca3dd74e8244cfa8753241936d87f7&scope.project.id=4facf8265b034e41b65929b2699eb944&role.id=26a400f146c54b26a90d5afef23446e8 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:07.023952 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a509b6-ab98-45c7-a9e1-5758ddafc7ad None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:07.024468 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a509b6-ab98-45c7-a9e1-5758ddafc7ad None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:07.024468 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a509b6-ab98-45c7-a9e1-5758ddafc7ad None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:07.026458 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 98/188] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:07.032271 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b63aa-4de2-4fc0-96af-7d01c69d60eb None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:07.032696 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b63aa-4de2-4fc0-96af-7d01c69d60eb None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:07.032863 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b63aa-4de2-4fc0-96af-7d01c69d60eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:07.050614 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-eb6b63aa-4de2-4fc0-96af-7d01c69d60eb None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:07.051818 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-eb6b63aa-4de2-4fc0-96af-7d01c69d60eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:07.059649 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978a84e-c482-40e5-b2a1-5472932e072d None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:07.059865 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 91/189] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:07 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:07.060368 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978a84e-c482-40e5-b2a1-5472932e072d None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:07.060933 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978a84e-c482-40e5-b2a1-5472932e072d None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:07.062932 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 99/190] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:07.069102 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b352a-93a5-4f55-9c7e-43d0c66a86df None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:07.069594 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b352a-93a5-4f55-9c7e-43d0c66a86df None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:07.070050 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b352a-93a5-4f55-9c7e-43d0c66a86df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:07.085357 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978a84e-c482-40e5-b2a1-5472932e072d None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:07.090478 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-175b352a-93a5-4f55-9c7e-43d0c66a86df None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:07.091667 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-175b352a-93a5-4f55-9c7e-43d0c66a86df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:07.098108 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978a84e-c482-40e5-b2a1-5472932e072d None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:07.099234 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 92/191] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:07 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:07.105702 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb2420-1275-4d16-b22a-144f011f2f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:07.106726 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb2420-1275-4d16-b22a-144f011f2f2d admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:07.107233 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb2420-1275-4d16-b22a-144f011f2f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:07.107686 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb2420-1275-4d16-b22a-144f011f2f2d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:07.118131 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb2420-1275-4d16-b22a-144f011f2f2d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:07.123030 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b352a-93a5-4f55-9c7e-43d0c66a86df None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:07.125629 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-51eb2420-1275-4d16-b22a-144f011f2f2d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 29 20:08:07.127111 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 100/192] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Nov 29 20:08:07 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:07.133527 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb2420-1275-4d16-b22a-144f011f2f2d admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:07.136865 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b352a-93a5-4f55-9c7e-43d0c66a86df None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:07.141226 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d8f16-0fa2-4dec-b1f7-6992c3b5fdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:07.142012 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d8f16-0fa2-4dec-b1f7-6992c3b5fdbc admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:07.142283 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d8f16-0fa2-4dec-b1f7-6992c3b5fdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:07.142547 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d8f16-0fa2-4dec-b1f7-6992c3b5fdbc admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:07.145154 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb2420-1275-4d16-b22a-144f011f2f2d admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:07.151350 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb947b-5482-4196-ab8e-7dde72e2ea9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:07.152437 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb947b-5482-4196-ab8e-7dde72e2ea9e admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:07.153166 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb947b-5482-4196-ab8e-7dde72e2ea9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:07.153671 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb947b-5482-4196-ab8e-7dde72e2ea9e admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:07.154628 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb947b-5482-4196-ab8e-7dde72e2ea9e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:07.155374 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb947b-5482-4196-ab8e-7dde72e2ea9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:07.155708 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898d8f16-0fa2-4dec-b1f7-6992c3b5fdbc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:07.157352 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb947b-5482-4196-ab8e-7dde72e2ea9e admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:07.162704 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-898d8f16-0fa2-4dec-b1f7-6992c3b5fdbc admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 29 20:08:07.163993 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 93/193] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:08:07 2021] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:08:07.166745 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 101/194] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:08:07 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:07.174044 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d8f16-0fa2-4dec-b1f7-6992c3b5fdbc admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:07.175103 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb947b-5482-4196-ab8e-7dde72e2ea9e admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:07.184279 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d8f16-0fa2-4dec-b1f7-6992c3b5fdbc admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:07.185805 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb947b-5482-4196-ab8e-7dde72e2ea9e admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:07.188779 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a38c5-3a43-41b6-b235-3b7320523131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:07.189495 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a38c5-3a43-41b6-b235-3b7320523131 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:07.189889 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a38c5-3a43-41b6-b235-3b7320523131 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:07.190200 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a38c5-3a43-41b6-b235-3b7320523131 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:07.191069 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a38c5-3a43-41b6-b235-3b7320523131 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:07.191494 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a38c5-3a43-41b6-b235-3b7320523131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:07.191989 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a6eda2-3ca1-42a3-aeab-5135bef54bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:07.193056 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6eda2-3ca1-42a3-aeab-5135bef54bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:07.193329 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a38c5-3a43-41b6-b235-3b7320523131 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:07.193686 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6eda2-3ca1-42a3-aeab-5135bef54bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:07.194129 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a6eda2-3ca1-42a3-aeab-5135bef54bd4 admin admin] PATH_INFO: `/v3/users/79917d2425d147f1920d9f4cba12bb75` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:07.210901 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 94/195] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Nov 29 20:08:07 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:07.210901 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a38c5-3a43-41b6-b235-3b7320523131 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:07.221808 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a38c5-3a43-41b6-b235-3b7320523131 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:07.226241 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e515df-37c0-40cd-98ad-82f6f4d136ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:07.227168 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e515df-37c0-40cd-98ad-82f6f4d136ce admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:07.227540 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e515df-37c0-40cd-98ad-82f6f4d136ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:07.227850 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e515df-37c0-40cd-98ad-82f6f4d136ce admin admin] PATH_INFO: `/v3/users/79917d2425d147f1920d9f4cba12bb75` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:07.228070 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a6eda2-3ca1-42a3-aeab-5135bef54bd4 admin admin] RBAC: Authorizing `identity:get_user(user_id=79917d2425d147f1920d9f4cba12bb75)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:07.229103 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e515df-37c0-40cd-98ad-82f6f4d136ce admin admin] RBAC: Authorizing `identity:get_user(user_id=79917d2425d147f1920d9f4cba12bb75)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:07.230933 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a6eda2-3ca1-42a3-aeab-5135bef54bd4 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:07.231377 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e515df-37c0-40cd-98ad-82f6f4d136ce admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:07.233110 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 102/196] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:08:07 2021] GET /identity/v3/users/79917d2425d147f1920d9f4cba12bb75 => generated 283 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:07.234981 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 95/197] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:08:07 2021] GET /identity/v3/users/79917d2425d147f1920d9f4cba12bb75 => generated 283 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:07.243395 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a6eda2-3ca1-42a3-aeab-5135bef54bd4 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:07.243737 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e515df-37c0-40cd-98ad-82f6f4d136ce admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:07.253616 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e515df-37c0-40cd-98ad-82f6f4d136ce admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:07.254122 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a6eda2-3ca1-42a3-aeab-5135bef54bd4 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:07.259090 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bf71a-3d4e-4a87-b201-837111ab338d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:07.259846 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bf71a-3d4e-4a87-b201-837111ab338d admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:07.260206 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bf71a-3d4e-4a87-b201-837111ab338d admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:07.260543 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bf71a-3d4e-4a87-b201-837111ab338d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:07.261051 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f6b14d-6c09-424a-bff1-07cdf726c6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:07.261992 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6b14d-6c09-424a-bff1-07cdf726c6e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:07.262444 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6b14d-6c09-424a-bff1-07cdf726c6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:07.262924 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6b14d-6c09-424a-bff1-07cdf726c6e3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:07.269282 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1bf71a-3d4e-4a87-b201-837111ab338d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:07.271145 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1bf71a-3d4e-4a87-b201-837111ab338d admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:07.272597 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f6b14d-6c09-424a-bff1-07cdf726c6e3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:07.274501 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f6b14d-6c09-424a-bff1-07cdf726c6e3 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:07.284933 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 103/199] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:08:07 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:08:07.289865 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 96/199] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:08:07 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:08:07.289865 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bf71a-3d4e-4a87-b201-837111ab338d admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:07.290997 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f6b14d-6c09-424a-bff1-07cdf726c6e3 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:07.297339 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bf71a-3d4e-4a87-b201-837111ab338d admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:07.301769 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f10f0e-51ce-4f56-b2bd-b2d365a95f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:07.301998 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f6b14d-6c09-424a-bff1-07cdf726c6e3 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:07.302798 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f10f0e-51ce-4f56-b2bd-b2d365a95f17 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:07.303183 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f10f0e-51ce-4f56-b2bd-b2d365a95f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:07.303555 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f10f0e-51ce-4f56-b2bd-b2d365a95f17 admin admin] PATH_INFO: `/v3/projects/949a39418c3f4e5d83eee096bcff2c25` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:07.304812 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f10f0e-51ce-4f56-b2bd-b2d365a95f17 admin admin] RBAC: Authorizing `identity:get_project(project_id=949a39418c3f4e5d83eee096bcff2c25)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:07.307063 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f10f0e-51ce-4f56-b2bd-b2d365a95f17 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:07.307501 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5bac23-a1e3-41ac-b2e5-07bbeec661e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:07.308598 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5bac23-a1e3-41ac-b2e5-07bbeec661e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:07.309050 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5bac23-a1e3-41ac-b2e5-07bbeec661e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:07.309166 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 97/200] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:08:07 2021] GET /identity/v3/projects/949a39418c3f4e5d83eee096bcff2c25 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:07.309587 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5bac23-a1e3-41ac-b2e5-07bbeec661e6 admin admin] PATH_INFO: `/v3/projects/949a39418c3f4e5d83eee096bcff2c25` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:07.311009 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5bac23-a1e3-41ac-b2e5-07bbeec661e6 admin admin] RBAC: Authorizing `identity:get_project(project_id=949a39418c3f4e5d83eee096bcff2c25)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:07.313198 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5bac23-a1e3-41ac-b2e5-07bbeec661e6 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:07.315089 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 104/201] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:08:07 2021] GET /identity/v3/projects/949a39418c3f4e5d83eee096bcff2c25 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:07.318883 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f10f0e-51ce-4f56-b2bd-b2d365a95f17 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:07.321183 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5bac23-a1e3-41ac-b2e5-07bbeec661e6 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:07.331897 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5bac23-a1e3-41ac-b2e5-07bbeec661e6 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:07.332312 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f10f0e-51ce-4f56-b2bd-b2d365a95f17 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:07.336787 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c47db-cb46-4822-b5ef-be1827dd24fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:07.337596 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c47db-cb46-4822-b5ef-be1827dd24fd admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:07.337713 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602667e8-91eb-4c02-9c88-398fbb202835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:07.337909 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c47db-cb46-4822-b5ef-be1827dd24fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:07.338138 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c47db-cb46-4822-b5ef-be1827dd24fd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:07.338358 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602667e8-91eb-4c02-9c88-398fbb202835 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:07.338691 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602667e8-91eb-4c02-9c88-398fbb202835 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:07.339028 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c47db-cb46-4822-b5ef-be1827dd24fd admin admin] RBAC: Adding query filter params (role.id=33d95c7861b64f1a95af8a333bd626ea, scope.project.id=949a39418c3f4e5d83eee096bcff2c25, user.id=79917d2425d147f1920d9f4cba12bb75) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:07.339133 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602667e8-91eb-4c02-9c88-398fbb202835 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:07.339386 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c47db-cb46-4822-b5ef-be1827dd24fd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:07.340027 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602667e8-91eb-4c02-9c88-398fbb202835 admin admin] RBAC: Adding query filter params (role.id=88a0e2c4c85c4449ad4681edcdc57835, scope.project.id=949a39418c3f4e5d83eee096bcff2c25, user.id=79917d2425d147f1920d9f4cba12bb75) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:07.340338 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602667e8-91eb-4c02-9c88-398fbb202835 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:07.341212 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c47db-cb46-4822-b5ef-be1827dd24fd admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:07.342171 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602667e8-91eb-4c02-9c88-398fbb202835 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:07.347870 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 105/202] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:08:07 2021] GET /identity/v3/role_assignments?user.id=79917d2425d147f1920d9f4cba12bb75&scope.project.id=949a39418c3f4e5d83eee096bcff2c25&role.id=33d95c7861b64f1a95af8a333bd626ea => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:07.348007 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 98/203] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:08:07 2021] GET /identity/v3/role_assignments?user.id=79917d2425d147f1920d9f4cba12bb75&scope.project.id=949a39418c3f4e5d83eee096bcff2c25&role.id=88a0e2c4c85c4449ad4681edcdc57835 => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:07.351157 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772912a-b409-437c-b499-7cbf1fa77a70 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:07.351714 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772912a-b409-437c-b499-7cbf1fa77a70 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:07.352188 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b772912a-b409-437c-b499-7cbf1fa77a70 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:07.354441 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 106/204] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:07 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:07.359426 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f9ed6-3055-44ba-a190-cf0b15c51461 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:07.359426 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f9ed6-3055-44ba-a190-cf0b15c51461 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:07.359426 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85f9ed6-3055-44ba-a190-cf0b15c51461 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:07.362883 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 99/205] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:07.363066 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffdcb6-4683-4391-a313-fd9708cb0940 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:07.363066 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffdcb6-4683-4391-a313-fd9708cb0940 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:07.363066 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ffdcb6-4683-4391-a313-fd9708cb0940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:07.369528 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79112c-ec9f-443e-b0a6-0c980b09b7f1 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:07.369869 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79112c-ec9f-443e-b0a6-0c980b09b7f1 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:07.370153 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79112c-ec9f-443e-b0a6-0c980b09b7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:07.381808 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-42ffdcb6-4683-4391-a313-fd9708cb0940 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:07.383823 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-42ffdcb6-4683-4391-a313-fd9708cb0940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:07.390662 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-ab79112c-ec9f-443e-b0a6-0c980b09b7f1 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:07.392155 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-ab79112c-ec9f-443e-b0a6-0c980b09b7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:07.392711 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 107/206] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:07 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 29 20:08:07.407810 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 100/207] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:07 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 29 20:08:07.418479 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ffdcb6-4683-4391-a313-fd9708cb0940 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:07.428641 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ffdcb6-4683-4391-a313-fd9708cb0940 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:07.433488 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b603e-a1db-41ad-8388-81c2ebbceef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:07.434118 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79112c-ec9f-443e-b0a6-0c980b09b7f1 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:07.434466 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b603e-a1db-41ad-8388-81c2ebbceef2 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:07.434812 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b603e-a1db-41ad-8388-81c2ebbceef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:07.435180 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b603e-a1db-41ad-8388-81c2ebbceef2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:07.436498 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b603e-a1db-41ad-8388-81c2ebbceef2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:07.438339 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b603e-a1db-41ad-8388-81c2ebbceef2 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:07.440468 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 108/208] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:07 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:07.444282 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79112c-ec9f-443e-b0a6-0c980b09b7f1 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:07.446448 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b603e-a1db-41ad-8388-81c2ebbceef2 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:07.449502 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7180a1c-f2dd-4b77-9c11-d255bdb5aaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:07.450411 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7180a1c-f2dd-4b77-9c11-d255bdb5aaae admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:07.450748 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7180a1c-f2dd-4b77-9c11-d255bdb5aaae admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:07.451062 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7180a1c-f2dd-4b77-9c11-d255bdb5aaae admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:07.457118 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b603e-a1db-41ad-8388-81c2ebbceef2 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:07.461856 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae8c66-41b4-47cc-af34-52d35be1f280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:07.462681 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae8c66-41b4-47cc-af34-52d35be1f280 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:07.463057 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae8c66-41b4-47cc-af34-52d35be1f280 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:07.463404 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae8c66-41b4-47cc-af34-52d35be1f280 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:07.464226 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae8c66-41b4-47cc-af34-52d35be1f280 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:07.464380 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7180a1c-f2dd-4b77-9c11-d255bdb5aaae admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:07.466338 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae8c66-41b4-47cc-af34-52d35be1f280 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:07.472170 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-b7180a1c-f2dd-4b77-9c11-d255bdb5aaae admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 29 20:08:07.473536 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 101/209] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Nov 29 20:08:07 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:07.480026 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7180a1c-f2dd-4b77-9c11-d255bdb5aaae admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:07.488862 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 109/210] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Nov 29 20:08:07 2021] POST /identity/v3/users => generated 297 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 29 20:08:07.494914 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7180a1c-f2dd-4b77-9c11-d255bdb5aaae admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:07.500003 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644cf6f-3a69-4782-b22d-46ae3a3ff141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:07.501147 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644cf6f-3a69-4782-b22d-46ae3a3ff141 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:07.501675 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644cf6f-3a69-4782-b22d-46ae3a3ff141 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:07.502107 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644cf6f-3a69-4782-b22d-46ae3a3ff141 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:07.503209 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0644cf6f-3a69-4782-b22d-46ae3a3ff141 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:07.503809 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0644cf6f-3a69-4782-b22d-46ae3a3ff141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:07.506020 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0644cf6f-3a69-4782-b22d-46ae3a3ff141 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:07.518129 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 102/211] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:08:07 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:07.525351 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae8c66-41b4-47cc-af34-52d35be1f280 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:07.537922 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae8c66-41b4-47cc-af34-52d35be1f280 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:07.543475 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90cbcbd-b9df-460b-b208-8d3f206e55c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:07.544806 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cbcbd-b9df-460b-b208-8d3f206e55c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:07.545283 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cbcbd-b9df-460b-b208-8d3f206e55c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:07.545792 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cbcbd-b9df-460b-b208-8d3f206e55c7 admin admin] PATH_INFO: `/v3/users/79917d2425d147f1920d9f4cba12bb75` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:07.547534 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90cbcbd-b9df-460b-b208-8d3f206e55c7 admin admin] RBAC: Authorizing `identity:get_user(user_id=79917d2425d147f1920d9f4cba12bb75)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:07.550127 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90cbcbd-b9df-460b-b208-8d3f206e55c7 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:07.552421 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 110/212] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:08:07 2021] GET /identity/v3/users/79917d2425d147f1920d9f4cba12bb75 => generated 283 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:07.559270 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644cf6f-3a69-4782-b22d-46ae3a3ff141 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:07.570459 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644cf6f-3a69-4782-b22d-46ae3a3ff141 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:07.575966 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b9352-38fe-4084-a534-a8d4d73db61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:07.577071 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b9352-38fe-4084-a534-a8d4d73db61c admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:07.577535 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b9352-38fe-4084-a534-a8d4d73db61c admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:07.577984 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b9352-38fe-4084-a534-a8d4d73db61c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:07.588291 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27b9352-38fe-4084-a534-a8d4d73db61c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:07.590685 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27b9352-38fe-4084-a534-a8d4d73db61c admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:07.601785 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 103/213] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:08:07 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:08:07.608867 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90cbcbd-b9df-460b-b208-8d3f206e55c7 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:07.619591 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90cbcbd-b9df-460b-b208-8d3f206e55c7 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:07.624972 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdcfdad-2104-4ecf-9a1e-f36fc8a55eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:07.625852 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdcfdad-2104-4ecf-9a1e-f36fc8a55eba admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:07.626113 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdcfdad-2104-4ecf-9a1e-f36fc8a55eba admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:07.626383 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdcfdad-2104-4ecf-9a1e-f36fc8a55eba admin admin] PATH_INFO: `/v3/projects/949a39418c3f4e5d83eee096bcff2c25` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:07.627775 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdcfdad-2104-4ecf-9a1e-f36fc8a55eba admin admin] RBAC: Authorizing `identity:get_project(project_id=949a39418c3f4e5d83eee096bcff2c25)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:07.629809 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdcfdad-2104-4ecf-9a1e-f36fc8a55eba admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:07.632460 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 111/214] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:08:07 2021] GET /identity/v3/projects/949a39418c3f4e5d83eee096bcff2c25 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:07.639578 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b9352-38fe-4084-a534-a8d4d73db61c admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:07.652673 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b9352-38fe-4084-a534-a8d4d73db61c admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:07.657407 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9257c4-d959-42f7-9ec3-468db49f3b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:07.658070 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9257c4-d959-42f7-9ec3-468db49f3b05 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:07.658396 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9257c4-d959-42f7-9ec3-468db49f3b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:07.658679 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9257c4-d959-42f7-9ec3-468db49f3b05 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:07.659781 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9257c4-d959-42f7-9ec3-468db49f3b05 admin admin] RBAC: Adding query filter params (role.id=d63eb17a7e7d455ea5f2c6696d92978c, scope.project.id=949a39418c3f4e5d83eee096bcff2c25, user.id=79917d2425d147f1920d9f4cba12bb75) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:07.660138 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9257c4-d959-42f7-9ec3-468db49f3b05 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:07.662141 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9257c4-d959-42f7-9ec3-468db49f3b05 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:07.669107 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 104/215] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:08:07 2021] GET /identity/v3/role_assignments?user.id=79917d2425d147f1920d9f4cba12bb75&scope.project.id=949a39418c3f4e5d83eee096bcff2c25&role.id=d63eb17a7e7d455ea5f2c6696d92978c => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:10.108065 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84d9fa-e5d7-48d4-8b6e-248335e89a48 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:10.108557 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84d9fa-e5d7-48d4-8b6e-248335e89a48 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:10.108557 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84d9fa-e5d7-48d4-8b6e-248335e89a48 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:10.110287 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 112/216] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:10.116526 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664982f5-c382-4c10-90ac-76e777cdd768 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:10.116923 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664982f5-c382-4c10-90ac-76e777cdd768 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:10.117087 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664982f5-c382-4c10-90ac-76e777cdd768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:10.138072 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-664982f5-c382-4c10-90ac-76e777cdd768 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:10.139631 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-664982f5-c382-4c10-90ac-76e777cdd768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:10.152622 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 105/217] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:10 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:10.183427 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84d9fa-e5d7-48d4-8b6e-248335e89a48 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:10.197223 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84d9fa-e5d7-48d4-8b6e-248335e89a48 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:10.208910 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9296c8-aee8-459c-b269-d6b0f7044993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:10.209718 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9296c8-aee8-459c-b269-d6b0f7044993 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:10.209993 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9296c8-aee8-459c-b269-d6b0f7044993 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:10.210264 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9296c8-aee8-459c-b269-d6b0f7044993 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:10.211702 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303d9ea-8ac2-484a-9368-dfeae9f8412e None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:10.212444 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303d9ea-8ac2-484a-9368-dfeae9f8412e None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:10.212935 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303d9ea-8ac2-484a-9368-dfeae9f8412e None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:10.215353 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 106/218] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:10 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:10.221898 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78031c70-0030-4e32-849d-67efdb3c4cc5 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:10.222722 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78031c70-0030-4e32-849d-67efdb3c4cc5 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:10.223240 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78031c70-0030-4e32-849d-67efdb3c4cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:10.225207 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9296c8-aee8-459c-b269-d6b0f7044993 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:10.234878 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-4d9296c8-aee8-459c-b269-d6b0f7044993 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 29 20:08:10.234878 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 113/219] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Nov 29 20:08:10 2021] GET /identity/v3/roles/admin => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:10.243783 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9296c8-aee8-459c-b269-d6b0f7044993 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:10.256504 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-78031c70-0030-4e32-849d-67efdb3c4cc5 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:10.257710 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-78031c70-0030-4e32-849d-67efdb3c4cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:10.261174 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9296c8-aee8-459c-b269-d6b0f7044993 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:10.269657 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b0b2b3-e178-41bb-b8f5-f2f38c1d5f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:10.270321 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0b2b3-e178-41bb-b8f5-f2f38c1d5f33 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:10.270598 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0b2b3-e178-41bb-b8f5-f2f38c1d5f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:10.270875 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0b2b3-e178-41bb-b8f5-f2f38c1d5f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:10.271651 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b0b2b3-e178-41bb-b8f5-f2f38c1d5f33 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:10.271952 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b0b2b3-e178-41bb-b8f5-f2f38c1d5f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:10.273532 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b0b2b3-e178-41bb-b8f5-f2f38c1d5f33 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:10.277517 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 107/220] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:10 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 29 20:08:10.283825 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 114/221] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:08:10 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:10.291887 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78031c70-0030-4e32-849d-67efdb3c4cc5 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:10.302770 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b0b2b3-e178-41bb-b8f5-f2f38c1d5f33 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:10.305320 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78031c70-0030-4e32-849d-67efdb3c4cc5 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:10.310181 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0630f-9aac-4801-aae8-6eb10ad0b5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:10.311357 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0630f-9aac-4801-aae8-6eb10ad0b5f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:10.311832 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0630f-9aac-4801-aae8-6eb10ad0b5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:10.312286 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0630f-9aac-4801-aae8-6eb10ad0b5f1 admin admin] PATH_INFO: `/v3/users/79917d2425d147f1920d9f4cba12bb75` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:10.312384 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b0b2b3-e178-41bb-b8f5-f2f38c1d5f33 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:10.313749 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0630f-9aac-4801-aae8-6eb10ad0b5f1 admin admin] RBAC: Authorizing `identity:get_user(user_id=79917d2425d147f1920d9f4cba12bb75)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:10.316205 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0630f-9aac-4801-aae8-6eb10ad0b5f1 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:10.316560 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e2adb9-01b9-4932-b4c7-a3fd9a9a9be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:10.317338 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2adb9-01b9-4932-b4c7-a3fd9a9a9be2 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:10.317613 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2adb9-01b9-4932-b4c7-a3fd9a9a9be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:10.317882 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e2adb9-01b9-4932-b4c7-a3fd9a9a9be2 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:10.319461 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 108/222] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:08:10 2021] GET /identity/v3/users/79917d2425d147f1920d9f4cba12bb75 => generated 283 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:10.320867 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe5d01-3bc5-42ba-8695-fbcd03cc0550 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:10.321334 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe5d01-3bc5-42ba-8695-fbcd03cc0550 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:10.321792 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe5d01-3bc5-42ba-8695-fbcd03cc0550 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:10.328241 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 109/223] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:10 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:10.328370 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e2adb9-01b9-4932-b4c7-a3fd9a9a9be2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:10.329323 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe5d01-3bc5-42ba-8695-fbcd03cc0550 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:10.335184 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-93e2adb9-01b9-4932-b4c7-a3fd9a9a9be2 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 29 20:08:10.336631 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 115/224] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:08:10 2021] GET /identity/v3/roles/member => generated 84 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:10.337862 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346c715-7d62-4632-b7b2-3fb39382fdc8 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:10.338551 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346c715-7d62-4632-b7b2-3fb39382fdc8 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:10.338551 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1346c715-7d62-4632-b7b2-3fb39382fdc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:10.343537 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe5d01-3bc5-42ba-8695-fbcd03cc0550 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:10.348722 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153854d3-5959-441c-8c8c-6d9dbda23257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:10.349802 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153854d3-5959-441c-8c8c-6d9dbda23257 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:10.350349 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153854d3-5959-441c-8c8c-6d9dbda23257 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:10.350684 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153854d3-5959-441c-8c8c-6d9dbda23257 admin admin] PATH_INFO: `/v3/projects/949a39418c3f4e5d83eee096bcff2c25` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:10.351944 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153854d3-5959-441c-8c8c-6d9dbda23257 admin admin] RBAC: Authorizing `identity:get_project(project_id=949a39418c3f4e5d83eee096bcff2c25)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:10.354069 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153854d3-5959-441c-8c8c-6d9dbda23257 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:10.355869 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 110/225] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:08:10 2021] GET /identity/v3/projects/949a39418c3f4e5d83eee096bcff2c25 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:10.356358 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-1346c715-7d62-4632-b7b2-3fb39382fdc8 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:10.356831 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153854d3-5959-441c-8c8c-6d9dbda23257 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:10.357882 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-1346c715-7d62-4632-b7b2-3fb39382fdc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:10.365851 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 116/226] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:10 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:10.366796 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346c715-7d62-4632-b7b2-3fb39382fdc8 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:10.372256 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153854d3-5959-441c-8c8c-6d9dbda23257 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:10.382672 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1346c715-7d62-4632-b7b2-3fb39382fdc8 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:10.384978 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372a9ba-adbe-4f5b-89c6-e0cce5987ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:10.385792 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372a9ba-adbe-4f5b-89c6-e0cce5987ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:10.386202 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372a9ba-adbe-4f5b-89c6-e0cce5987ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:10.386664 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372a9ba-adbe-4f5b-89c6-e0cce5987ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:10.387581 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372a9ba-adbe-4f5b-89c6-e0cce5987ff5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:10.388024 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372a9ba-adbe-4f5b-89c6-e0cce5987ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:10.389739 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372a9ba-adbe-4f5b-89c6-e0cce5987ff5 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:10.398879 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b7166-e0ee-4502-89fa-f1297ea73408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:10.399878 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b7166-e0ee-4502-89fa-f1297ea73408 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:10.400116 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 111/227] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Nov 29 20:08:10 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:10.400210 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b7166-e0ee-4502-89fa-f1297ea73408 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:10.400603 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b7166-e0ee-4502-89fa-f1297ea73408 admin admin] PATH_INFO: `/v3/projects/949a39418c3f4e5d83eee096bcff2c25/users/79917d2425d147f1920d9f4cba12bb75/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:10.401259 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372a9ba-adbe-4f5b-89c6-e0cce5987ff5 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:10.402990 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b7166-e0ee-4502-89fa-f1297ea73408 admin admin] RBAC: Authorizing `identity:create_grant(project_id=949a39418c3f4e5d83eee096bcff2c25, user_id=79917d2425d147f1920d9f4cba12bb75, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:10.406089 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b7166-e0ee-4502-89fa-f1297ea73408 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:10.410797 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372a9ba-adbe-4f5b-89c6-e0cce5987ff5 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:10.415647 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f8fc1-45e1-4900-b1ab-8eae4f3a8bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:10.416608 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f8fc1-45e1-4900-b1ab-8eae4f3a8bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:10.417021 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f8fc1-45e1-4900-b1ab-8eae4f3a8bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:10.417426 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f8fc1-45e1-4900-b1ab-8eae4f3a8bf1 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:10.422250 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 117/228] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Nov 29 20:08:10 2021] PUT /identity/v3/projects/949a39418c3f4e5d83eee096bcff2c25/users/79917d2425d147f1920d9f4cba12bb75/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:08:10.423655 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b7166-e0ee-4502-89fa-f1297ea73408 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:10.429301 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4f8fc1-45e1-4900-b1ab-8eae4f3a8bf1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:10.437000 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-ac4f8fc1-45e1-4900-b1ab-8eae4f3a8bf1 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 29 20:08:10.438836 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 112/229] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:08:10 2021] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:10.445479 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f8fc1-45e1-4900-b1ab-8eae4f3a8bf1 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:10.458531 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f8fc1-45e1-4900-b1ab-8eae4f3a8bf1 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:10.525920 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b7166-e0ee-4502-89fa-f1297ea73408 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:10.536910 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53074be-0040-4cfe-8340-2177ccf7a73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:10.538960 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53074be-0040-4cfe-8340-2177ccf7a73f admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:10.539240 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53074be-0040-4cfe-8340-2177ccf7a73f admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:10.539510 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53074be-0040-4cfe-8340-2177ccf7a73f admin admin] PATH_INFO: `/v3/users/79917d2425d147f1920d9f4cba12bb75` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:10.544309 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53074be-0040-4cfe-8340-2177ccf7a73f admin admin] RBAC: Authorizing `identity:get_user(user_id=79917d2425d147f1920d9f4cba12bb75)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:10.550243 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53074be-0040-4cfe-8340-2177ccf7a73f admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:10.555076 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 118/230] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:08:10 2021] GET /identity/v3/users/79917d2425d147f1920d9f4cba12bb75 => generated 283 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:10.558103 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53074be-0040-4cfe-8340-2177ccf7a73f admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:10.572675 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53074be-0040-4cfe-8340-2177ccf7a73f admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:10.576450 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bf3cb-6b81-49ea-829d-76631e4553bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:10.577139 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bf3cb-6b81-49ea-829d-76631e4553bd admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:10.577431 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bf3cb-6b81-49ea-829d-76631e4553bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:10.577737 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bf3cb-6b81-49ea-829d-76631e4553bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:10.578543 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bf3cb-6b81-49ea-829d-76631e4553bd admin admin] RBAC: Adding query filter params (name=member) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:10.578912 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bf3cb-6b81-49ea-829d-76631e4553bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:10.580316 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a372c84-413c-49ca-a2f9-a2715a8a1a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:10.580512 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bf3cb-6b81-49ea-829d-76631e4553bd admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:10.581559 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a372c84-413c-49ca-a2f9-a2715a8a1a9b admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:10.582064 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a372c84-413c-49ca-a2f9-a2715a8a1a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:10.582519 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a372c84-413c-49ca-a2f9-a2715a8a1a9b admin admin] PATH_INFO: `/v3/projects/949a39418c3f4e5d83eee096bcff2c25` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:10.584098 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a372c84-413c-49ca-a2f9-a2715a8a1a9b admin admin] RBAC: Authorizing `identity:get_project(project_id=949a39418c3f4e5d83eee096bcff2c25)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:10.586416 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a372c84-413c-49ca-a2f9-a2715a8a1a9b admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:10.588851 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 119/231] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:08:10 2021] GET /identity/v3/projects/949a39418c3f4e5d83eee096bcff2c25 => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:10.590532 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f502c-2905-4eed-b346-99238840c053 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:10.591087 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f502c-2905-4eed-b346-99238840c053 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:10.591554 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f502c-2905-4eed-b346-99238840c053 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:10.593830 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 113/232] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Nov 29 20:08:10 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:10.598985 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bf3cb-6b81-49ea-829d-76631e4553bd admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:10.599455 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 120/233] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:10 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:10.600467 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f502c-2905-4eed-b346-99238840c053 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:10.610177 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bf3cb-6b81-49ea-829d-76631e4553bd admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:10.613442 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f502c-2905-4eed-b346-99238840c053 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:10.615652 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a938f808-67ce-43a0-a74f-d4419a603833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:10.617147 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938f808-67ce-43a0-a74f-d4419a603833 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:10.617649 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938f808-67ce-43a0-a74f-d4419a603833 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:10.618128 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938f808-67ce-43a0-a74f-d4419a603833 admin admin] PATH_INFO: `/v3/projects/949a39418c3f4e5d83eee096bcff2c25/users/79917d2425d147f1920d9f4cba12bb75/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:10.618521 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385be3e-dba5-469a-9aaa-bc73220306da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:10.619702 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385be3e-dba5-469a-9aaa-bc73220306da admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:10.620065 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385be3e-dba5-469a-9aaa-bc73220306da admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:10.620431 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b385be3e-dba5-469a-9aaa-bc73220306da admin admin] PATH_INFO: `/v3/users/0c6d8d4b016d48e69a42cc0ca4a43bff` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:10.621769 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a938f808-67ce-43a0-a74f-d4419a603833 admin admin] RBAC: Authorizing `identity:create_grant(project_id=949a39418c3f4e5d83eee096bcff2c25, user_id=79917d2425d147f1920d9f4cba12bb75, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:10.624788 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a938f808-67ce-43a0-a74f-d4419a603833 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:10.637243 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b385be3e-dba5-469a-9aaa-bc73220306da admin admin] RBAC: Authorizing `identity:get_user(user_id=0c6d8d4b016d48e69a42cc0ca4a43bff)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:10.639759 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b385be3e-dba5-469a-9aaa-bc73220306da admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:10.640418 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 114/234] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Nov 29 20:08:10 2021] PUT /identity/v3/projects/949a39418c3f4e5d83eee096bcff2c25/users/79917d2425d147f1920d9f4cba12bb75/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:08:10.646518 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 121/235] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:08:10 2021] GET /identity/v3/users/0c6d8d4b016d48e69a42cc0ca4a43bff => generated 297 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:10.646731 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87894c-aeba-434d-ada3-eff8b5778fcd None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:10.646731 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87894c-aeba-434d-ada3-eff8b5778fcd None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:10.646731 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87894c-aeba-434d-ada3-eff8b5778fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:10.649408 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385be3e-dba5-469a-9aaa-bc73220306da admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:10.659636 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b385be3e-dba5-469a-9aaa-bc73220306da admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:10.669440 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-df87894c-aeba-434d-ada3-eff8b5778fcd None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:10.671200 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-df87894c-aeba-434d-ada3-eff8b5778fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:10.722709 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5499747-646f-4567-af84-028b63e9dd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:10.723404 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5499747-646f-4567-af84-028b63e9dd72 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:10.723681 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5499747-646f-4567-af84-028b63e9dd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:10.723966 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5499747-646f-4567-af84-028b63e9dd72 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:10.732880 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5499747-646f-4567-af84-028b63e9dd72 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:10.734725 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5499747-646f-4567-af84-028b63e9dd72 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:10.740352 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 115/236] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:10 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:10.750606 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 122/237] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:08:10 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:08:10.756766 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87894c-aeba-434d-ada3-eff8b5778fcd None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:10.768285 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87894c-aeba-434d-ada3-eff8b5778fcd None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:10.770840 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5499747-646f-4567-af84-028b63e9dd72 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:10.773802 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8131067-6a53-4992-8e37-97c9fd02a081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:10.774955 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8131067-6a53-4992-8e37-97c9fd02a081 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:10.775426 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8131067-6a53-4992-8e37-97c9fd02a081 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:10.775882 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8131067-6a53-4992-8e37-97c9fd02a081 admin admin] PATH_INFO: `/v3/projects/949a39418c3f4e5d83eee096bcff2c25` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:10.777351 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8131067-6a53-4992-8e37-97c9fd02a081 admin admin] RBAC: Authorizing `identity:get_project(project_id=949a39418c3f4e5d83eee096bcff2c25)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:10.779652 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8131067-6a53-4992-8e37-97c9fd02a081 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:10.781024 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5499747-646f-4567-af84-028b63e9dd72 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:10.786883 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 116/238] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:08:10 2021] GET /identity/v3/projects/949a39418c3f4e5d83eee096bcff2c25 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:10.789146 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8131067-6a53-4992-8e37-97c9fd02a081 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:10.796394 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215fb1bb-e329-4712-9712-209787fe300b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:10.797218 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fb1bb-e329-4712-9712-209787fe300b admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:10.797494 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fb1bb-e329-4712-9712-209787fe300b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:10.797762 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215fb1bb-e329-4712-9712-209787fe300b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:10.804080 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8131067-6a53-4992-8e37-97c9fd02a081 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:10.811992 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9118f-2ba0-4d97-891a-fbd95356671d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:10.811992 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9118f-2ba0-4d97-891a-fbd95356671d admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:10.811992 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9118f-2ba0-4d97-891a-fbd95356671d admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:10.811992 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9118f-2ba0-4d97-891a-fbd95356671d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:10.814252 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa9118f-2ba0-4d97-891a-fbd95356671d admin admin] RBAC: Adding query filter params (role.id=88a0e2c4c85c4449ad4681edcdc57835, scope.project.id=949a39418c3f4e5d83eee096bcff2c25, user.id=0c6d8d4b016d48e69a42cc0ca4a43bff) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:10.814252 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa9118f-2ba0-4d97-891a-fbd95356671d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:10.814252 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa9118f-2ba0-4d97-891a-fbd95356671d admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:10.822023 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 117/239] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:08:10 2021] GET /identity/v3/role_assignments?user.id=0c6d8d4b016d48e69a42cc0ca4a43bff&scope.project.id=949a39418c3f4e5d83eee096bcff2c25&role.id=88a0e2c4c85c4449ad4681edcdc57835 => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:10.822964 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215fb1bb-e329-4712-9712-209787fe300b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:10.844336 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-215fb1bb-e329-4712-9712-209787fe300b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 29 20:08:10.848927 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 123/240] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Nov 29 20:08:10 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:08:10.853107 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9118f-2ba0-4d97-891a-fbd95356671d admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:10.870915 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9118f-2ba0-4d97-891a-fbd95356671d admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:10.884732 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796a4d4-7dc2-4580-b467-d7716a3eddf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:10.885438 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796a4d4-7dc2-4580-b467-d7716a3eddf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:10.885716 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796a4d4-7dc2-4580-b467-d7716a3eddf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:10.885985 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796a4d4-7dc2-4580-b467-d7716a3eddf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:10.886870 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b796a4d4-7dc2-4580-b467-d7716a3eddf3 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:10.887202 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b796a4d4-7dc2-4580-b467-d7716a3eddf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:10.888856 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b796a4d4-7dc2-4580-b467-d7716a3eddf3 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:10.902236 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 118/241] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:08:10 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:10.908466 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215fb1bb-e329-4712-9712-209787fe300b admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:10.919384 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215fb1bb-e329-4712-9712-209787fe300b admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:10.926554 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff59c0-1b76-4318-8650-ca3b01e95818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:10.927866 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff59c0-1b76-4318-8650-ca3b01e95818 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:10.928337 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff59c0-1b76-4318-8650-ca3b01e95818 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:10.928849 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff59c0-1b76-4318-8650-ca3b01e95818 admin admin] PATH_INFO: `/v3/users/79917d2425d147f1920d9f4cba12bb75` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:10.931062 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff59c0-1b76-4318-8650-ca3b01e95818 admin admin] RBAC: Authorizing `identity:get_user(user_id=79917d2425d147f1920d9f4cba12bb75)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:10.933734 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff59c0-1b76-4318-8650-ca3b01e95818 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:10.936288 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 124/242] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:08:10 2021] GET /identity/v3/users/79917d2425d147f1920d9f4cba12bb75 => generated 283 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:10.941962 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796a4d4-7dc2-4580-b467-d7716a3eddf3 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:10.957922 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796a4d4-7dc2-4580-b467-d7716a3eddf3 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:10.963819 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73cfa1a-d602-4f4a-9e40-b1b314d2624f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:10.965075 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73cfa1a-d602-4f4a-9e40-b1b314d2624f admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:10.965547 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73cfa1a-d602-4f4a-9e40-b1b314d2624f admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:10.966024 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73cfa1a-d602-4f4a-9e40-b1b314d2624f admin admin] PATH_INFO: `/v3/projects/949a39418c3f4e5d83eee096bcff2c25` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:10.967608 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73cfa1a-d602-4f4a-9e40-b1b314d2624f admin admin] RBAC: Authorizing `identity:get_project(project_id=949a39418c3f4e5d83eee096bcff2c25)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:10.970035 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73cfa1a-d602-4f4a-9e40-b1b314d2624f admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:10.972038 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 119/243] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:08:10 2021] GET /identity/v3/projects/949a39418c3f4e5d83eee096bcff2c25 => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:10.977185 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facfb50-fc68-411b-878b-7062cca2f57d None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:10.977185 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facfb50-fc68-411b-878b-7062cca2f57d None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:10.977185 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3facfb50-fc68-411b-878b-7062cca2f57d None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:10.977185 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 125/244] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:10.979358 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73cfa1a-d602-4f4a-9e40-b1b314d2624f admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:10.983308 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cceef62-ef8c-44b7-8036-1edf88483bae None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:10.983593 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cceef62-ef8c-44b7-8036-1edf88483bae None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:10.983868 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cceef62-ef8c-44b7-8036-1edf88483bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:10.991255 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73cfa1a-d602-4f4a-9e40-b1b314d2624f admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:10.998661 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f9d64-d2a6-41f2-97bc-8f441e3dd683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:10.999700 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f9d64-d2a6-41f2-97bc-8f441e3dd683 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:11.002174 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f9d64-d2a6-41f2-97bc-8f441e3dd683 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:11.002480 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960f9d64-d2a6-41f2-97bc-8f441e3dd683 admin admin] PATH_INFO: `/v3/projects/949a39418c3f4e5d83eee096bcff2c25/users/79917d2425d147f1920d9f4cba12bb75/roles/d63eb17a7e7d455ea5f2c6696d92978c` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:11.014376 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960f9d64-d2a6-41f2-97bc-8f441e3dd683 admin admin] RBAC: Authorizing `identity:create_grant(project_id=949a39418c3f4e5d83eee096bcff2c25, user_id=79917d2425d147f1920d9f4cba12bb75, role_id=d63eb17a7e7d455ea5f2c6696d92978c)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:11.014376 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960f9d64-d2a6-41f2-97bc-8f441e3dd683 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:11.017252 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-3cceef62-ef8c-44b7-8036-1edf88483bae None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:11.018567 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-3cceef62-ef8c-44b7-8036-1edf88483bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:11.026336 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 120/245] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Nov 29 20:08:10 2021] PUT /identity/v3/projects/949a39418c3f4e5d83eee096bcff2c25/users/79917d2425d147f1920d9f4cba12bb75/roles/d63eb17a7e7d455ea5f2c6696d92978c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:08:11.115548 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 126/246] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:10 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 29 20:08:11.142130 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f9d64-d2a6-41f2-97bc-8f441e3dd683 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:11.153076 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960f9d64-d2a6-41f2-97bc-8f441e3dd683 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:11.157565 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd8ebb-0c0b-477c-baf4-ebd805c3633e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:11.158399 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd8ebb-0c0b-477c-baf4-ebd805c3633e admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:11.158674 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd8ebb-0c0b-477c-baf4-ebd805c3633e admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:11.158983 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd8ebb-0c0b-477c-baf4-ebd805c3633e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:11.160212 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd8ebb-0c0b-477c-baf4-ebd805c3633e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:11.161917 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd8ebb-0c0b-477c-baf4-ebd805c3633e admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:11.163623 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 121/247] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:11 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:11.169701 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cceef62-ef8c-44b7-8036-1edf88483bae None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:11.179721 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cceef62-ef8c-44b7-8036-1edf88483bae None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:11.184381 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d56f61-fd86-4b9e-bb55-2a58c3718f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:11.185069 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d56f61-fd86-4b9e-bb55-2a58c3718f96 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:11.185343 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d56f61-fd86-4b9e-bb55-2a58c3718f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:11.185611 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d56f61-fd86-4b9e-bb55-2a58c3718f96 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:11.186408 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d56f61-fd86-4b9e-bb55-2a58c3718f96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:11.188430 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d56f61-fd86-4b9e-bb55-2a58c3718f96 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:11.211732 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 127/248] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Nov 29 20:08:11 2021] POST /identity/v3/users => generated 297 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:08:13.100049 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2451987-f071-44a7-b92f-9148e6a0bf0f None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:13.100605 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2451987-f071-44a7-b92f-9148e6a0bf0f None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:13.100605 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2451987-f071-44a7-b92f-9148e6a0bf0f None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:13.102277 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 122/249] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:13.108418 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b5a73-31d1-4a1f-bd59-ee7462c6ce36 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:13.108920 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b5a73-31d1-4a1f-bd59-ee7462c6ce36 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:13.108995 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b5a73-31d1-4a1f-bd59-ee7462c6ce36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:13.143100 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-be2b5a73-31d1-4a1f-bd59-ee7462c6ce36 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:13.144294 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-be2b5a73-31d1-4a1f-bd59-ee7462c6ce36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:13.157415 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 128/250] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:13 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 29 20:08:13.196966 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2451987-f071-44a7-b92f-9148e6a0bf0f None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:13.215603 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2451987-f071-44a7-b92f-9148e6a0bf0f None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:13.220184 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1b49a-c1a9-46f3-a300-1731b312a23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:13.220980 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1b49a-c1a9-46f3-a300-1731b312a23a admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:13.221257 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1b49a-c1a9-46f3-a300-1731b312a23a admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:13.221525 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe1b49a-c1a9-46f3-a300-1731b312a23a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:13.237329 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe1b49a-c1a9-46f3-a300-1731b312a23a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:13.244429 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-7fe1b49a-c1a9-46f3-a300-1731b312a23a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 29 20:08:13.245961 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 123/251] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Nov 29 20:08:13 2021] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:13.252136 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b5a73-31d1-4a1f-bd59-ee7462c6ce36 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:13.261940 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b5a73-31d1-4a1f-bd59-ee7462c6ce36 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:13.271163 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc1281-dee8-44ac-84e6-684f2017f379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:13.271854 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc1281-dee8-44ac-84e6-684f2017f379 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:13.272131 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc1281-dee8-44ac-84e6-684f2017f379 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:13.272403 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc1281-dee8-44ac-84e6-684f2017f379 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:13.273182 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fc1281-dee8-44ac-84e6-684f2017f379 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:13.273486 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fc1281-dee8-44ac-84e6-684f2017f379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:13.275125 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fc1281-dee8-44ac-84e6-684f2017f379 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:13.286569 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 129/252] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:08:13 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:13.292156 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1b49a-c1a9-46f3-a300-1731b312a23a admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:13.302064 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe1b49a-c1a9-46f3-a300-1731b312a23a admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:13.310670 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24481387-775c-4f3c-8dbf-e7c469d11a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:13.311582 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24481387-775c-4f3c-8dbf-e7c469d11a4a admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:13.311859 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24481387-775c-4f3c-8dbf-e7c469d11a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:13.312131 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24481387-775c-4f3c-8dbf-e7c469d11a4a admin admin] PATH_INFO: `/v3/users/79917d2425d147f1920d9f4cba12bb75` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:13.313358 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24481387-775c-4f3c-8dbf-e7c469d11a4a admin admin] RBAC: Authorizing `identity:get_user(user_id=79917d2425d147f1920d9f4cba12bb75)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:13.315537 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24481387-775c-4f3c-8dbf-e7c469d11a4a admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:13.317359 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 124/253] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:08:13 2021] GET /identity/v3/users/79917d2425d147f1920d9f4cba12bb75 => generated 283 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:13.323154 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc1281-dee8-44ac-84e6-684f2017f379 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:13.335811 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc1281-dee8-44ac-84e6-684f2017f379 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:13.340371 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac30149-fa92-43b1-89d5-7ab6bc0f2d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:13.341022 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac30149-fa92-43b1-89d5-7ab6bc0f2d5b admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:13.341280 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac30149-fa92-43b1-89d5-7ab6bc0f2d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:13.341557 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac30149-fa92-43b1-89d5-7ab6bc0f2d5b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:13.358491 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac30149-fa92-43b1-89d5-7ab6bc0f2d5b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:13.358491 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac30149-fa92-43b1-89d5-7ab6bc0f2d5b admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:13.366912 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 130/254] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:08:13 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:08:13.373002 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24481387-775c-4f3c-8dbf-e7c469d11a4a admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:13.388285 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24481387-775c-4f3c-8dbf-e7c469d11a4a admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:13.392765 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c18b8f0-0dff-49b6-8f1c-add329f71368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:13.393624 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18b8f0-0dff-49b6-8f1c-add329f71368 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:13.393904 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18b8f0-0dff-49b6-8f1c-add329f71368 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:13.394176 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18b8f0-0dff-49b6-8f1c-add329f71368 admin admin] PATH_INFO: `/v3/projects/949a39418c3f4e5d83eee096bcff2c25` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:13.399584 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c18b8f0-0dff-49b6-8f1c-add329f71368 admin admin] RBAC: Authorizing `identity:get_project(project_id=949a39418c3f4e5d83eee096bcff2c25)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:13.401652 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c18b8f0-0dff-49b6-8f1c-add329f71368 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:13.403727 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 125/255] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:08:13 2021] GET /identity/v3/projects/949a39418c3f4e5d83eee096bcff2c25 => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:13.409637 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac30149-fa92-43b1-89d5-7ab6bc0f2d5b admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:13.423830 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac30149-fa92-43b1-89d5-7ab6bc0f2d5b admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:13.434478 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066f247-3bf0-430f-bcaa-451ddff8044f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:13.435418 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066f247-3bf0-430f-bcaa-451ddff8044f admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:13.435885 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066f247-3bf0-430f-bcaa-451ddff8044f admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:13.436370 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066f247-3bf0-430f-bcaa-451ddff8044f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:13.437414 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5066f247-3bf0-430f-bcaa-451ddff8044f admin admin] RBAC: Adding query filter params (role.id=33d95c7861b64f1a95af8a333bd626ea, scope.project.id=949a39418c3f4e5d83eee096bcff2c25, user.id=79917d2425d147f1920d9f4cba12bb75) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:13.437938 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5066f247-3bf0-430f-bcaa-451ddff8044f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:13.439992 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5066f247-3bf0-430f-bcaa-451ddff8044f admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:13.451945 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 131/256] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:08:13 2021] GET /identity/v3/role_assignments?user.id=79917d2425d147f1920d9f4cba12bb75&scope.project.id=949a39418c3f4e5d83eee096bcff2c25&role.id=33d95c7861b64f1a95af8a333bd626ea => generated 608 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:13.894346 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20482f8-6ee8-44d7-adbb-717484c0c078 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:13.894672 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20482f8-6ee8-44d7-adbb-717484c0c078 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:13.894918 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20482f8-6ee8-44d7-adbb-717484c0c078 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:13.896720 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 126/257] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:13.902902 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8e8d4-754d-428e-a847-bffa31daba0c None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:13.903454 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8e8d4-754d-428e-a847-bffa31daba0c None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:13.903911 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8e8d4-754d-428e-a847-bffa31daba0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:13.930887 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-19d8e8d4-754d-428e-a847-bffa31daba0c None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:13.932404 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-19d8e8d4-754d-428e-a847-bffa31daba0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:13.940574 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 132/258] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:13 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 29 20:08:13.984420 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20482f8-6ee8-44d7-adbb-717484c0c078 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:14.000736 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20482f8-6ee8-44d7-adbb-717484c0c078 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:14.005385 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed7eb4d-5ac3-4c5e-b23f-91ee9e1e68ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:14.006398 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7eb4d-5ac3-4c5e-b23f-91ee9e1e68ee admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:14.006893 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7eb4d-5ac3-4c5e-b23f-91ee9e1e68ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:14.007365 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed7eb4d-5ac3-4c5e-b23f-91ee9e1e68ee admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:14.020159 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed7eb4d-5ac3-4c5e-b23f-91ee9e1e68ee admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:14.027390 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-9ed7eb4d-5ac3-4c5e-b23f-91ee9e1e68ee admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 29 20:08:14.029872 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 127/259] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:08:13 2021] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:14.035201 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8e8d4-754d-428e-a847-bffa31daba0c None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:14.044552 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8e8d4-754d-428e-a847-bffa31daba0c None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:14.046284 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9a4e8-4a3b-4b42-a68e-9a7f0192b449 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:14.046926 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9a4e8-4a3b-4b42-a68e-9a7f0192b449 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:14.047389 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9a4e8-4a3b-4b42-a68e-9a7f0192b449 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:14.049693 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 128/260] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:14.054758 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8803b1-37fa-4d5b-af94-c3618bc38ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:14.055676 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ddf0a-5e2c-4657-a210-b45f3b35ff5e None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:14.055932 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8803b1-37fa-4d5b-af94-c3618bc38ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:14.056028 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ddf0a-5e2c-4657-a210-b45f3b35ff5e None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:14.056213 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ddf0a-5e2c-4657-a210-b45f3b35ff5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:14.056651 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8803b1-37fa-4d5b-af94-c3618bc38ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:14.057099 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8803b1-37fa-4d5b-af94-c3618bc38ac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:14.058161 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8803b1-37fa-4d5b-af94-c3618bc38ac9 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:14.058646 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8803b1-37fa-4d5b-af94-c3618bc38ac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:14.060526 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8803b1-37fa-4d5b-af94-c3618bc38ac9 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:14.081011 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 133/261] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Nov 29 20:08:14 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:14.085631 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-a16ddf0a-5e2c-4657-a210-b45f3b35ff5e None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:14.086664 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8803b1-37fa-4d5b-af94-c3618bc38ac9 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:14.092227 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-a16ddf0a-5e2c-4657-a210-b45f3b35ff5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:14.102433 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8803b1-37fa-4d5b-af94-c3618bc38ac9 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:14.108319 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 129/262] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:14 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:14.112825 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f42fe-1a19-4bfc-9908-7ae16a2e5664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:14.114242 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f42fe-1a19-4bfc-9908-7ae16a2e5664 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:14.114732 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f42fe-1a19-4bfc-9908-7ae16a2e5664 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:14.115209 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f42fe-1a19-4bfc-9908-7ae16a2e5664 admin admin] PATH_INFO: `/v3/users/79917d2425d147f1920d9f4cba12bb75` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:14.119080 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f42fe-1a19-4bfc-9908-7ae16a2e5664 admin admin] RBAC: Authorizing `identity:get_user(user_id=79917d2425d147f1920d9f4cba12bb75)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:14.120211 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d9c69-1771-4c90-b924-e5c4d6da54ca None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:14.120539 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d9c69-1771-4c90-b924-e5c4d6da54ca None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:14.120807 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d9c69-1771-4c90-b924-e5c4d6da54ca None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:14.122118 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f42fe-1a19-4bfc-9908-7ae16a2e5664 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:14.123739 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 130/263] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:14 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 29 20:08:14.124470 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 134/264] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:08:14 2021] GET /identity/v3/users/79917d2425d147f1920d9f4cba12bb75 => generated 283 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:14.130281 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d9c69-1771-4c90-b924-e5c4d6da54ca None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:14.134954 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef252b-6316-450c-8481-994c0e77e179 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:14.135243 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef252b-6316-450c-8481-994c0e77e179 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:14.135517 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef252b-6316-450c-8481-994c0e77e179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:14.150804 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d9c69-1771-4c90-b924-e5c4d6da54ca None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:14.156512 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f8fb4-5c90-429d-ad12-f4ef373105c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:14.157158 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f8fb4-5c90-429d-ad12-f4ef373105c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:14.157436 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f8fb4-5c90-429d-ad12-f4ef373105c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:14.157755 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f8fb4-5c90-429d-ad12-f4ef373105c6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:14.159744 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-c6ef252b-6316-450c-8481-994c0e77e179 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:14.160937 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-c6ef252b-6316-450c-8481-994c0e77e179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:14.167949 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f8fb4-5c90-429d-ad12-f4ef373105c6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:14.168887 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 135/265] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:14 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:14.169461 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef252b-6316-450c-8481-994c0e77e179 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:14.170081 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f8fb4-5c90-429d-ad12-f4ef373105c6 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:14.181341 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 131/266] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:08:14 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:08:14.187054 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef252b-6316-450c-8481-994c0e77e179 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:14.187235 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f8fb4-5c90-429d-ad12-f4ef373105c6 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:14.196768 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f8fb4-5c90-429d-ad12-f4ef373105c6 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:14.201731 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef6db8-1f9b-4387-aecc-ef5783124d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:14.202666 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef6db8-1f9b-4387-aecc-ef5783124d7e admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:14.203016 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef6db8-1f9b-4387-aecc-ef5783124d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:14.203284 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef6db8-1f9b-4387-aecc-ef5783124d7e admin admin] PATH_INFO: `/v3/projects/949a39418c3f4e5d83eee096bcff2c25` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:14.203525 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3265b7-a9ab-4a4f-aea0-6b5553a3bcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:14.204353 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3265b7-a9ab-4a4f-aea0-6b5553a3bcbc admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:14.204538 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef6db8-1f9b-4387-aecc-ef5783124d7e admin admin] RBAC: Authorizing `identity:get_project(project_id=949a39418c3f4e5d83eee096bcff2c25)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:14.204633 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3265b7-a9ab-4a4f-aea0-6b5553a3bcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:14.204900 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3265b7-a9ab-4a4f-aea0-6b5553a3bcbc admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:14.206763 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ef6db8-1f9b-4387-aecc-ef5783124d7e admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:14.208868 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 132/267] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:08:14 2021] GET /identity/v3/projects/949a39418c3f4e5d83eee096bcff2c25 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:14.214009 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef6db8-1f9b-4387-aecc-ef5783124d7e admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:14.218093 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3265b7-a9ab-4a4f-aea0-6b5553a3bcbc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:14.224856 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef6db8-1f9b-4387-aecc-ef5783124d7e admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:14.225492 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-3d3265b7-a9ab-4a4f-aea0-6b5553a3bcbc admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 29 20:08:14.226899 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 136/268] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Nov 29 20:08:14 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:14.227496 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3265b7-a9ab-4a4f-aea0-6b5553a3bcbc admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:14.233871 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e923969-a506-492e-bb18-a78083c29456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:14.234672 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e923969-a506-492e-bb18-a78083c29456 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:14.235010 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e923969-a506-492e-bb18-a78083c29456 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:14.235286 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e923969-a506-492e-bb18-a78083c29456 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:14.249015 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3265b7-a9ab-4a4f-aea0-6b5553a3bcbc admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:14.250903 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e923969-a506-492e-bb18-a78083c29456 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:14.257908 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-9e923969-a506-492e-bb18-a78083c29456 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 29 20:08:14.260127 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 133/269] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:08:14 2021] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:14.260649 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c46178-6b46-40d8-8881-45dd62614815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:14.260894 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e923969-a506-492e-bb18-a78083c29456 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:14.261420 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c46178-6b46-40d8-8881-45dd62614815 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:14.261691 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c46178-6b46-40d8-8881-45dd62614815 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:14.261995 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c46178-6b46-40d8-8881-45dd62614815 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:14.262874 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c46178-6b46-40d8-8881-45dd62614815 admin admin] RBAC: Adding query filter params (role.id=88a0e2c4c85c4449ad4681edcdc57835, scope.project.id=949a39418c3f4e5d83eee096bcff2c25, user.id=79917d2425d147f1920d9f4cba12bb75) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:14.263201 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c46178-6b46-40d8-8881-45dd62614815 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:14.265046 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c46178-6b46-40d8-8881-45dd62614815 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:14.276063 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e923969-a506-492e-bb18-a78083c29456 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:14.281215 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12632bb-4cd9-49ee-992f-d1db66198339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:14.281803 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 137/270] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:08:14 2021] GET /identity/v3/role_assignments?user.id=79917d2425d147f1920d9f4cba12bb75&scope.project.id=949a39418c3f4e5d83eee096bcff2c25&role.id=88a0e2c4c85c4449ad4681edcdc57835 => generated 608 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:14.281907 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12632bb-4cd9-49ee-992f-d1db66198339 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:14.282111 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12632bb-4cd9-49ee-992f-d1db66198339 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:14.282383 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12632bb-4cd9-49ee-992f-d1db66198339 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:14.283167 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12632bb-4cd9-49ee-992f-d1db66198339 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:14.283469 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12632bb-4cd9-49ee-992f-d1db66198339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:14.283715 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c46178-6b46-40d8-8881-45dd62614815 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:14.285039 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12632bb-4cd9-49ee-992f-d1db66198339 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:14.305083 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 134/271] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:08:14 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:14.305577 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c46178-6b46-40d8-8881-45dd62614815 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:14.311480 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12632bb-4cd9-49ee-992f-d1db66198339 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:14.316231 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae8fc1-ca0c-4eb8-b2f2-86fc61c61936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:14.317530 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae8fc1-ca0c-4eb8-b2f2-86fc61c61936 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:14.317800 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae8fc1-ca0c-4eb8-b2f2-86fc61c61936 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:14.318076 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ae8fc1-ca0c-4eb8-b2f2-86fc61c61936 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:14.319383 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae8fc1-ca0c-4eb8-b2f2-86fc61c61936 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:14.319688 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae8fc1-ca0c-4eb8-b2f2-86fc61c61936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:14.322526 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ae8fc1-ca0c-4eb8-b2f2-86fc61c61936 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:14.327314 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12632bb-4cd9-49ee-992f-d1db66198339 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:14.339401 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6555bf7-2896-436e-bded-aeee7a324694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:14.340355 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6555bf7-2896-436e-bded-aeee7a324694 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:14.340719 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6555bf7-2896-436e-bded-aeee7a324694 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:14.340997 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6555bf7-2896-436e-bded-aeee7a324694 admin admin] PATH_INFO: `/v3/users/79917d2425d147f1920d9f4cba12bb75` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:14.342601 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6555bf7-2896-436e-bded-aeee7a324694 admin admin] RBAC: Authorizing `identity:get_user(user_id=79917d2425d147f1920d9f4cba12bb75)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:14.343059 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 138/272] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Nov 29 20:08:14 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:14.345114 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6555bf7-2896-436e-bded-aeee7a324694 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:14.351343 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 135/273] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:08:14 2021] GET /identity/v3/users/79917d2425d147f1920d9f4cba12bb75 => generated 283 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:14.353675 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae8fc1-ca0c-4eb8-b2f2-86fc61c61936 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:14.359557 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6555bf7-2896-436e-bded-aeee7a324694 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:14.369793 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ae8fc1-ca0c-4eb8-b2f2-86fc61c61936 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:14.377886 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6555bf7-2896-436e-bded-aeee7a324694 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:14.381294 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4419ec26-fd91-40ee-9e4b-91aeb3dd8f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:14.382243 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4419ec26-fd91-40ee-9e4b-91aeb3dd8f2a admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:14.382527 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4419ec26-fd91-40ee-9e4b-91aeb3dd8f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:14.382801 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4419ec26-fd91-40ee-9e4b-91aeb3dd8f2a admin admin] PATH_INFO: `/v3/users/0c6d8d4b016d48e69a42cc0ca4a43bff` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:14.385612 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4419ec26-fd91-40ee-9e4b-91aeb3dd8f2a admin admin] RBAC: Authorizing `identity:get_user(user_id=0c6d8d4b016d48e69a42cc0ca4a43bff)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:14.389667 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f2828-666d-4a57-9aa0-18b3303118cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:14.390387 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f2828-666d-4a57-9aa0-18b3303118cf admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:14.390668 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f2828-666d-4a57-9aa0-18b3303118cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:14.390976 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f2828-666d-4a57-9aa0-18b3303118cf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:14.391922 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4419ec26-fd91-40ee-9e4b-91aeb3dd8f2a admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:14.400503 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 139/274] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:08:14 2021] GET /identity/v3/users/0c6d8d4b016d48e69a42cc0ca4a43bff => generated 297 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:14.405772 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4419ec26-fd91-40ee-9e4b-91aeb3dd8f2a admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:14.416417 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525f2828-666d-4a57-9aa0-18b3303118cf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:14.418565 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525f2828-666d-4a57-9aa0-18b3303118cf admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:14.422028 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4419ec26-fd91-40ee-9e4b-91aeb3dd8f2a admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:14.433682 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c02877-01a9-4241-96dc-7b6f4c60f6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:14.434600 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c02877-01a9-4241-96dc-7b6f4c60f6f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:14.434981 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c02877-01a9-4241-96dc-7b6f4c60f6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:14.435259 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c02877-01a9-4241-96dc-7b6f4c60f6f5 admin admin] PATH_INFO: `/v3/projects/949a39418c3f4e5d83eee096bcff2c25` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:14.436813 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c02877-01a9-4241-96dc-7b6f4c60f6f5 admin admin] RBAC: Authorizing `identity:get_project(project_id=949a39418c3f4e5d83eee096bcff2c25)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:14.439343 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 136/275] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:08:14 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:08:14.440263 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c02877-01a9-4241-96dc-7b6f4c60f6f5 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:14.442440 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 140/276] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:08:14 2021] GET /identity/v3/projects/949a39418c3f4e5d83eee096bcff2c25 => generated 302 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:14.448438 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f2828-666d-4a57-9aa0-18b3303118cf admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:14.453678 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c02877-01a9-4241-96dc-7b6f4c60f6f5 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:14.465936 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f2828-666d-4a57-9aa0-18b3303118cf admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:14.469226 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c02877-01a9-4241-96dc-7b6f4c60f6f5 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:14.475708 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a969f5ba-609c-4e37-8677-6fda99d50934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:14.476593 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969f5ba-609c-4e37-8677-6fda99d50934 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:14.476876 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969f5ba-609c-4e37-8677-6fda99d50934 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:14.477155 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969f5ba-609c-4e37-8677-6fda99d50934 admin admin] PATH_INFO: `/v3/projects/949a39418c3f4e5d83eee096bcff2c25` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:14.478910 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a969f5ba-609c-4e37-8677-6fda99d50934 admin admin] RBAC: Authorizing `identity:get_project(project_id=949a39418c3f4e5d83eee096bcff2c25)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:14.481630 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45d437-d115-4940-afdd-5c335e722b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:14.482519 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45d437-d115-4940-afdd-5c335e722b6e admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:14.482799 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45d437-d115-4940-afdd-5c335e722b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:14.483099 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45d437-d115-4940-afdd-5c335e722b6e admin admin] PATH_INFO: `/v3/projects/949a39418c3f4e5d83eee096bcff2c25/users/0c6d8d4b016d48e69a42cc0ca4a43bff/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:14.484198 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a969f5ba-609c-4e37-8677-6fda99d50934 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:14.486020 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 137/277] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:08:14 2021] GET /identity/v3/projects/949a39418c3f4e5d83eee096bcff2c25 => generated 302 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:14.487420 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45d437-d115-4940-afdd-5c335e722b6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=949a39418c3f4e5d83eee096bcff2c25, user_id=0c6d8d4b016d48e69a42cc0ca4a43bff, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:14.490135 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c45d437-d115-4940-afdd-5c335e722b6e admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:14.492452 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a969f5ba-609c-4e37-8677-6fda99d50934 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:14.503982 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a969f5ba-609c-4e37-8677-6fda99d50934 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:14.510584 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce53c63-06a2-4650-a912-232be6d16265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:14.511345 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce53c63-06a2-4650-a912-232be6d16265 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:14.511627 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce53c63-06a2-4650-a912-232be6d16265 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:14.511911 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce53c63-06a2-4650-a912-232be6d16265 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:14.516731 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce53c63-06a2-4650-a912-232be6d16265 admin admin] RBAC: Adding query filter params (role.id=d63eb17a7e7d455ea5f2c6696d92978c, scope.project.id=949a39418c3f4e5d83eee096bcff2c25, user.id=79917d2425d147f1920d9f4cba12bb75) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:14.520231 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 141/278] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Nov 29 20:08:14 2021] PUT /identity/v3/projects/949a39418c3f4e5d83eee096bcff2c25/users/0c6d8d4b016d48e69a42cc0ca4a43bff/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:08:14.520595 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce53c63-06a2-4650-a912-232be6d16265 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:14.522616 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce53c63-06a2-4650-a912-232be6d16265 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:14.529742 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 138/279] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:08:14 2021] GET /identity/v3/role_assignments?user.id=79917d2425d147f1920d9f4cba12bb75&scope.project.id=949a39418c3f4e5d83eee096bcff2c25&role.id=d63eb17a7e7d455ea5f2c6696d92978c => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:15.119761 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5a7da-e449-455d-ade2-1cc31cd43297 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:15.120440 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5a7da-e449-455d-ade2-1cc31cd43297 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:15.120440 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5a7da-e449-455d-ade2-1cc31cd43297 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:15.122115 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 142/280] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:15.127961 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74930f89-4e52-4456-8b02-42fab53014f7 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:15.128372 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74930f89-4e52-4456-8b02-42fab53014f7 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:15.128535 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74930f89-4e52-4456-8b02-42fab53014f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:15.147759 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-74930f89-4e52-4456-8b02-42fab53014f7 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:15.148928 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-74930f89-4e52-4456-8b02-42fab53014f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:15.206194 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 139/281] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:15 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:15.229680 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5a7da-e449-455d-ade2-1cc31cd43297 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:15.242204 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5a7da-e449-455d-ade2-1cc31cd43297 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:15.246708 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f612ca6-2ab1-47a3-9e9b-e414f48400de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:15.247513 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f612ca6-2ab1-47a3-9e9b-e414f48400de admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:15.247789 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f612ca6-2ab1-47a3-9e9b-e414f48400de admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:15.248057 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f612ca6-2ab1-47a3-9e9b-e414f48400de admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:15.258094 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f612ca6-2ab1-47a3-9e9b-e414f48400de admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:15.265367 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-3f612ca6-2ab1-47a3-9e9b-e414f48400de admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 29 20:08:15.266735 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 143/282] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:08:15 2021] GET /identity/v3/roles/reader => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:15.272642 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74930f89-4e52-4456-8b02-42fab53014f7 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:15.281610 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74930f89-4e52-4456-8b02-42fab53014f7 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:15.286072 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec462f-b361-4e64-af7a-c1527ee90f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:15.286723 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec462f-b361-4e64-af7a-c1527ee90f8a admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:15.287027 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec462f-b361-4e64-af7a-c1527ee90f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:15.287292 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec462f-b361-4e64-af7a-c1527ee90f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:15.288048 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cec462f-b361-4e64-af7a-c1527ee90f8a admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:15.288342 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cec462f-b361-4e64-af7a-c1527ee90f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:15.289935 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cec462f-b361-4e64-af7a-c1527ee90f8a admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:15.298888 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 140/283] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Nov 29 20:08:15 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:15.304587 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f612ca6-2ab1-47a3-9e9b-e414f48400de admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:15.314272 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca3249-c214-4cf4-a48b-ca96083d9604 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:15.314554 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca3249-c214-4cf4-a48b-ca96083d9604 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:15.314822 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca3249-c214-4cf4-a48b-ca96083d9604 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:15.315226 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f612ca6-2ab1-47a3-9e9b-e414f48400de admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:15.316932 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 141/284] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 29 20:08:15.319661 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea3baa-08e3-4dbe-927d-37f51ffe2306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:15.320590 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea3baa-08e3-4dbe-927d-37f51ffe2306 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:15.320880 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea3baa-08e3-4dbe-927d-37f51ffe2306 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:15.321176 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea3baa-08e3-4dbe-927d-37f51ffe2306 admin admin] PATH_INFO: `/v3/users/36b5af1ce5c642d28a6d5a08fe4cd645` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:15.322123 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cc0ae-2057-4245-a6d7-0b2706ae5701 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:15.322406 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cc0ae-2057-4245-a6d7-0b2706ae5701 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:15.322673 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232cc0ae-2057-4245-a6d7-0b2706ae5701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:15.334373 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea3baa-08e3-4dbe-927d-37f51ffe2306 admin admin] RBAC: Authorizing `identity:get_user(user_id=36b5af1ce5c642d28a6d5a08fe4cd645)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:15.336568 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea3baa-08e3-4dbe-927d-37f51ffe2306 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:15.338419 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 144/285] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:08:15 2021] GET /identity/v3/users/36b5af1ce5c642d28a6d5a08fe4cd645 => generated 297 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:15.339803 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-232cc0ae-2057-4245-a6d7-0b2706ae5701 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:15.341004 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-232cc0ae-2057-4245-a6d7-0b2706ae5701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:15.344110 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea3baa-08e3-4dbe-927d-37f51ffe2306 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:15.348343 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 142/286] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:15 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 29 20:08:15.353954 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea3baa-08e3-4dbe-927d-37f51ffe2306 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:15.358799 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25f2a2-ac7e-482c-8a89-75d6ab488ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:15.359488 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25f2a2-ac7e-482c-8a89-75d6ab488ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:15.359767 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25f2a2-ac7e-482c-8a89-75d6ab488ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:15.360041 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb25f2a2-ac7e-482c-8a89-75d6ab488ab5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:15.376929 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232cc0ae-2057-4245-a6d7-0b2706ae5701 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:15.377099 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb25f2a2-ac7e-482c-8a89-75d6ab488ab5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:15.378625 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb25f2a2-ac7e-482c-8a89-75d6ab488ab5 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:15.386388 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232cc0ae-2057-4245-a6d7-0b2706ae5701 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:15.388375 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 145/287] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:08:15 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 29 20:08:15.390683 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5faaa-374c-4432-ad29-f3684da22bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:15.391497 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5faaa-374c-4432-ad29-f3684da22bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:15.391774 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5faaa-374c-4432-ad29-f3684da22bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:15.392049 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5faaa-374c-4432-ad29-f3684da22bd5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:15.393255 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5faaa-374c-4432-ad29-f3684da22bd5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:15.394816 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25f2a2-ac7e-482c-8a89-75d6ab488ab5 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:15.395028 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c5faaa-374c-4432-ad29-f3684da22bd5 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:15.396701 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 143/288] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:15 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:15.402046 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5faaa-374c-4432-ad29-f3684da22bd5 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:15.403490 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb25f2a2-ac7e-482c-8a89-75d6ab488ab5 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:15.407640 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177756a-82a8-4106-9972-716efd9756a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:15.408468 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177756a-82a8-4106-9972-716efd9756a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:15.408742 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177756a-82a8-4106-9972-716efd9756a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:15.409022 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177756a-82a8-4106-9972-716efd9756a3 admin admin] PATH_INFO: `/v3/projects/949a39418c3f4e5d83eee096bcff2c25` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:15.410160 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177756a-82a8-4106-9972-716efd9756a3 admin admin] RBAC: Authorizing `identity:get_project(project_id=949a39418c3f4e5d83eee096bcff2c25)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:15.411482 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c5faaa-374c-4432-ad29-f3684da22bd5 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:15.412224 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177756a-82a8-4106-9972-716efd9756a3 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:15.413887 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 146/289] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:08:15 2021] GET /identity/v3/projects/949a39418c3f4e5d83eee096bcff2c25 => generated 302 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:15.417344 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b2804-28b2-43f0-9015-4916e94002fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:15.417990 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b2804-28b2-43f0-9015-4916e94002fe admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:15.418262 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b2804-28b2-43f0-9015-4916e94002fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:15.418595 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b2804-28b2-43f0-9015-4916e94002fe admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:15.419333 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b2804-28b2-43f0-9015-4916e94002fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:15.419961 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177756a-82a8-4106-9972-716efd9756a3 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:15.421198 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b2804-28b2-43f0-9015-4916e94002fe admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:15.429446 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177756a-82a8-4106-9972-716efd9756a3 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:15.434927 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d944f902-06d1-4de5-84ad-67c1bdfa6372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:15.435622 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944f902-06d1-4de5-84ad-67c1bdfa6372 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:15.435952 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944f902-06d1-4de5-84ad-67c1bdfa6372 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:15.436221 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d944f902-06d1-4de5-84ad-67c1bdfa6372 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:15.437269 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d944f902-06d1-4de5-84ad-67c1bdfa6372 admin admin] RBAC: Adding query filter params (role.id=26a400f146c54b26a90d5afef23446e8, scope.project.id=949a39418c3f4e5d83eee096bcff2c25, user.id=36b5af1ce5c642d28a6d5a08fe4cd645) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:15.437573 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d944f902-06d1-4de5-84ad-67c1bdfa6372 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:15.439448 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d944f902-06d1-4de5-84ad-67c1bdfa6372 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:15.442313 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 144/290] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Nov 29 20:08:15 2021] POST /identity/v3/users => generated 293 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 29 20:08:15.445519 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 147/291] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:08:15 2021] GET /identity/v3/role_assignments?user.id=36b5af1ce5c642d28a6d5a08fe4cd645&scope.project.id=949a39418c3f4e5d83eee096bcff2c25&role.id=26a400f146c54b26a90d5afef23446e8 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:16.923733 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf83ed-e9cc-4328-a201-45e779480c3b None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:16.924273 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf83ed-e9cc-4328-a201-45e779480c3b None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:16.924273 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf83ed-e9cc-4328-a201-45e779480c3b None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:16.926301 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 145/292] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:16.932245 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d93e0-2e98-490b-9bf7-22d051d2e5fe None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:16.932664 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d93e0-2e98-490b-9bf7-22d051d2e5fe None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:16.932782 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d93e0-2e98-490b-9bf7-22d051d2e5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:16.950525 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-f42d93e0-2e98-490b-9bf7-22d051d2e5fe None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:16.951758 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-f42d93e0-2e98-490b-9bf7-22d051d2e5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:16.959575 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 148/293] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:16 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:16.983123 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf83ed-e9cc-4328-a201-45e779480c3b None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:16.995138 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf83ed-e9cc-4328-a201-45e779480c3b None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:16.999419 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5df62-7d06-4ec8-bc25-ef95eb182e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:17.000205 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5df62-7d06-4ec8-bc25-ef95eb182e6d admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:17.000482 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5df62-7d06-4ec8-bc25-ef95eb182e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:17.000751 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5df62-7d06-4ec8-bc25-ef95eb182e6d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:17.011336 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5df62-7d06-4ec8-bc25-ef95eb182e6d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:17.018254 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-38a5df62-7d06-4ec8-bc25-ef95eb182e6d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 29 20:08:17.019470 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 146/294] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:08:16 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:17.025681 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d93e0-2e98-490b-9bf7-22d051d2e5fe None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:17.034749 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d93e0-2e98-490b-9bf7-22d051d2e5fe None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:17.039113 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229bc16-7419-4237-8b62-8026c4c688e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:17.039776 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229bc16-7419-4237-8b62-8026c4c688e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:17.040057 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229bc16-7419-4237-8b62-8026c4c688e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:17.040332 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229bc16-7419-4237-8b62-8026c4c688e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:17.041102 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9229bc16-7419-4237-8b62-8026c4c688e9 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:17.041407 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9229bc16-7419-4237-8b62-8026c4c688e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:17.043026 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9229bc16-7419-4237-8b62-8026c4c688e9 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:17.051220 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 149/295] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Nov 29 20:08:17 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:17.060863 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5df62-7d06-4ec8-bc25-ef95eb182e6d admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:17.071071 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5df62-7d06-4ec8-bc25-ef95eb182e6d admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:17.075464 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda5ec0-85ec-43d4-8bd5-20c89a3a9c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:17.076315 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda5ec0-85ec-43d4-8bd5-20c89a3a9c14 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:17.076595 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda5ec0-85ec-43d4-8bd5-20c89a3a9c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:17.076868 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda5ec0-85ec-43d4-8bd5-20c89a3a9c14 admin admin] PATH_INFO: `/v3/users/0c6d8d4b016d48e69a42cc0ca4a43bff` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:17.078066 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda5ec0-85ec-43d4-8bd5-20c89a3a9c14 admin admin] RBAC: Authorizing `identity:get_user(user_id=0c6d8d4b016d48e69a42cc0ca4a43bff)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:17.080304 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda5ec0-85ec-43d4-8bd5-20c89a3a9c14 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:17.082098 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 147/296] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:08:17 2021] GET /identity/v3/users/0c6d8d4b016d48e69a42cc0ca4a43bff => generated 297 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:17.087714 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229bc16-7419-4237-8b62-8026c4c688e9 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:17.097251 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9229bc16-7419-4237-8b62-8026c4c688e9 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:17.101583 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f60e9ef-832a-4753-9e4a-d4c511f631ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:17.102212 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60e9ef-832a-4753-9e4a-d4c511f631ac admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:17.102495 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60e9ef-832a-4753-9e4a-d4c511f631ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:17.102773 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f60e9ef-832a-4753-9e4a-d4c511f631ac admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:17.110402 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f60e9ef-832a-4753-9e4a-d4c511f631ac admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:17.112169 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f60e9ef-832a-4753-9e4a-d4c511f631ac admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:17.120742 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 150/297] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:08:17 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 29 20:08:17.126516 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda5ec0-85ec-43d4-8bd5-20c89a3a9c14 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:17.136359 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda5ec0-85ec-43d4-8bd5-20c89a3a9c14 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:17.141327 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aafbc5-0c10-4a10-84d8-46d2eb861168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:17.142164 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aafbc5-0c10-4a10-84d8-46d2eb861168 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:17.142445 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aafbc5-0c10-4a10-84d8-46d2eb861168 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:17.142721 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aafbc5-0c10-4a10-84d8-46d2eb861168 admin admin] PATH_INFO: `/v3/projects/949a39418c3f4e5d83eee096bcff2c25` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:17.143927 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aafbc5-0c10-4a10-84d8-46d2eb861168 admin admin] RBAC: Authorizing `identity:get_project(project_id=949a39418c3f4e5d83eee096bcff2c25)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:17.145959 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aafbc5-0c10-4a10-84d8-46d2eb861168 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:17.147892 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 148/298] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:08:17 2021] GET /identity/v3/projects/949a39418c3f4e5d83eee096bcff2c25 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:17.153753 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f60e9ef-832a-4753-9e4a-d4c511f631ac admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:17.162476 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f60e9ef-832a-4753-9e4a-d4c511f631ac admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:17.166875 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702f81b-dadf-4267-be05-4665c9333027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:17.167531 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702f81b-dadf-4267-be05-4665c9333027 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:17.167811 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702f81b-dadf-4267-be05-4665c9333027 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:17.168085 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702f81b-dadf-4267-be05-4665c9333027 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:17.168961 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8702f81b-dadf-4267-be05-4665c9333027 admin admin] RBAC: Adding query filter params (role.id=88a0e2c4c85c4449ad4681edcdc57835, scope.project.id=949a39418c3f4e5d83eee096bcff2c25, user.id=0c6d8d4b016d48e69a42cc0ca4a43bff) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:17.169275 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8702f81b-dadf-4267-be05-4665c9333027 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:17.171124 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8702f81b-dadf-4267-be05-4665c9333027 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:17.177233 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 151/299] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:08:17 2021] GET /identity/v3/role_assignments?user.id=0c6d8d4b016d48e69a42cc0ca4a43bff&scope.project.id=949a39418c3f4e5d83eee096bcff2c25&role.id=88a0e2c4c85c4449ad4681edcdc57835 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:17.789718 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca7b16-0527-485d-b13e-1ddd78428329 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:17.790125 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca7b16-0527-485d-b13e-1ddd78428329 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:17.790225 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fca7b16-0527-485d-b13e-1ddd78428329 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:17.792042 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 149/300] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:17.798132 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336ef23-ddc2-41e0-964b-2ef72b34984b None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:17.798383 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336ef23-ddc2-41e0-964b-2ef72b34984b None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:17.798689 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a336ef23-ddc2-41e0-964b-2ef72b34984b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:17.816914 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-a336ef23-ddc2-41e0-964b-2ef72b34984b None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:17.818085 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-a336ef23-ddc2-41e0-964b-2ef72b34984b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:17.827282 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 152/301] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:17 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:17.850238 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca7b16-0527-485d-b13e-1ddd78428329 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:17.862701 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fca7b16-0527-485d-b13e-1ddd78428329 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:17.867149 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346db3c-47e9-42c8-95be-d439c53df35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:17.867922 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346db3c-47e9-42c8-95be-d439c53df35c admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:17.868173 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346db3c-47e9-42c8-95be-d439c53df35c admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:17.868467 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346db3c-47e9-42c8-95be-d439c53df35c admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:17.878888 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e346db3c-47e9-42c8-95be-d439c53df35c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:17.885962 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-e346db3c-47e9-42c8-95be-d439c53df35c admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 29 20:08:17.887396 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 150/302] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:08:17 2021] GET /identity/v3/roles/reader => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:17.893392 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336ef23-ddc2-41e0-964b-2ef72b34984b None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:17.902320 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a336ef23-ddc2-41e0-964b-2ef72b34984b None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:17.907032 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39601577-91b6-4e94-b9a4-e789f3098ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:17.907688 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39601577-91b6-4e94-b9a4-e789f3098ecc admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:17.907962 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39601577-91b6-4e94-b9a4-e789f3098ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:17.908196 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39601577-91b6-4e94-b9a4-e789f3098ecc admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:17.908977 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39601577-91b6-4e94-b9a4-e789f3098ecc admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:17.909271 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39601577-91b6-4e94-b9a4-e789f3098ecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:17.910875 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39601577-91b6-4e94-b9a4-e789f3098ecc admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:17.919602 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 153/303] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Nov 29 20:08:17 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:17.925436 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346db3c-47e9-42c8-95be-d439c53df35c admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:17.935724 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346db3c-47e9-42c8-95be-d439c53df35c admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:17.940312 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded266c2-7ffa-418d-a3e2-67b9a7a61f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:17.941183 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded266c2-7ffa-418d-a3e2-67b9a7a61f7b admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:17.941468 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded266c2-7ffa-418d-a3e2-67b9a7a61f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:17.941744 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded266c2-7ffa-418d-a3e2-67b9a7a61f7b admin admin] PATH_INFO: `/v3/users/36b5af1ce5c642d28a6d5a08fe4cd645` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:17.943086 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded266c2-7ffa-418d-a3e2-67b9a7a61f7b admin admin] RBAC: Authorizing `identity:get_user(user_id=36b5af1ce5c642d28a6d5a08fe4cd645)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:17.945244 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded266c2-7ffa-418d-a3e2-67b9a7a61f7b admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:17.947023 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 151/304] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:08:17 2021] GET /identity/v3/users/36b5af1ce5c642d28a6d5a08fe4cd645 => generated 297 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:17.950223 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d5b3c-8ae3-4208-9045-6b94eda118d1 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:17.950730 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d5b3c-8ae3-4208-9045-6b94eda118d1 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:17.950815 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d5b3c-8ae3-4208-9045-6b94eda118d1 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:17.952795 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 154/305] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:17.953820 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded266c2-7ffa-418d-a3e2-67b9a7a61f7b admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:17.954759 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3cc9cd-0e32-45bd-95bb-ce8d75e5f6dc None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:17.955073 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3cc9cd-0e32-45bd-95bb-ce8d75e5f6dc None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:17.955347 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3cc9cd-0e32-45bd-95bb-ce8d75e5f6dc None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:17.956973 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 155/306] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 29 20:08:17.958003 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557c96e-cdce-4469-95e5-722a404ded8e None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:17.958282 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557c96e-cdce-4469-95e5-722a404ded8e None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:17.958553 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557c96e-cdce-4469-95e5-722a404ded8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:17.964732 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded266c2-7ffa-418d-a3e2-67b9a7a61f7b admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:17.969630 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24557d61-89ef-49b8-8b36-577c9cde61c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:17.970465 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24557d61-89ef-49b8-8b36-577c9cde61c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:17.970745 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24557d61-89ef-49b8-8b36-577c9cde61c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:17.971051 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24557d61-89ef-49b8-8b36-577c9cde61c6 admin admin] PATH_INFO: `/v3/projects/949a39418c3f4e5d83eee096bcff2c25` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:17.972314 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24557d61-89ef-49b8-8b36-577c9cde61c6 admin admin] RBAC: Authorizing `identity:get_project(project_id=949a39418c3f4e5d83eee096bcff2c25)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:17.974532 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24557d61-89ef-49b8-8b36-577c9cde61c6 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:17.976254 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 152/307] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:08:17 2021] GET /identity/v3/projects/949a39418c3f4e5d83eee096bcff2c25 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:17.977484 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad8cf8-834e-43d0-ad0b-37aa69a85f86 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:17.977771 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad8cf8-834e-43d0-ad0b-37aa69a85f86 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:17.978045 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad8cf8-834e-43d0-ad0b-37aa69a85f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:17.978955 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-9557c96e-cdce-4469-95e5-722a404ded8e None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:17.980119 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-9557c96e-cdce-4469-95e5-722a404ded8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:17.987793 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 156/308] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:17 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:17.988535 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557c96e-cdce-4469-95e5-722a404ded8e None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:17.996597 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-04ad8cf8-834e-43d0-ad0b-37aa69a85f86 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:17.997443 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557c96e-cdce-4469-95e5-722a404ded8e None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:17.997836 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-04ad8cf8-834e-43d0-ad0b-37aa69a85f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:18.001767 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2cd22f-269f-4f2b-9299-690d6cd40747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:18.002719 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2cd22f-269f-4f2b-9299-690d6cd40747 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:18.003035 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2cd22f-269f-4f2b-9299-690d6cd40747 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:18.003353 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2cd22f-269f-4f2b-9299-690d6cd40747 admin admin] PATH_INFO: `/v3/projects/949a39418c3f4e5d83eee096bcff2c25/users/36b5af1ce5c642d28a6d5a08fe4cd645/roles/26a400f146c54b26a90d5afef23446e8` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:18.005324 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 153/309] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:17 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:18.005422 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2cd22f-269f-4f2b-9299-690d6cd40747 admin admin] RBAC: Authorizing `identity:create_grant(project_id=949a39418c3f4e5d83eee096bcff2c25, user_id=36b5af1ce5c642d28a6d5a08fe4cd645, role_id=26a400f146c54b26a90d5afef23446e8)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:18.008174 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2cd22f-269f-4f2b-9299-690d6cd40747 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:18.014816 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad8cf8-834e-43d0-ad0b-37aa69a85f86 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:18.024567 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad8cf8-834e-43d0-ad0b-37aa69a85f86 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:18.024756 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 157/310] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Nov 29 20:08:17 2021] PUT /identity/v3/projects/949a39418c3f4e5d83eee096bcff2c25/users/36b5af1ce5c642d28a6d5a08fe4cd645/roles/26a400f146c54b26a90d5afef23446e8 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:08:18.031631 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2cd22f-269f-4f2b-9299-690d6cd40747 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:18.086362 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c4d40-f953-489b-b36f-762596da2ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:18.087327 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c4d40-f953-489b-b36f-762596da2ffb admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:18.087607 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c4d40-f953-489b-b36f-762596da2ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:18.087892 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c4d40-f953-489b-b36f-762596da2ffb admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:18.089197 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c4d40-f953-489b-b36f-762596da2ffb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:18.091165 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c4d40-f953-489b-b36f-762596da2ffb admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:18.092961 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 154/311] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:18 2021] GET /identity/v3/domains/default => generated 199 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:18.098897 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2cd22f-269f-4f2b-9299-690d6cd40747 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:18.099069 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c4d40-f953-489b-b36f-762596da2ffb admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:18.103733 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96f8a0-0a76-4ca2-9649-69fb8d3f905c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:18.104791 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96f8a0-0a76-4ca2-9649-69fb8d3f905c admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:18.105244 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96f8a0-0a76-4ca2-9649-69fb8d3f905c admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:18.105520 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96f8a0-0a76-4ca2-9649-69fb8d3f905c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:18.109184 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c4d40-f953-489b-b36f-762596da2ffb admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:18.113635 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71389187-5bf9-4204-ae14-fa1e630b93a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:18.114313 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71389187-5bf9-4204-ae14-fa1e630b93a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:18.114596 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71389187-5bf9-4204-ae14-fa1e630b93a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:18.114888 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71389187-5bf9-4204-ae14-fa1e630b93a7 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:18.115614 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71389187-5bf9-4204-ae14-fa1e630b93a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:18.117356 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b96f8a0-0a76-4ca2-9649-69fb8d3f905c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:18.117550 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71389187-5bf9-4204-ae14-fa1e630b93a7 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:18.124939 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-3b96f8a0-0a76-4ca2-9649-69fb8d3f905c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 29 20:08:18.126595 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 158/312] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:08:18 2021] GET /identity/v3/roles/member => generated 84 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:08:18.132662 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96f8a0-0a76-4ca2-9649-69fb8d3f905c admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:18.142696 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 155/313] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Nov 29 20:08:18 2021] POST /identity/v3/users => generated 293 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 29 20:08:18.150960 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96f8a0-0a76-4ca2-9649-69fb8d3f905c admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:18.156004 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d40af6-aac1-4f43-95d3-e3033e8e3de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:18.156708 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d40af6-aac1-4f43-95d3-e3033e8e3de1 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:18.156992 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d40af6-aac1-4f43-95d3-e3033e8e3de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:18.157264 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d40af6-aac1-4f43-95d3-e3033e8e3de1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:18.158075 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d40af6-aac1-4f43-95d3-e3033e8e3de1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:18.158383 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d40af6-aac1-4f43-95d3-e3033e8e3de1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:18.160161 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d40af6-aac1-4f43-95d3-e3033e8e3de1 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:18.171507 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 159/314] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Nov 29 20:08:18 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:18.177741 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71389187-5bf9-4204-ae14-fa1e630b93a7 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:18.188197 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71389187-5bf9-4204-ae14-fa1e630b93a7 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:18.192875 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e709a-bce8-498b-85af-1f7f547903a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:18.193779 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e709a-bce8-498b-85af-1f7f547903a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:18.194091 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e709a-bce8-498b-85af-1f7f547903a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:18.194330 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e709a-bce8-498b-85af-1f7f547903a4 admin admin] PATH_INFO: `/v3/users/a09841be54494b84b72a9799494f16ee` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:18.210748 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e709a-bce8-498b-85af-1f7f547903a4 admin admin] RBAC: Authorizing `identity:get_user(user_id=a09841be54494b84b72a9799494f16ee)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:18.213174 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e709a-bce8-498b-85af-1f7f547903a4 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:18.215413 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 156/315] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:08:18 2021] GET /identity/v3/users/a09841be54494b84b72a9799494f16ee => generated 293 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:18.221774 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d40af6-aac1-4f43-95d3-e3033e8e3de1 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:18.232717 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d40af6-aac1-4f43-95d3-e3033e8e3de1 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:18.237588 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e4d22-b5ab-4870-ba20-f3251b66a8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:18.238265 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e4d22-b5ab-4870-ba20-f3251b66a8eb admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:18.238546 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e4d22-b5ab-4870-ba20-f3251b66a8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:18.238817 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e4d22-b5ab-4870-ba20-f3251b66a8eb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:18.239727 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e4d22-b5ab-4870-ba20-f3251b66a8eb admin admin] RBAC: Adding query filter params (role.id=88a0e2c4c85c4449ad4681edcdc57835, user.id=a09841be54494b84b72a9799494f16ee, scope.system=all) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:18.240037 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e4d22-b5ab-4870-ba20-f3251b66a8eb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:18.241955 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e4d22-b5ab-4870-ba20-f3251b66a8eb admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:18.250944 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 160/316] 10.222.0.15 () {56 vars in 1329 bytes} [Mon Nov 29 20:08:18 2021] GET /identity/v3/role_assignments?user.id=a09841be54494b84b72a9799494f16ee&scope.system=all&role.id=88a0e2c4c85c4449ad4681edcdc57835 => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:20.432696 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13f2ba-707a-4cf7-bed0-9692166392f1 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:20.433234 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13f2ba-707a-4cf7-bed0-9692166392f1 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:20.433234 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13f2ba-707a-4cf7-bed0-9692166392f1 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:20.435355 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 157/317] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:20.441199 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9d16d-a1fd-4699-8a9f-9273341efe21 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:20.441947 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9d16d-a1fd-4699-8a9f-9273341efe21 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:20.442367 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9d16d-a1fd-4699-8a9f-9273341efe21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:20.461406 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-f0b9d16d-a1fd-4699-8a9f-9273341efe21 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:20.462822 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-f0b9d16d-a1fd-4699-8a9f-9273341efe21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:20.474957 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 161/318] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 29 20:08:20.495232 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13f2ba-707a-4cf7-bed0-9692166392f1 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:20.507959 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da13f2ba-707a-4cf7-bed0-9692166392f1 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:20.513772 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1f244-e073-44ae-8b88-71a086f30563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:20.515484 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1f244-e073-44ae-8b88-71a086f30563 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:20.515990 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1f244-e073-44ae-8b88-71a086f30563 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:20.516430 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1f244-e073-44ae-8b88-71a086f30563 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:20.527794 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a1f244-e073-44ae-8b88-71a086f30563 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:20.534953 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-c4a1f244-e073-44ae-8b88-71a086f30563 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 29 20:08:20.536471 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 158/319] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:08:20 2021] GET /identity/v3/roles/reader => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:20.542517 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9d16d-a1fd-4699-8a9f-9273341efe21 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:20.551616 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9d16d-a1fd-4699-8a9f-9273341efe21 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:20.556051 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c4e921-a96a-4292-baca-ed9c2c16c1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:20.556713 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4e921-a96a-4292-baca-ed9c2c16c1a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:20.556993 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4e921-a96a-4292-baca-ed9c2c16c1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:20.557268 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c4e921-a96a-4292-baca-ed9c2c16c1a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:20.558034 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c4e921-a96a-4292-baca-ed9c2c16c1a4 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:20.558339 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c4e921-a96a-4292-baca-ed9c2c16c1a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:20.560017 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c4e921-a96a-4292-baca-ed9c2c16c1a4 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:20.568828 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 162/320] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Nov 29 20:08:20 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:20.574733 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1f244-e073-44ae-8b88-71a086f30563 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:20.584657 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1f244-e073-44ae-8b88-71a086f30563 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:20.589084 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40be0399-e741-41bf-809b-6a49d4adfd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:20.589950 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be0399-e741-41bf-809b-6a49d4adfd36 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:20.590230 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be0399-e741-41bf-809b-6a49d4adfd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:20.590503 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40be0399-e741-41bf-809b-6a49d4adfd36 admin admin] PATH_INFO: `/v3/users/36b5af1ce5c642d28a6d5a08fe4cd645` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:20.591798 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be0399-e741-41bf-809b-6a49d4adfd36 admin admin] RBAC: Authorizing `identity:get_user(user_id=36b5af1ce5c642d28a6d5a08fe4cd645)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:20.593949 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40be0399-e741-41bf-809b-6a49d4adfd36 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:20.595634 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 159/321] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:08:20 2021] GET /identity/v3/users/36b5af1ce5c642d28a6d5a08fe4cd645 => generated 297 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:20.601642 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c4e921-a96a-4292-baca-ed9c2c16c1a4 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:20.608919 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd56188-0381-4c0b-b6ba-b8826f9f02d9 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:20.609203 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd56188-0381-4c0b-b6ba-b8826f9f02d9 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:20.609475 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd56188-0381-4c0b-b6ba-b8826f9f02d9 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:20.611399 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 160/322] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:20 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:20.611591 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c4e921-a96a-4292-baca-ed9c2c16c1a4 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:20.612392 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdbf6a-d3cc-4beb-9186-8869825caf2f None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:20.612616 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdbf6a-d3cc-4beb-9186-8869825caf2f None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:20.612891 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cdbf6a-d3cc-4beb-9186-8869825caf2f None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:20.614566 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 161/323] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:20.618687 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927ccbf-c3d4-4f3f-a3e5-af2629524db4 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:20.619005 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927ccbf-c3d4-4f3f-a3e5-af2629524db4 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:20.619283 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927ccbf-c3d4-4f3f-a3e5-af2629524db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:20.619374 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4872cdb-fcee-4bf7-986d-c13055a6fd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:20.619938 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4872cdb-fcee-4bf7-986d-c13055a6fd2d admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:20.620215 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4872cdb-fcee-4bf7-986d-c13055a6fd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:20.620481 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4872cdb-fcee-4bf7-986d-c13055a6fd2d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:20.628436 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4872cdb-fcee-4bf7-986d-c13055a6fd2d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:20.630157 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4872cdb-fcee-4bf7-986d-c13055a6fd2d admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:20.636920 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-b927ccbf-c3d4-4f3f-a3e5-af2629524db4 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:20.638162 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-b927ccbf-c3d4-4f3f-a3e5-af2629524db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:20.638989 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 163/324] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:08:20 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:08:20.640191 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906ec45-81fc-47c1-897f-f992075197af None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:20.640468 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906ec45-81fc-47c1-897f-f992075197af None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:20.640738 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906ec45-81fc-47c1-897f-f992075197af None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:20.642370 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 164/325] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:20.643423 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3350c3-12da-4a5e-be9f-b8d9bdaf246c None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:20.643718 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3350c3-12da-4a5e-be9f-b8d9bdaf246c None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:20.643968 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3350c3-12da-4a5e-be9f-b8d9bdaf246c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:20.650445 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 162/326] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:20.655734 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927ccbf-c3d4-4f3f-a3e5-af2629524db4 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:20.660775 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-fb3350c3-12da-4a5e-be9f-b8d9bdaf246c None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:20.661921 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-fb3350c3-12da-4a5e-be9f-b8d9bdaf246c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:20.665032 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927ccbf-c3d4-4f3f-a3e5-af2629524db4 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:20.670073 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 165/327] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:20.670192 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d84ff8e-c567-41a8-bd17-a475d498c12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:20.670776 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84ff8e-c567-41a8-bd17-a475d498c12b admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:20.671145 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84ff8e-c567-41a8-bd17-a475d498c12b admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:20.671420 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84ff8e-c567-41a8-bd17-a475d498c12b admin admin] PATH_INFO: `/v3/projects/949a39418c3f4e5d83eee096bcff2c25` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:20.672576 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d84ff8e-c567-41a8-bd17-a475d498c12b admin admin] RBAC: Authorizing `identity:get_project(project_id=949a39418c3f4e5d83eee096bcff2c25)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:20.674622 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d84ff8e-c567-41a8-bd17-a475d498c12b admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:20.676023 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011dd714-4001-4520-9973-a1b33d0f61a2 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:20.676311 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011dd714-4001-4520-9973-a1b33d0f61a2 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:20.676530 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 163/328] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:08:20 2021] GET /identity/v3/projects/949a39418c3f4e5d83eee096bcff2c25 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:20.676627 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011dd714-4001-4520-9973-a1b33d0f61a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:20.677267 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d84ff8e-c567-41a8-bd17-a475d498c12b admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:20.686562 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d84ff8e-c567-41a8-bd17-a475d498c12b admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:20.691303 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e4d2b-e45d-4e30-a3fa-31424280bfa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:20.692337 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e4d2b-e45d-4e30-a3fa-31424280bfa5 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:20.692619 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e4d2b-e45d-4e30-a3fa-31424280bfa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:20.692891 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e4d2b-e45d-4e30-a3fa-31424280bfa5 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:20.694530 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-011dd714-4001-4520-9973-a1b33d0f61a2 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:20.695766 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-011dd714-4001-4520-9973-a1b33d0f61a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:20.703189 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9e4d2b-e45d-4e30-a3fa-31424280bfa5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:20.703860 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 166/329] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:20 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:20.705738 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011dd714-4001-4520-9973-a1b33d0f61a2 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:20.710031 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-1c9e4d2b-e45d-4e30-a3fa-31424280bfa5 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 29 20:08:20.711717 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 164/330] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:08:20 2021] GET /identity/v3/roles/member => generated 84 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:20.711969 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e4d2b-e45d-4e30-a3fa-31424280bfa5 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:20.714926 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011dd714-4001-4520-9973-a1b33d0f61a2 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:20.722123 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e4d2b-e45d-4e30-a3fa-31424280bfa5 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:20.725177 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ef301-bd9c-4520-8f09-c076c5dc6c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:20.726169 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ef301-bd9c-4520-8f09-c076c5dc6c20 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:20.726497 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ef301-bd9c-4520-8f09-c076c5dc6c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:20.726598 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134f215-f16e-4b12-9f87-b663a71f7820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:20.726770 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ef301-bd9c-4520-8f09-c076c5dc6c20 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:20.727443 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134f215-f16e-4b12-9f87-b663a71f7820 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:20.727682 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ef301-bd9c-4520-8f09-c076c5dc6c20 admin admin] RBAC: Adding query filter params (role.id=26a400f146c54b26a90d5afef23446e8, scope.project.id=949a39418c3f4e5d83eee096bcff2c25, user.id=36b5af1ce5c642d28a6d5a08fe4cd645) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:20.727777 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134f215-f16e-4b12-9f87-b663a71f7820 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:20.727984 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134f215-f16e-4b12-9f87-b663a71f7820 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:20.728076 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ef301-bd9c-4520-8f09-c076c5dc6c20 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:20.729147 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6134f215-f16e-4b12-9f87-b663a71f7820 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:20.729809 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ef301-bd9c-4520-8f09-c076c5dc6c20 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:20.730879 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6134f215-f16e-4b12-9f87-b663a71f7820 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:20.732556 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 165/331] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:20 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:20.733381 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134f215-f16e-4b12-9f87-b663a71f7820 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:20.736475 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 167/332] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:08:20 2021] GET /identity/v3/role_assignments?user.id=36b5af1ce5c642d28a6d5a08fe4cd645&scope.project.id=949a39418c3f4e5d83eee096bcff2c25&role.id=26a400f146c54b26a90d5afef23446e8 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:20.737434 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ef301-bd9c-4520-8f09-c076c5dc6c20 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:20.743127 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134f215-f16e-4b12-9f87-b663a71f7820 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:20.747348 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ef301-bd9c-4520-8f09-c076c5dc6c20 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:20.747705 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84e315-4f6b-445d-931a-289164355129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:20.748418 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84e315-4f6b-445d-931a-289164355129 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:20.748776 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84e315-4f6b-445d-931a-289164355129 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:20.748969 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84e315-4f6b-445d-931a-289164355129 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:20.749739 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84e315-4f6b-445d-931a-289164355129 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:20.750101 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84e315-4f6b-445d-931a-289164355129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:20.751711 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84e315-4f6b-445d-931a-289164355129 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:20.751922 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603bbec-12e6-49ee-89e0-b259382d4e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:20.752705 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603bbec-12e6-49ee-89e0-b259382d4e29 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:20.752978 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603bbec-12e6-49ee-89e0-b259382d4e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:20.753252 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603bbec-12e6-49ee-89e0-b259382d4e29 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:20.762714 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 166/333] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Nov 29 20:08:20 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:20.763970 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84e315-4f6b-445d-931a-289164355129 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:20.765130 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603bbec-12e6-49ee-89e0-b259382d4e29 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:20.772241 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-f603bbec-12e6-49ee-89e0-b259382d4e29 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 29 20:08:20.773494 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 168/334] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:08:20 2021] GET /identity/v3/roles/reader => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:20.774266 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603bbec-12e6-49ee-89e0-b259382d4e29 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:20.783534 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84e315-4f6b-445d-931a-289164355129 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:20.784207 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603bbec-12e6-49ee-89e0-b259382d4e29 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:20.788151 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f51270e-b831-4d28-9020-42e52e1628c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:20.788830 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51270e-b831-4d28-9020-42e52e1628c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:20.789020 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6da81a-5ba0-400e-883b-9649c48afe77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:20.789125 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51270e-b831-4d28-9020-42e52e1628c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:20.789375 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51270e-b831-4d28-9020-42e52e1628c7 admin admin] PATH_INFO: `/v3/groups` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:20.789837 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6da81a-5ba0-400e-883b-9649c48afe77 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:20.790081 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f51270e-b831-4d28-9020-42e52e1628c7 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:20.790183 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6da81a-5ba0-400e-883b-9649c48afe77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:20.790375 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6da81a-5ba0-400e-883b-9649c48afe77 admin admin] PATH_INFO: `/v3/users/a09841be54494b84b72a9799494f16ee` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:20.791204 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING py.warnings [None req-6f51270e-b831-4d28-9020-42e52e1628c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 29 20:08:20.791204 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: warnings.warn(msg) Nov 29 20:08:20.791204 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: Nov 29 20:08:20.791721 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6da81a-5ba0-400e-883b-9649c48afe77 admin admin] RBAC: Authorizing `identity:get_user(user_id=a09841be54494b84b72a9799494f16ee)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:20.792399 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f51270e-b831-4d28-9020-42e52e1628c7 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:20.793969 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6da81a-5ba0-400e-883b-9649c48afe77 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:20.795694 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 169/335] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:08:20 2021] GET /identity/v3/users/a09841be54494b84b72a9799494f16ee => generated 293 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:20.796463 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6da81a-5ba0-400e-883b-9649c48afe77 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:20.806999 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6da81a-5ba0-400e-883b-9649c48afe77 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:20.812070 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 167/336] 10.222.0.15 () {60 vars in 1155 bytes} [Mon Nov 29 20:08:20 2021] POST /identity/v3/groups => generated 229 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:08:20.812070 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f51270e-b831-4d28-9020-42e52e1628c7 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:20.824043 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f51270e-b831-4d28-9020-42e52e1628c7 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:20.829353 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6ef15-d656-43f9-809d-ad88c504673d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:20.831222 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6ef15-d656-43f9-809d-ad88c504673d admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:20.831614 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6ef15-d656-43f9-809d-ad88c504673d admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:20.831961 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6ef15-d656-43f9-809d-ad88c504673d admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:20.832841 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6ef15-d656-43f9-809d-ad88c504673d admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:20.833263 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6ef15-d656-43f9-809d-ad88c504673d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:20.835039 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6ef15-d656-43f9-809d-ad88c504673d admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:20.845622 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961af65-2c8b-4fcb-9f74-2633f389fecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:20.846728 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 170/337] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Nov 29 20:08:20 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:20.847070 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961af65-2c8b-4fcb-9f74-2633f389fecd admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:20.847418 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961af65-2c8b-4fcb-9f74-2633f389fecd admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:20.847647 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961af65-2c8b-4fcb-9f74-2633f389fecd admin admin] PATH_INFO: `/v3/system/users/a09841be54494b84b72a9799494f16ee/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:20.849276 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3961af65-2c8b-4fcb-9f74-2633f389fecd admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a09841be54494b84b72a9799494f16ee, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:20.850305 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING py.warnings [None req-3961af65-2c8b-4fcb-9f74-2633f389fecd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_system_grant_for_user failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 29 20:08:20.850305 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: warnings.warn(msg) Nov 29 20:08:20.850305 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: Nov 29 20:08:20.854921 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3961af65-2c8b-4fcb-9f74-2633f389fecd admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:20.855122 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6ef15-d656-43f9-809d-ad88c504673d admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:20.866268 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6ef15-d656-43f9-809d-ad88c504673d admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:20.870948 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 168/338] 10.222.0.15 () {58 vars in 1355 bytes} [Mon Nov 29 20:08:20 2021] PUT /identity/v3/system/users/a09841be54494b84b72a9799494f16ee/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:08:20.879802 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5840f91-16f8-4651-afb3-ea0d2f17e2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:20.881175 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5840f91-16f8-4651-afb3-ea0d2f17e2e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:20.881688 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5840f91-16f8-4651-afb3-ea0d2f17e2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:20.882141 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5840f91-16f8-4651-afb3-ea0d2f17e2e1 admin admin] PATH_INFO: `/v3/users/3783ea349d1b48d6ba2adcac6deea344` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:20.902271 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5840f91-16f8-4651-afb3-ea0d2f17e2e1 admin admin] RBAC: Authorizing `identity:get_user(user_id=3783ea349d1b48d6ba2adcac6deea344)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:20.905055 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5840f91-16f8-4651-afb3-ea0d2f17e2e1 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:20.907361 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 171/339] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:08:20 2021] GET /identity/v3/users/3783ea349d1b48d6ba2adcac6deea344 => generated 293 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:20.914463 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961af65-2c8b-4fcb-9f74-2633f389fecd admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:20.928827 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961af65-2c8b-4fcb-9f74-2633f389fecd admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:20.934108 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6675fed-5a22-4075-a020-0958530db6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:20.935191 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6675fed-5a22-4075-a020-0958530db6c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:20.935649 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6675fed-5a22-4075-a020-0958530db6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:20.936083 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6675fed-5a22-4075-a020-0958530db6c5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:20.937219 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6675fed-5a22-4075-a020-0958530db6c5 admin admin] RBAC: Adding query filter params (role.id=26a400f146c54b26a90d5afef23446e8, user.id=3783ea349d1b48d6ba2adcac6deea344, scope.system=all) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:20.937773 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6675fed-5a22-4075-a020-0958530db6c5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:20.940015 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6675fed-5a22-4075-a020-0958530db6c5 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:20.955047 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 169/340] 10.222.0.15 () {56 vars in 1329 bytes} [Mon Nov 29 20:08:20 2021] GET /identity/v3/role_assignments?user.id=3783ea349d1b48d6ba2adcac6deea344&scope.system=all&role.id=26a400f146c54b26a90d5afef23446e8 => generated 226 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:23.193906 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dcdd02-1e5a-4aba-aee9-0924ed550de7 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:23.194509 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dcdd02-1e5a-4aba-aee9-0924ed550de7 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:23.194509 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dcdd02-1e5a-4aba-aee9-0924ed550de7 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:23.196452 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 172/341] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:23.202147 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d798a-1caa-4b8a-95cf-a6ba2d1b8e3b None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:23.202598 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d798a-1caa-4b8a-95cf-a6ba2d1b8e3b None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:23.202679 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d798a-1caa-4b8a-95cf-a6ba2d1b8e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:23.207196 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbc3af-8a2b-42be-9c31-ae798d49b27a None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:23.207480 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbc3af-8a2b-42be-9c31-ae798d49b27a None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:23.207747 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dbc3af-8a2b-42be-9c31-ae798d49b27a None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:23.209588 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 173/342] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 29 20:08:23.214793 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d138c-a457-474d-b9e4-94d1ef6a6ad3 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:23.215073 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d138c-a457-474d-b9e4-94d1ef6a6ad3 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:23.215344 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d138c-a457-474d-b9e4-94d1ef6a6ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:23.221053 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-ae9d798a-1caa-4b8a-95cf-a6ba2d1b8e3b None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:23.222473 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-ae9d798a-1caa-4b8a-95cf-a6ba2d1b8e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:23.230413 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 170/343] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:23.233150 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-190d138c-a457-474d-b9e4-94d1ef6a6ad3 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:23.234305 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-190d138c-a457-474d-b9e4-94d1ef6a6ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:23.241852 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 174/344] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 29 20:08:23.253739 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d798a-1caa-4b8a-95cf-a6ba2d1b8e3b None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:23.263631 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d798a-1caa-4b8a-95cf-a6ba2d1b8e3b None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:23.265708 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d138c-a457-474d-b9e4-94d1ef6a6ad3 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:23.268395 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2409c11-3f24-4473-ab2e-3a4c8588ac03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:23.269176 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2409c11-3f24-4473-ab2e-3a4c8588ac03 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:23.269453 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2409c11-3f24-4473-ab2e-3a4c8588ac03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:23.269696 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2409c11-3f24-4473-ab2e-3a4c8588ac03 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:23.270922 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2409c11-3f24-4473-ab2e-3a4c8588ac03 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:23.272621 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2409c11-3f24-4473-ab2e-3a4c8588ac03 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:23.274205 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 171/345] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:23 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:23.274821 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d138c-a457-474d-b9e4-94d1ef6a6ad3 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:23.279327 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4f67b-4b62-4426-a91d-2b5d83caaf32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:23.280109 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4f67b-4b62-4426-a91d-2b5d83caaf32 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:23.280205 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2409c11-3f24-4473-ab2e-3a4c8588ac03 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:23.280367 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4f67b-4b62-4426-a91d-2b5d83caaf32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:23.280647 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4f67b-4b62-4426-a91d-2b5d83caaf32 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:23.289478 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2409c11-3f24-4473-ab2e-3a4c8588ac03 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:23.291035 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4f67b-4b62-4426-a91d-2b5d83caaf32 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:23.293995 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734ad03-81da-483e-8a9c-265526a0a30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:23.294656 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734ad03-81da-483e-8a9c-265526a0a30f admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:23.294962 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734ad03-81da-483e-8a9c-265526a0a30f admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:23.295228 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734ad03-81da-483e-8a9c-265526a0a30f admin admin] PATH_INFO: `/v3/groups` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:23.295926 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734ad03-81da-483e-8a9c-265526a0a30f admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:23.297791 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734ad03-81da-483e-8a9c-265526a0a30f admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:23.297964 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-76e4f67b-4b62-4426-a91d-2b5d83caaf32 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 29 20:08:23.298974 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 175/346] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:08:23 2021] GET /identity/v3/roles/member => generated 84 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:08:23.305263 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4f67b-4b62-4426-a91d-2b5d83caaf32 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:23.313983 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 172/347] 10.222.0.15 () {60 vars in 1155 bytes} [Mon Nov 29 20:08:23 2021] POST /identity/v3/groups => generated 226 bytes in 34 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:08:23.319075 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4f67b-4b62-4426-a91d-2b5d83caaf32 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:23.319827 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7796a0-259f-4c20-82b0-03556e3da316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:23.320355 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3deddcf-ca7a-424f-9179-98d50be8200b None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:23.320500 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7796a0-259f-4c20-82b0-03556e3da316 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:23.320634 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3deddcf-ca7a-424f-9179-98d50be8200b None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:23.320782 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7796a0-259f-4c20-82b0-03556e3da316 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:23.320902 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3deddcf-ca7a-424f-9179-98d50be8200b None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:23.321055 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7796a0-259f-4c20-82b0-03556e3da316 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:23.321837 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7796a0-259f-4c20-82b0-03556e3da316 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:23.322145 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7796a0-259f-4c20-82b0-03556e3da316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:23.322915 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 173/348] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:23.323905 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7796a0-259f-4c20-82b0-03556e3da316 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:23.329236 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015cd59-5e3d-4a98-8d4e-e134b4ea9b27 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:23.329539 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015cd59-5e3d-4a98-8d4e-e134b4ea9b27 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:23.329770 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015cd59-5e3d-4a98-8d4e-e134b4ea9b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:23.334236 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 176/349] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Nov 29 20:08:23 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:23.340253 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7796a0-259f-4c20-82b0-03556e3da316 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:23.350347 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-b015cd59-5e3d-4a98-8d4e-e134b4ea9b27 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:23.351439 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7796a0-259f-4c20-82b0-03556e3da316 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:23.351635 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-b015cd59-5e3d-4a98-8d4e-e134b4ea9b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:23.356292 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925bb47-fb76-4d4f-aa5f-635368f50c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:23.357266 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925bb47-fb76-4d4f-aa5f-635368f50c82 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:23.357550 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925bb47-fb76-4d4f-aa5f-635368f50c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:23.357824 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925bb47-fb76-4d4f-aa5f-635368f50c82 admin admin] PATH_INFO: `/v3/users/a09841be54494b84b72a9799494f16ee` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:23.359228 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925bb47-fb76-4d4f-aa5f-635368f50c82 admin admin] RBAC: Authorizing `identity:get_user(user_id=a09841be54494b84b72a9799494f16ee)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:23.360628 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 174/350] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:23 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 29 20:08:23.361538 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925bb47-fb76-4d4f-aa5f-635368f50c82 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:23.368320 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 177/351] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:08:23 2021] GET /identity/v3/users/a09841be54494b84b72a9799494f16ee => generated 293 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:23.369536 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b015cd59-5e3d-4a98-8d4e-e134b4ea9b27 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:23.379551 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b015cd59-5e3d-4a98-8d4e-e134b4ea9b27 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:23.384620 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6745663c-55e2-4102-8181-c87c85fc0bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:23.385007 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745663c-55e2-4102-8181-c87c85fc0bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:23.385615 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745663c-55e2-4102-8181-c87c85fc0bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:23.385886 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6745663c-55e2-4102-8181-c87c85fc0bf3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:23.386002 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925bb47-fb76-4d4f-aa5f-635368f50c82 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:23.386892 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6745663c-55e2-4102-8181-c87c85fc0bf3 admin admin] RBAC: Adding query filter params (role.id=88a0e2c4c85c4449ad4681edcdc57835, user.id=a09841be54494b84b72a9799494f16ee, scope.system=all) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:23.387210 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6745663c-55e2-4102-8181-c87c85fc0bf3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:23.389237 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6745663c-55e2-4102-8181-c87c85fc0bf3 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:23.395974 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925bb47-fb76-4d4f-aa5f-635368f50c82 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:23.400580 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaba111-7e4d-4fce-af8a-453a9c237df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:23.401420 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaba111-7e4d-4fce-af8a-453a9c237df1 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:23.401702 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaba111-7e4d-4fce-af8a-453a9c237df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:23.401974 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaba111-7e4d-4fce-af8a-453a9c237df1 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:23.410925 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 175/352] 10.222.0.15 () {56 vars in 1329 bytes} [Mon Nov 29 20:08:23 2021] GET /identity/v3/role_assignments?user.id=a09841be54494b84b72a9799494f16ee&scope.system=all&role.id=88a0e2c4c85c4449ad4681edcdc57835 => generated 510 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:23.413889 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaba111-7e4d-4fce-af8a-453a9c237df1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:23.421155 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-aaaba111-7e4d-4fce-af8a-453a9c237df1 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 29 20:08:23.423001 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 178/353] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:08:23 2021] GET /identity/v3/roles/reader => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:08:23.429139 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6745663c-55e2-4102-8181-c87c85fc0bf3 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:23.439560 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6745663c-55e2-4102-8181-c87c85fc0bf3 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:23.444322 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9746a5-097e-4450-8ca2-0d76245858e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:23.444934 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9746a5-097e-4450-8ca2-0d76245858e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:23.445215 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9746a5-097e-4450-8ca2-0d76245858e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:23.445486 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9746a5-097e-4450-8ca2-0d76245858e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:23.446274 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9746a5-097e-4450-8ca2-0d76245858e3 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:23.446586 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9746a5-097e-4450-8ca2-0d76245858e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:23.448323 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9746a5-097e-4450-8ca2-0d76245858e3 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:23.464065 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 176/354] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Nov 29 20:08:23 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:23.465090 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaba111-7e4d-4fce-af8a-453a9c237df1 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:23.475505 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaba111-7e4d-4fce-af8a-453a9c237df1 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:23.480180 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e3128-6667-41dc-a93f-ef06bcb14ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:23.481080 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e3128-6667-41dc-a93f-ef06bcb14ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:23.481362 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e3128-6667-41dc-a93f-ef06bcb14ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:23.481701 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e3128-6667-41dc-a93f-ef06bcb14ba2 admin admin] PATH_INFO: `/v3/users/3783ea349d1b48d6ba2adcac6deea344` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:23.483062 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e3128-6667-41dc-a93f-ef06bcb14ba2 admin admin] RBAC: Authorizing `identity:get_user(user_id=3783ea349d1b48d6ba2adcac6deea344)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:23.485275 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e3128-6667-41dc-a93f-ef06bcb14ba2 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:23.487325 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 179/355] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:08:23 2021] GET /identity/v3/users/3783ea349d1b48d6ba2adcac6deea344 => generated 293 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:23.493910 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9746a5-097e-4450-8ca2-0d76245858e3 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:23.505057 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9746a5-097e-4450-8ca2-0d76245858e3 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:23.512192 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7af44a-f7ca-4950-9d66-30e364c128af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:23.513553 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7af44a-f7ca-4950-9d66-30e364c128af admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:23.513829 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7af44a-f7ca-4950-9d66-30e364c128af admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:23.514151 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7af44a-f7ca-4950-9d66-30e364c128af admin admin] PATH_INFO: `/v3/system/users/3783ea349d1b48d6ba2adcac6deea344/roles/26a400f146c54b26a90d5afef23446e8` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:23.516271 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7af44a-f7ca-4950-9d66-30e364c128af admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3783ea349d1b48d6ba2adcac6deea344, role_id=26a400f146c54b26a90d5afef23446e8)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:23.518023 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7af44a-f7ca-4950-9d66-30e364c128af admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:23.529441 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 177/356] 10.222.0.15 () {58 vars in 1355 bytes} [Mon Nov 29 20:08:23 2021] PUT /identity/v3/system/users/3783ea349d1b48d6ba2adcac6deea344/roles/26a400f146c54b26a90d5afef23446e8 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:08:26.513703 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77e447-0bdc-46f2-8d79-445a0243a6e6 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:26.514745 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77e447-0bdc-46f2-8d79-445a0243a6e6 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:26.515301 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77e447-0bdc-46f2-8d79-445a0243a6e6 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:26.517311 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 180/357] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:26 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:26.523480 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56caab-c38f-41b6-bcdf-7ffa3b06da38 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:26.524301 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56caab-c38f-41b6-bcdf-7ffa3b06da38 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:26.524795 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56caab-c38f-41b6-bcdf-7ffa3b06da38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:26.547466 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-df56caab-c38f-41b6-bcdf-7ffa3b06da38 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:26.549020 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-df56caab-c38f-41b6-bcdf-7ffa3b06da38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:26.556888 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 178/358] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:26 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 29 20:08:26.597602 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e77e447-0bdc-46f2-8d79-445a0243a6e6 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:26.617929 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e77e447-0bdc-46f2-8d79-445a0243a6e6 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:26.622681 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c42dcd-c66c-4b9c-afe8-21f70a1e9c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:26.623760 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c42dcd-c66c-4b9c-afe8-21f70a1e9c4b admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:26.624238 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c42dcd-c66c-4b9c-afe8-21f70a1e9c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:26.624702 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c42dcd-c66c-4b9c-afe8-21f70a1e9c4b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:26.640428 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c42dcd-c66c-4b9c-afe8-21f70a1e9c4b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:26.651923 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-b6c42dcd-c66c-4b9c-afe8-21f70a1e9c4b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 29 20:08:26.653437 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 181/359] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:08:26 2021] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:26.660039 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56caab-c38f-41b6-bcdf-7ffa3b06da38 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:26.669700 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56caab-c38f-41b6-bcdf-7ffa3b06da38 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:26.674472 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec2c59a-a501-4650-8301-415f64f86e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:26.679552 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2c59a-a501-4650-8301-415f64f86e0b admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:26.680057 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2c59a-a501-4650-8301-415f64f86e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:26.680546 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2c59a-a501-4650-8301-415f64f86e0b admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:26.681514 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec2c59a-a501-4650-8301-415f64f86e0b admin admin] RBAC: Adding query filter params (name=member) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:26.682048 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec2c59a-a501-4650-8301-415f64f86e0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:26.683902 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec2c59a-a501-4650-8301-415f64f86e0b admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:26.693449 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 179/360] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Nov 29 20:08:26 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:26.699626 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c42dcd-c66c-4b9c-afe8-21f70a1e9c4b admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:26.709921 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c42dcd-c66c-4b9c-afe8-21f70a1e9c4b admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:26.714832 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c223e27d-19a3-489c-bb5a-9bfaf59108e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:26.715754 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223e27d-19a3-489c-bb5a-9bfaf59108e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:26.716277 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223e27d-19a3-489c-bb5a-9bfaf59108e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:26.716770 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223e27d-19a3-489c-bb5a-9bfaf59108e4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:26.726966 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c223e27d-19a3-489c-bb5a-9bfaf59108e4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:26.729046 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c223e27d-19a3-489c-bb5a-9bfaf59108e4 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:26.739866 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 182/361] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:08:26 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:08:26.745922 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec2c59a-a501-4650-8301-415f64f86e0b admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:26.756182 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec2c59a-a501-4650-8301-415f64f86e0b admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:26.763673 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8242a43-ff09-4c85-8157-630fe889dbe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:26.764865 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8242a43-ff09-4c85-8157-630fe889dbe5 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:26.765345 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8242a43-ff09-4c85-8157-630fe889dbe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:26.765842 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8242a43-ff09-4c85-8157-630fe889dbe5 admin admin] PATH_INFO: `/v3/projects/4facf8265b034e41b65929b2699eb944` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:26.767274 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8242a43-ff09-4c85-8157-630fe889dbe5 admin admin] RBAC: Authorizing `identity:get_project(project_id=4facf8265b034e41b65929b2699eb944)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:26.769563 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8242a43-ff09-4c85-8157-630fe889dbe5 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:26.771491 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 180/362] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:08:26 2021] GET /identity/v3/projects/4facf8265b034e41b65929b2699eb944 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:26.778129 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c223e27d-19a3-489c-bb5a-9bfaf59108e4 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:26.791707 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c223e27d-19a3-489c-bb5a-9bfaf59108e4 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:26.796369 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec85a75-ccc0-4a7d-910b-5af389b86184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:26.797230 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec85a75-ccc0-4a7d-910b-5af389b86184 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:26.797512 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec85a75-ccc0-4a7d-910b-5af389b86184 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:26.797788 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec85a75-ccc0-4a7d-910b-5af389b86184 admin admin] PATH_INFO: `/v3/groups/fa37380e467347c884df371a191adc53` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:26.814894 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec85a75-ccc0-4a7d-910b-5af389b86184 admin admin] RBAC: Authorizing `identity:get_group(group_id=fa37380e467347c884df371a191adc53)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:26.815921 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING py.warnings [None req-4ec85a75-ccc0-4a7d-910b-5af389b86184 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 29 20:08:26.815921 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: warnings.warn(msg) Nov 29 20:08:26.815921 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: Nov 29 20:08:26.817123 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec85a75-ccc0-4a7d-910b-5af389b86184 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:26.819119 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 183/363] 10.222.0.15 () {56 vars in 1201 bytes} [Mon Nov 29 20:08:26 2021] GET /identity/v3/groups/fa37380e467347c884df371a191adc53 => generated 226 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:26.825235 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8242a43-ff09-4c85-8157-630fe889dbe5 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:26.840352 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8242a43-ff09-4c85-8157-630fe889dbe5 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:26.849363 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85012c23-f0c3-498a-8f05-f33bb33ff526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:26.850313 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85012c23-f0c3-498a-8f05-f33bb33ff526 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:26.850801 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85012c23-f0c3-498a-8f05-f33bb33ff526 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:26.851297 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85012c23-f0c3-498a-8f05-f33bb33ff526 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:26.852365 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85012c23-f0c3-498a-8f05-f33bb33ff526 admin admin] RBAC: Adding query filter params (group.id=fa37380e467347c884df371a191adc53, role.id=88a0e2c4c85c4449ad4681edcdc57835, scope.project.id=4facf8265b034e41b65929b2699eb944) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:26.852881 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85012c23-f0c3-498a-8f05-f33bb33ff526 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:26.854991 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85012c23-f0c3-498a-8f05-f33bb33ff526 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:26.866996 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 181/364] 10.222.0.15 () {56 vars in 1397 bytes} [Mon Nov 29 20:08:26 2021] GET /identity/v3/role_assignments?group.id=fa37380e467347c884df371a191adc53&scope.project.id=4facf8265b034e41b65929b2699eb944&role.id=88a0e2c4c85c4449ad4681edcdc57835 => generated 260 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:26.903785 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abdafd-b888-4088-9948-efdc017efb5a None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:26.905251 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abdafd-b888-4088-9948-efdc017efb5a None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:26.905532 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3abdafd-b888-4088-9948-efdc017efb5a None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:26.907579 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 184/365] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:26 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:26.914163 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb66ac-00cc-485f-a447-77d50a865205 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:26.914827 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb66ac-00cc-485f-a447-77d50a865205 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:26.915471 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb66ac-00cc-485f-a447-77d50a865205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:26.939476 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-97fb66ac-00cc-485f-a447-77d50a865205 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:26.941075 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-97fb66ac-00cc-485f-a447-77d50a865205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:26.953777 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 182/366] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:26 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:27.005262 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abdafd-b888-4088-9948-efdc017efb5a None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:27.024845 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3abdafd-b888-4088-9948-efdc017efb5a None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:27.030672 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dabd28-ed7d-4533-a776-cd440bf96b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:27.031565 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dabd28-ed7d-4533-a776-cd440bf96b79 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:27.031842 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dabd28-ed7d-4533-a776-cd440bf96b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:27.032111 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dabd28-ed7d-4533-a776-cd440bf96b79 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:27.042257 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178afc88-934e-4ed4-87c4-6a952298015b None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:27.042896 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178afc88-934e-4ed4-87c4-6a952298015b None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:27.043368 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178afc88-934e-4ed4-87c4-6a952298015b None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:27.045706 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 183/367] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:27.052182 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c82134-6dfd-448f-b649-96066b69af4b None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:27.052599 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dabd28-ed7d-4533-a776-cd440bf96b79 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:27.052996 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c82134-6dfd-448f-b649-96066b69af4b None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:27.053465 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c82134-6dfd-448f-b649-96066b69af4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:27.059723 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-77dabd28-ed7d-4533-a776-cd440bf96b79 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 29 20:08:27.066295 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 185/368] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:08:27 2021] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:27.078468 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-41c82134-6dfd-448f-b649-96066b69af4b None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:27.080226 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-41c82134-6dfd-448f-b649-96066b69af4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:27.084475 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dabd28-ed7d-4533-a776-cd440bf96b79 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:27.092310 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 184/369] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 29 20:08:27.101443 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dabd28-ed7d-4533-a776-cd440bf96b79 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:27.115324 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7837a4-7d46-45b8-b373-cdbe902d678d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:27.116014 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7837a4-7d46-45b8-b373-cdbe902d678d admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:27.116297 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7837a4-7d46-45b8-b373-cdbe902d678d admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:27.116574 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7837a4-7d46-45b8-b373-cdbe902d678d admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:27.117348 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7837a4-7d46-45b8-b373-cdbe902d678d admin admin] RBAC: Adding query filter params (name=member) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:27.117681 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7837a4-7d46-45b8-b373-cdbe902d678d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:27.119315 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7837a4-7d46-45b8-b373-cdbe902d678d admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:27.126208 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c82134-6dfd-448f-b649-96066b69af4b None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:27.134337 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 186/370] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Nov 29 20:08:27 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:27.137943 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c82134-6dfd-448f-b649-96066b69af4b None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:27.145361 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae1541-d277-466f-b2d9-f8fce659ef58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:27.146597 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae1541-d277-466f-b2d9-f8fce659ef58 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:27.149145 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae1541-d277-466f-b2d9-f8fce659ef58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:27.149670 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae1541-d277-466f-b2d9-f8fce659ef58 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:27.162403 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ae1541-d277-466f-b2d9-f8fce659ef58 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:27.168474 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7837a4-7d46-45b8-b373-cdbe902d678d admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:27.170832 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-22ae1541-d277-466f-b2d9-f8fce659ef58 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Nov 29 20:08:27.172412 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 185/371] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:08:27 2021] GET /identity/v3/roles/reader => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:08:27.179379 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae1541-d277-466f-b2d9-f8fce659ef58 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:27.184888 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7837a4-7d46-45b8-b373-cdbe902d678d admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:27.190552 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae1541-d277-466f-b2d9-f8fce659ef58 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:27.196630 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799a182-94c0-41cb-8d86-32324b872170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:27.197306 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799a182-94c0-41cb-8d86-32324b872170 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:27.197590 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799a182-94c0-41cb-8d86-32324b872170 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:27.197700 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d3811-7739-482b-bb37-1f989241c6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:27.197948 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799a182-94c0-41cb-8d86-32324b872170 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:27.199082 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d3811-7739-482b-bb37-1f989241c6fa admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:27.199621 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d3811-7739-482b-bb37-1f989241c6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:27.200094 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d3811-7739-482b-bb37-1f989241c6fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:27.201137 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89d3811-7739-482b-bb37-1f989241c6fa admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:27.201703 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89d3811-7739-482b-bb37-1f989241c6fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:27.203539 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89d3811-7739-482b-bb37-1f989241c6fa admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:27.206611 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3799a182-94c0-41cb-8d86-32324b872170 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:27.208395 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3799a182-94c0-41cb-8d86-32324b872170 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:27.220718 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 186/372] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Nov 29 20:08:27 2021] GET /identity/v3/roles?name=reader => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:27.228162 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d3811-7739-482b-bb37-1f989241c6fa admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:27.229479 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 187/373] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:08:27 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:08:27.239418 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d3811-7739-482b-bb37-1f989241c6fa admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:27.249786 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d0941-1fef-43ff-a977-4565e130cf40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:27.251108 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d0941-1fef-43ff-a977-4565e130cf40 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:27.251688 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d0941-1fef-43ff-a977-4565e130cf40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:27.252177 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d0941-1fef-43ff-a977-4565e130cf40 admin admin] PATH_INFO: `/v3/users/3783ea349d1b48d6ba2adcac6deea344` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:27.253654 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0d0941-1fef-43ff-a977-4565e130cf40 admin admin] RBAC: Authorizing `identity:get_user(user_id=3783ea349d1b48d6ba2adcac6deea344)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:27.259402 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0d0941-1fef-43ff-a977-4565e130cf40 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:27.261216 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 187/374] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:08:27 2021] GET /identity/v3/users/3783ea349d1b48d6ba2adcac6deea344 => generated 293 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:27.261538 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da1bf5-a683-49ee-822b-c305543565bf None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:27.261707 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da1bf5-a683-49ee-822b-c305543565bf None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:27.261959 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d0941-1fef-43ff-a977-4565e130cf40 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:27.262066 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da1bf5-a683-49ee-822b-c305543565bf None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:27.264163 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 188/375] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 29 20:08:27.269294 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da1bf5-a683-49ee-822b-c305543565bf None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:27.280908 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d0941-1fef-43ff-a977-4565e130cf40 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:27.290283 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af969d-1946-413b-bcf4-84c659cf0b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:27.292514 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da1bf5-a683-49ee-822b-c305543565bf None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:27.293032 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af969d-1946-413b-bcf4-84c659cf0b02 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:27.293786 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af969d-1946-413b-bcf4-84c659cf0b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:27.294067 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af969d-1946-413b-bcf4-84c659cf0b02 admin admin] PATH_INFO: `/v3/projects/949a39418c3f4e5d83eee096bcff2c25` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:27.296589 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af969d-1946-413b-bcf4-84c659cf0b02 admin admin] RBAC: Authorizing `identity:get_project(project_id=949a39418c3f4e5d83eee096bcff2c25)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:27.301310 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af969d-1946-413b-bcf4-84c659cf0b02 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:27.302049 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c12694-5ef0-47a9-82ec-556f3c7f786f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:27.303860 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c12694-5ef0-47a9-82ec-556f3c7f786f admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:27.304974 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c12694-5ef0-47a9-82ec-556f3c7f786f admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:27.305301 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c12694-5ef0-47a9-82ec-556f3c7f786f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:27.306166 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c12694-5ef0-47a9-82ec-556f3c7f786f admin admin] RBAC: Adding query filter params (role.id=26a400f146c54b26a90d5afef23446e8, user.id=3783ea349d1b48d6ba2adcac6deea344, scope.system=all) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:27.306634 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 188/376] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:08:27 2021] GET /identity/v3/projects/949a39418c3f4e5d83eee096bcff2c25 => generated 302 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:27.307679 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2caa802-7a0d-4c02-b37c-91a8f34332c4 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:27.308311 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c12694-5ef0-47a9-82ec-556f3c7f786f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:27.309543 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2caa802-7a0d-4c02-b37c-91a8f34332c4 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:27.309821 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2caa802-7a0d-4c02-b37c-91a8f34332c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:27.310816 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c12694-5ef0-47a9-82ec-556f3c7f786f admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:27.338888 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 189/377] 10.222.0.15 () {56 vars in 1329 bytes} [Mon Nov 29 20:08:27 2021] GET /identity/v3/role_assignments?user.id=3783ea349d1b48d6ba2adcac6deea344&scope.system=all&role.id=26a400f146c54b26a90d5afef23446e8 => generated 510 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:27.338888 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c12694-5ef0-47a9-82ec-556f3c7f786f admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:27.339139 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-e2caa802-7a0d-4c02-b37c-91a8f34332c4 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:27.339139 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-e2caa802-7a0d-4c02-b37c-91a8f34332c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:27.348960 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c12694-5ef0-47a9-82ec-556f3c7f786f admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:27.356477 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65487912-f83f-4186-8f95-fd3c9fa540bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:27.358013 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65487912-f83f-4186-8f95-fd3c9fa540bd admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:27.358295 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65487912-f83f-4186-8f95-fd3c9fa540bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:27.358574 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65487912-f83f-4186-8f95-fd3c9fa540bd admin admin] PATH_INFO: `/v3/groups/fa37380e467347c884df371a191adc53` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:27.360822 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 189/378] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:27.361562 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65487912-f83f-4186-8f95-fd3c9fa540bd admin admin] RBAC: Authorizing `identity:get_group(group_id=fa37380e467347c884df371a191adc53)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:27.367943 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65487912-f83f-4186-8f95-fd3c9fa540bd admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:27.370080 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 190/379] 10.222.0.15 () {56 vars in 1201 bytes} [Mon Nov 29 20:08:27 2021] GET /identity/v3/groups/fa37380e467347c884df371a191adc53 => generated 226 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:27.376727 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2caa802-7a0d-4c02-b37c-91a8f34332c4 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:27.392510 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2caa802-7a0d-4c02-b37c-91a8f34332c4 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:27.400637 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626b7ed-209e-444f-a0c0-d0ead03badc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:27.401319 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626b7ed-209e-444f-a0c0-d0ead03badc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:27.401596 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626b7ed-209e-444f-a0c0-d0ead03badc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:27.401864 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626b7ed-209e-444f-a0c0-d0ead03badc8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:27.402724 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1626b7ed-209e-444f-a0c0-d0ead03badc8 admin admin] RBAC: Adding query filter params (group.id=fa37380e467347c884df371a191adc53, role.id=88a0e2c4c85c4449ad4681edcdc57835, scope.project.id=949a39418c3f4e5d83eee096bcff2c25) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:27.403129 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1626b7ed-209e-444f-a0c0-d0ead03badc8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:27.405048 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1626b7ed-209e-444f-a0c0-d0ead03badc8 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:27.415749 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 190/380] 10.222.0.15 () {56 vars in 1397 bytes} [Mon Nov 29 20:08:27 2021] GET /identity/v3/role_assignments?group.id=fa37380e467347c884df371a191adc53&scope.project.id=949a39418c3f4e5d83eee096bcff2c25&role.id=88a0e2c4c85c4449ad4681edcdc57835 => generated 260 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:27.417773 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65487912-f83f-4186-8f95-fd3c9fa540bd admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:27.428152 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65487912-f83f-4186-8f95-fd3c9fa540bd admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:27.437572 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb531037-18ba-4c17-bd3a-2ea56b2f767f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:27.438407 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb531037-18ba-4c17-bd3a-2ea56b2f767f admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:27.438690 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb531037-18ba-4c17-bd3a-2ea56b2f767f admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:27.438995 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb531037-18ba-4c17-bd3a-2ea56b2f767f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:27.457173 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb531037-18ba-4c17-bd3a-2ea56b2f767f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:27.464711 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-eb531037-18ba-4c17-bd3a-2ea56b2f767f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 29 20:08:27.466027 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 191/381] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Nov 29 20:08:27 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:27.472492 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626b7ed-209e-444f-a0c0-d0ead03badc8 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:27.488418 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1626b7ed-209e-444f-a0c0-d0ead03badc8 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:27.495421 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9191ebe-9e6e-4c9b-90f7-b50ebc84ce46 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:27.495746 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9191ebe-9e6e-4c9b-90f7-b50ebc84ce46 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:27.496010 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9191ebe-9e6e-4c9b-90f7-b50ebc84ce46 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:27.497905 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 192/382] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 29 20:08:27.499553 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0a730-b955-472c-9928-536d0aaa4a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:27.500234 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0a730-b955-472c-9928-536d0aaa4a65 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:27.500514 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0a730-b955-472c-9928-536d0aaa4a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:27.500789 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d0a730-b955-472c-9928-536d0aaa4a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:27.501558 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d0a730-b955-472c-9928-536d0aaa4a65 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:27.501863 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d0a730-b955-472c-9928-536d0aaa4a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:27.503536 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d0a730-b955-472c-9928-536d0aaa4a65 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:27.512257 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df81df7-d48b-4bba-9051-39f7a7277d03 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:27.512868 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df81df7-d48b-4bba-9051-39f7a7277d03 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:27.513383 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df81df7-d48b-4bba-9051-39f7a7277d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:27.518257 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 191/383] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:08:27 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:27.525677 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0a730-b955-472c-9928-536d0aaa4a65 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:27.536833 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d0a730-b955-472c-9928-536d0aaa4a65 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:27.541362 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-6df81df7-d48b-4bba-9051-39f7a7277d03 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:27.542081 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c87f31-c397-429d-86e8-eb2ef70f22e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:27.542791 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c87f31-c397-429d-86e8-eb2ef70f22e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:27.543109 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c87f31-c397-429d-86e8-eb2ef70f22e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:27.543389 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c87f31-c397-429d-86e8-eb2ef70f22e2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:27.544227 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-6df81df7-d48b-4bba-9051-39f7a7277d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:27.553000 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c87f31-c397-429d-86e8-eb2ef70f22e2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:27.554998 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c87f31-c397-429d-86e8-eb2ef70f22e2 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:27.565655 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 193/384] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:27 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 29 20:08:27.566408 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 192/385] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:08:27 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 29 20:08:27.573772 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df81df7-d48b-4bba-9051-39f7a7277d03 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:27.589560 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df81df7-d48b-4bba-9051-39f7a7277d03 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:27.598491 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf71b8-9dc3-4ed9-bb20-42d60e4add89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:27.599322 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c87f31-c397-429d-86e8-eb2ef70f22e2 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:27.600125 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf71b8-9dc3-4ed9-bb20-42d60e4add89 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:27.600597 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf71b8-9dc3-4ed9-bb20-42d60e4add89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:27.601059 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdf71b8-9dc3-4ed9-bb20-42d60e4add89 admin admin] PATH_INFO: `/v3/projects/4facf8265b034e41b65929b2699eb944` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:27.602491 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf71b8-9dc3-4ed9-bb20-42d60e4add89 admin admin] RBAC: Authorizing `identity:get_project(project_id=4facf8265b034e41b65929b2699eb944)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:27.604923 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdf71b8-9dc3-4ed9-bb20-42d60e4add89 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:27.607011 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 194/386] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:08:27 2021] GET /identity/v3/projects/4facf8265b034e41b65929b2699eb944 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:27.610275 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c87f31-c397-429d-86e8-eb2ef70f22e2 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:27.619432 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a723d508-1ce6-4386-a7f2-ad252cfc6c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:27.620283 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723d508-1ce6-4386-a7f2-ad252cfc6c65 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:27.620619 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723d508-1ce6-4386-a7f2-ad252cfc6c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:27.620900 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723d508-1ce6-4386-a7f2-ad252cfc6c65 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:27.635392 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf71b8-9dc3-4ed9-bb20-42d60e4add89 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:27.636065 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a723d508-1ce6-4386-a7f2-ad252cfc6c65 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:27.644300 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-a723d508-1ce6-4386-a7f2-ad252cfc6c65 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 29 20:08:27.646498 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 193/387] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Nov 29 20:08:27 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:27.653255 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a723d508-1ce6-4386-a7f2-ad252cfc6c65 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:27.654377 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdf71b8-9dc3-4ed9-bb20-42d60e4add89 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:27.664625 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb04eb2-a09e-4f65-9812-37c8e3b6059b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:27.665186 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a723d508-1ce6-4386-a7f2-ad252cfc6c65 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:27.666294 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb04eb2-a09e-4f65-9812-37c8e3b6059b admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:27.666914 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb04eb2-a09e-4f65-9812-37c8e3b6059b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:27.667396 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb04eb2-a09e-4f65-9812-37c8e3b6059b admin admin] PATH_INFO: `/v3/groups/fa37380e467347c884df371a191adc53` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:27.668988 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb04eb2-a09e-4f65-9812-37c8e3b6059b admin admin] RBAC: Authorizing `identity:get_group(group_id=fa37380e467347c884df371a191adc53)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:27.669946 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e93fae-9cb3-4732-98ab-11f659c4455e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:27.670673 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e93fae-9cb3-4732-98ab-11f659c4455e admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:27.674883 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e93fae-9cb3-4732-98ab-11f659c4455e admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:27.674883 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e93fae-9cb3-4732-98ab-11f659c4455e admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:27.674883 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e93fae-9cb3-4732-98ab-11f659c4455e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:27.674883 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e93fae-9cb3-4732-98ab-11f659c4455e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:27.674883 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e93fae-9cb3-4732-98ab-11f659c4455e admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:27.676442 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb04eb2-a09e-4f65-9812-37c8e3b6059b admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:27.678442 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 195/388] 10.222.0.15 () {56 vars in 1201 bytes} [Mon Nov 29 20:08:27 2021] GET /identity/v3/groups/fa37380e467347c884df371a191adc53 => generated 226 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:27.688214 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 194/389] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:08:27 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:27.690767 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb04eb2-a09e-4f65-9812-37c8e3b6059b admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:27.696108 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e93fae-9cb3-4732-98ab-11f659c4455e admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:27.706610 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb04eb2-a09e-4f65-9812-37c8e3b6059b admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:27.708079 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e93fae-9cb3-4732-98ab-11f659c4455e admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:27.714050 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d834154-c37b-45c7-b574-0fcadd6f646e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:27.714307 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118a195-e6b9-4984-9af9-2f2f6c328bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:27.715001 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118a195-e6b9-4984-9af9-2f2f6c328bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:27.715425 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118a195-e6b9-4984-9af9-2f2f6c328bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:27.715715 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118a195-e6b9-4984-9af9-2f2f6c328bd6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:27.715996 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d834154-c37b-45c7-b574-0fcadd6f646e admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:27.716657 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d834154-c37b-45c7-b574-0fcadd6f646e admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:27.717203 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d834154-c37b-45c7-b574-0fcadd6f646e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:27.718305 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d834154-c37b-45c7-b574-0fcadd6f646e admin admin] RBAC: Adding query filter params (group.id=fa37380e467347c884df371a191adc53, role.id=d63eb17a7e7d455ea5f2c6696d92978c, scope.project.id=4facf8265b034e41b65929b2699eb944) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:27.718827 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d834154-c37b-45c7-b574-0fcadd6f646e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:27.720965 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d834154-c37b-45c7-b574-0fcadd6f646e admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:27.725528 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118a195-e6b9-4984-9af9-2f2f6c328bd6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:27.727634 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118a195-e6b9-4984-9af9-2f2f6c328bd6 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:27.731552 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 196/390] 10.222.0.15 () {56 vars in 1397 bytes} [Mon Nov 29 20:08:27 2021] GET /identity/v3/role_assignments?group.id=fa37380e467347c884df371a191adc53&scope.project.id=4facf8265b034e41b65929b2699eb944&role.id=d63eb17a7e7d455ea5f2c6696d92978c => generated 260 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:27.742962 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 195/391] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:08:27 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 29 20:08:27.755883 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d834154-c37b-45c7-b574-0fcadd6f646e admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:27.773743 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d834154-c37b-45c7-b574-0fcadd6f646e admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:27.788579 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6ec70-996c-4d17-b3bd-ffcc6771aa93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:27.789391 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6ec70-996c-4d17-b3bd-ffcc6771aa93 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:27.789666 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6ec70-996c-4d17-b3bd-ffcc6771aa93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:27.789933 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6ec70-996c-4d17-b3bd-ffcc6771aa93 admin admin] PATH_INFO: `/v3/projects/949a39418c3f4e5d83eee096bcff2c25` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:27.795931 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f6ec70-996c-4d17-b3bd-ffcc6771aa93 admin admin] RBAC: Authorizing `identity:get_project(project_id=949a39418c3f4e5d83eee096bcff2c25)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:27.798040 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f6ec70-996c-4d17-b3bd-ffcc6771aa93 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:27.800136 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 197/392] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:08:27 2021] GET /identity/v3/projects/949a39418c3f4e5d83eee096bcff2c25 => generated 302 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:27.806072 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118a195-e6b9-4984-9af9-2f2f6c328bd6 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:27.834457 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118a195-e6b9-4984-9af9-2f2f6c328bd6 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:27.844425 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79100f45-bc41-47c9-99ff-cfd622514b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:27.846974 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79100f45-bc41-47c9-99ff-cfd622514b39 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:27.847490 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79100f45-bc41-47c9-99ff-cfd622514b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:27.847964 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79100f45-bc41-47c9-99ff-cfd622514b39 admin admin] PATH_INFO: `/v3/groups/fa37380e467347c884df371a191adc53` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:27.849586 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79100f45-bc41-47c9-99ff-cfd622514b39 admin admin] RBAC: Authorizing `identity:get_group(group_id=fa37380e467347c884df371a191adc53)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:27.850805 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING py.warnings [None req-79100f45-bc41-47c9-99ff-cfd622514b39 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 29 20:08:27.850805 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: warnings.warn(msg) Nov 29 20:08:27.850805 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: Nov 29 20:08:27.852363 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79100f45-bc41-47c9-99ff-cfd622514b39 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:27.854284 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 196/393] 10.222.0.15 () {56 vars in 1201 bytes} [Mon Nov 29 20:08:27 2021] GET /identity/v3/groups/fa37380e467347c884df371a191adc53 => generated 226 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:27.861081 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6ec70-996c-4d17-b3bd-ffcc6771aa93 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:27.878764 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6ec70-996c-4d17-b3bd-ffcc6771aa93 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:27.888078 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80a8fd-ef68-4f35-b657-5daa1016ef44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:27.888816 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80a8fd-ef68-4f35-b657-5daa1016ef44 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:27.889079 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80a8fd-ef68-4f35-b657-5daa1016ef44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:27.889359 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80a8fd-ef68-4f35-b657-5daa1016ef44 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:27.890224 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a80a8fd-ef68-4f35-b657-5daa1016ef44 admin admin] RBAC: Adding query filter params (group.id=fa37380e467347c884df371a191adc53, role.id=d63eb17a7e7d455ea5f2c6696d92978c, scope.project.id=949a39418c3f4e5d83eee096bcff2c25) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:27.890532 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a80a8fd-ef68-4f35-b657-5daa1016ef44 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:27.892432 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a80a8fd-ef68-4f35-b657-5daa1016ef44 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:27.903735 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 198/394] 10.222.0.15 () {56 vars in 1397 bytes} [Mon Nov 29 20:08:27 2021] GET /identity/v3/role_assignments?group.id=fa37380e467347c884df371a191adc53&scope.project.id=949a39418c3f4e5d83eee096bcff2c25&role.id=d63eb17a7e7d455ea5f2c6696d92978c => generated 260 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:28.190624 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20668d89-7392-4f73-a54a-35037360f537 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:28.191086 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20668d89-7392-4f73-a54a-35037360f537 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:28.191477 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20668d89-7392-4f73-a54a-35037360f537 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:28.193957 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 197/395] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:28.201434 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbec5fb-d29f-443d-8747-4d79fc099e5d None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:28.201858 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbec5fb-d29f-443d-8747-4d79fc099e5d None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:28.202228 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbec5fb-d29f-443d-8747-4d79fc099e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:28.224032 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-fcbec5fb-d29f-443d-8747-4d79fc099e5d None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:28.225416 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-fcbec5fb-d29f-443d-8747-4d79fc099e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:28.238965 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 199/396] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:28 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:28.261458 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20668d89-7392-4f73-a54a-35037360f537 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:28.276309 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20668d89-7392-4f73-a54a-35037360f537 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:28.282145 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cea701-9a36-43e3-8c16-4a6d500f31e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:28.283113 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cea701-9a36-43e3-8c16-4a6d500f31e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:28.283489 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cea701-9a36-43e3-8c16-4a6d500f31e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:28.283854 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cea701-9a36-43e3-8c16-4a6d500f31e6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:28.304275 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cea701-9a36-43e3-8c16-4a6d500f31e6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:28.311417 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-35cea701-9a36-43e3-8c16-4a6d500f31e6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 29 20:08:28.312927 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 198/397] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Nov 29 20:08:28 2021] GET /identity/v3/roles/admin => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:28.319421 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbec5fb-d29f-443d-8747-4d79fc099e5d None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:28.328781 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbec5fb-d29f-443d-8747-4d79fc099e5d None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:28.334643 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d3f5ce-6f41-4586-902e-d0a7896798ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:28.335450 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3f5ce-6f41-4586-902e-d0a7896798ed admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:28.335838 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3f5ce-6f41-4586-902e-d0a7896798ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:28.336199 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3f5ce-6f41-4586-902e-d0a7896798ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:28.337097 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d3f5ce-6f41-4586-902e-d0a7896798ed admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:28.337505 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d3f5ce-6f41-4586-902e-d0a7896798ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:28.339233 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d3f5ce-6f41-4586-902e-d0a7896798ed admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:28.353509 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 200/398] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:08:28 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:28.359501 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cea701-9a36-43e3-8c16-4a6d500f31e6 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:28.371532 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cea701-9a36-43e3-8c16-4a6d500f31e6 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:28.376534 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25291f3a-f442-426e-95f3-e4c8eee7c4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:28.377288 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25291f3a-f442-426e-95f3-e4c8eee7c4f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:28.377694 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25291f3a-f442-426e-95f3-e4c8eee7c4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:28.378070 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25291f3a-f442-426e-95f3-e4c8eee7c4f4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:28.389555 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25291f3a-f442-426e-95f3-e4c8eee7c4f4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:28.391581 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25291f3a-f442-426e-95f3-e4c8eee7c4f4 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:28.404549 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 199/399] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:08:28 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:08:28.410705 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d3f5ce-6f41-4586-902e-d0a7896798ed admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:28.420937 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d3f5ce-6f41-4586-902e-d0a7896798ed admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:28.430738 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112372d-02f6-4b67-9333-85ce05de66ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:28.431855 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112372d-02f6-4b67-9333-85ce05de66ae admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:28.432300 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112372d-02f6-4b67-9333-85ce05de66ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:28.432720 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112372d-02f6-4b67-9333-85ce05de66ae admin admin] PATH_INFO: `/v3/projects/2a13adf9036b4a4f9b01aa94a92cd3c3` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:28.434994 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e112372d-02f6-4b67-9333-85ce05de66ae admin admin] RBAC: Authorizing `identity:get_project(project_id=2a13adf9036b4a4f9b01aa94a92cd3c3)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:28.437183 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e112372d-02f6-4b67-9333-85ce05de66ae admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:28.439116 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 201/400] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:08:28 2021] GET /identity/v3/projects/2a13adf9036b4a4f9b01aa94a92cd3c3 => generated 344 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:28.445394 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25291f3a-f442-426e-95f3-e4c8eee7c4f4 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:28.457406 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25291f3a-f442-426e-95f3-e4c8eee7c4f4 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:28.465731 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a6270-d408-43de-8616-56e1236fc629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:28.466788 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a6270-d408-43de-8616-56e1236fc629 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:28.467221 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a6270-d408-43de-8616-56e1236fc629 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:28.467597 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a6270-d408-43de-8616-56e1236fc629 admin admin] PATH_INFO: `/v3/groups/de1227db8c86404087fe80c1a34dbd53` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:28.481473 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a6270-d408-43de-8616-56e1236fc629 admin admin] RBAC: Authorizing `identity:get_group(group_id=de1227db8c86404087fe80c1a34dbd53)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:28.483793 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a6270-d408-43de-8616-56e1236fc629 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:28.485773 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 200/401] 10.222.0.15 () {56 vars in 1201 bytes} [Mon Nov 29 20:08:28 2021] GET /identity/v3/groups/de1227db8c86404087fe80c1a34dbd53 => generated 229 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:28.492087 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112372d-02f6-4b67-9333-85ce05de66ae admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:28.502666 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112372d-02f6-4b67-9333-85ce05de66ae admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:28.512384 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006321b-31e1-4363-a2f4-d250597d98b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:28.513882 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006321b-31e1-4363-a2f4-d250597d98b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:28.514602 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006321b-31e1-4363-a2f4-d250597d98b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:28.515426 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006321b-31e1-4363-a2f4-d250597d98b8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:28.517317 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006321b-31e1-4363-a2f4-d250597d98b8 admin admin] RBAC: Adding query filter params (group.id=de1227db8c86404087fe80c1a34dbd53, role.id=33d95c7861b64f1a95af8a333bd626ea, scope.project.id=2a13adf9036b4a4f9b01aa94a92cd3c3) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:28.518092 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006321b-31e1-4363-a2f4-d250597d98b8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:28.522049 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a006321b-31e1-4363-a2f4-d250597d98b8 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:28.529540 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 202/402] 10.222.0.15 () {56 vars in 1397 bytes} [Mon Nov 29 20:08:28 2021] GET /identity/v3/role_assignments?group.id=de1227db8c86404087fe80c1a34dbd53&scope.project.id=2a13adf9036b4a4f9b01aa94a92cd3c3&role.id=33d95c7861b64f1a95af8a333bd626ea => generated 260 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:29.990836 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d89d6-333a-45f3-90ff-cfd39f5acd05 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:29.991920 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d89d6-333a-45f3-90ff-cfd39f5acd05 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:29.992409 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d89d6-333a-45f3-90ff-cfd39f5acd05 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:29.994638 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 201/403] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:29 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:30.001686 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50d745-eb27-48a3-ad6c-371bcbc0096b None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:30.002535 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50d745-eb27-48a3-ad6c-371bcbc0096b None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:30.003055 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50d745-eb27-48a3-ad6c-371bcbc0096b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:30.027871 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-0c50d745-eb27-48a3-ad6c-371bcbc0096b None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:30.029491 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-0c50d745-eb27-48a3-ad6c-371bcbc0096b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:30.040479 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 203/404] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:30 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 29 20:08:30.072103 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d89d6-333a-45f3-90ff-cfd39f5acd05 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:30.090438 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d89d6-333a-45f3-90ff-cfd39f5acd05 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:30.095331 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515eba5-3d17-4e45-a813-bba17298af05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:30.096401 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515eba5-3d17-4e45-a813-bba17298af05 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:30.096885 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515eba5-3d17-4e45-a813-bba17298af05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:30.097369 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515eba5-3d17-4e45-a813-bba17298af05 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:30.113230 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0515eba5-3d17-4e45-a813-bba17298af05 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:30.120546 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-0515eba5-3d17-4e45-a813-bba17298af05 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 29 20:08:30.121962 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 202/405] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:08:30 2021] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:30.128479 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c50d745-eb27-48a3-ad6c-371bcbc0096b None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:30.138392 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c50d745-eb27-48a3-ad6c-371bcbc0096b None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:30.146552 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a838901a-65a3-4783-8b3e-c4069a6e3f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:30.147551 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838901a-65a3-4783-8b3e-c4069a6e3f43 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:30.148038 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838901a-65a3-4783-8b3e-c4069a6e3f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:30.148512 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838901a-65a3-4783-8b3e-c4069a6e3f43 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:30.149482 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a838901a-65a3-4783-8b3e-c4069a6e3f43 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:30.150010 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a838901a-65a3-4783-8b3e-c4069a6e3f43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:30.151830 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a838901a-65a3-4783-8b3e-c4069a6e3f43 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:30.161388 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 204/406] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Nov 29 20:08:30 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:30.167261 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515eba5-3d17-4e45-a813-bba17298af05 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:30.177933 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515eba5-3d17-4e45-a813-bba17298af05 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:30.182615 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2c625-d2ae-4a10-90c8-94fa171718be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:30.183784 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2c625-d2ae-4a10-90c8-94fa171718be admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:30.184269 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2c625-d2ae-4a10-90c8-94fa171718be admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:30.184742 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2c625-d2ae-4a10-90c8-94fa171718be admin admin] PATH_INFO: `/v3/groups/fa37380e467347c884df371a191adc53` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:30.186162 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad2c625-d2ae-4a10-90c8-94fa171718be admin admin] RBAC: Authorizing `identity:get_group(group_id=fa37380e467347c884df371a191adc53)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:30.188327 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad2c625-d2ae-4a10-90c8-94fa171718be admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:30.190447 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 203/407] 10.222.0.15 () {56 vars in 1201 bytes} [Mon Nov 29 20:08:30 2021] GET /identity/v3/groups/fa37380e467347c884df371a191adc53 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:30.196319 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a838901a-65a3-4783-8b3e-c4069a6e3f43 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:30.206666 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a838901a-65a3-4783-8b3e-c4069a6e3f43 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:30.211387 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adad1e9c-64b0-489e-a116-c30cae0bab2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:30.212507 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad1e9c-64b0-489e-a116-c30cae0bab2f admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:30.212992 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad1e9c-64b0-489e-a116-c30cae0bab2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:30.213466 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adad1e9c-64b0-489e-a116-c30cae0bab2f admin admin] PATH_INFO: `/v3/projects/4facf8265b034e41b65929b2699eb944` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:30.214913 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad1e9c-64b0-489e-a116-c30cae0bab2f admin admin] RBAC: Authorizing `identity:get_project(project_id=4facf8265b034e41b65929b2699eb944)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:30.217222 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adad1e9c-64b0-489e-a116-c30cae0bab2f admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:30.219473 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 205/408] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:08:30 2021] GET /identity/v3/projects/4facf8265b034e41b65929b2699eb944 => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:30.228097 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2c625-d2ae-4a10-90c8-94fa171718be admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:30.238378 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2c625-d2ae-4a10-90c8-94fa171718be admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:30.244641 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d039b6-e06d-43a4-8b59-68694e152180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:30.245777 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d039b6-e06d-43a4-8b59-68694e152180 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:30.246274 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d039b6-e06d-43a4-8b59-68694e152180 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:30.246761 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d039b6-e06d-43a4-8b59-68694e152180 admin admin] PATH_INFO: `/v3/projects/4facf8265b034e41b65929b2699eb944/groups/fa37380e467347c884df371a191adc53/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:30.249062 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d039b6-e06d-43a4-8b59-68694e152180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4facf8265b034e41b65929b2699eb944, group_id=fa37380e467347c884df371a191adc53, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:30.251938 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d039b6-e06d-43a4-8b59-68694e152180 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:30.275434 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 204/409] 10.222.0.15 () {58 vars in 1463 bytes} [Mon Nov 29 20:08:30 2021] PUT /identity/v3/projects/4facf8265b034e41b65929b2699eb944/groups/fa37380e467347c884df371a191adc53/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:08:30.847375 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49536d-00fc-4826-8e69-80b33e5acfdd None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:30.848033 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49536d-00fc-4826-8e69-80b33e5acfdd None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:30.848517 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b49536d-00fc-4826-8e69-80b33e5acfdd None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:30.850983 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 206/410] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:30 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:30.856986 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087175b9-9b7f-4001-b80f-623489a242dc None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:30.857378 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087175b9-9b7f-4001-b80f-623489a242dc None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:30.857656 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087175b9-9b7f-4001-b80f-623489a242dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:30.880756 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-087175b9-9b7f-4001-b80f-623489a242dc None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:30.881993 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-087175b9-9b7f-4001-b80f-623489a242dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:30.965563 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 205/411] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:30 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:31.010365 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49536d-00fc-4826-8e69-80b33e5acfdd None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:31.031162 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b49536d-00fc-4826-8e69-80b33e5acfdd None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:31.036194 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad30fa-1313-4f2b-8506-82e1adad9b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:31.037294 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad30fa-1313-4f2b-8506-82e1adad9b0a admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:31.037975 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad30fa-1313-4f2b-8506-82e1adad9b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:31.038447 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ad30fa-1313-4f2b-8506-82e1adad9b0a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:31.055340 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ad30fa-1313-4f2b-8506-82e1adad9b0a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:31.062879 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-61ad30fa-1313-4f2b-8506-82e1adad9b0a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 29 20:08:31.064680 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 207/412] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:08:31 2021] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:31.070528 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087175b9-9b7f-4001-b80f-623489a242dc None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:31.079987 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087175b9-9b7f-4001-b80f-623489a242dc None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:31.092909 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bec922d-768c-4235-9d4f-9c1f3ffa37c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:31.093594 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec922d-768c-4235-9d4f-9c1f3ffa37c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:31.093871 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec922d-768c-4235-9d4f-9c1f3ffa37c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:31.094142 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bec922d-768c-4235-9d4f-9c1f3ffa37c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:31.094937 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec922d-768c-4235-9d4f-9c1f3ffa37c8 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:31.095237 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec922d-768c-4235-9d4f-9c1f3ffa37c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:31.096830 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bec922d-768c-4235-9d4f-9c1f3ffa37c8 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:31.109666 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 206/413] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Nov 29 20:08:31 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:31.115625 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad30fa-1313-4f2b-8506-82e1adad9b0a admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:31.131071 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ad30fa-1313-4f2b-8506-82e1adad9b0a admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:31.136465 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2331abc-c806-4505-a8f3-118342e49394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:31.137619 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2331abc-c806-4505-a8f3-118342e49394 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:31.138127 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2331abc-c806-4505-a8f3-118342e49394 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:31.138658 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2331abc-c806-4505-a8f3-118342e49394 admin admin] PATH_INFO: `/v3/groups/fa37380e467347c884df371a191adc53` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:31.141140 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2331abc-c806-4505-a8f3-118342e49394 admin admin] RBAC: Authorizing `identity:get_group(group_id=fa37380e467347c884df371a191adc53)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:31.142356 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5d210-5307-4c09-93d7-3b8da7ac3847 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:31.142643 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5d210-5307-4c09-93d7-3b8da7ac3847 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:31.142945 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5d210-5307-4c09-93d7-3b8da7ac3847 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:31.143416 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2331abc-c806-4505-a8f3-118342e49394 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:31.144727 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 207/414] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 29 20:08:31.145327 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 208/415] 10.222.0.15 () {56 vars in 1201 bytes} [Mon Nov 29 20:08:31 2021] GET /identity/v3/groups/fa37380e467347c884df371a191adc53 => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:31.150870 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5b30b-7480-4c99-9e83-e3a0b5975da5 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:31.151172 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5b30b-7480-4c99-9e83-e3a0b5975da5 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:31.151444 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5b30b-7480-4c99-9e83-e3a0b5975da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:31.154204 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2331abc-c806-4505-a8f3-118342e49394 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:31.174536 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2331abc-c806-4505-a8f3-118342e49394 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:31.184672 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601942dc-f4ae-4230-a54a-34cf8fa7f084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:31.185707 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601942dc-f4ae-4230-a54a-34cf8fa7f084 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:31.185986 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601942dc-f4ae-4230-a54a-34cf8fa7f084 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:31.186263 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601942dc-f4ae-4230-a54a-34cf8fa7f084 admin admin] PATH_INFO: `/v3/projects/949a39418c3f4e5d83eee096bcff2c25` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:31.188533 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601942dc-f4ae-4230-a54a-34cf8fa7f084 admin admin] RBAC: Authorizing `identity:get_project(project_id=949a39418c3f4e5d83eee096bcff2c25)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:31.190717 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601942dc-f4ae-4230-a54a-34cf8fa7f084 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:31.191970 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-34b5b30b-7480-4c99-9e83-e3a0b5975da5 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:31.193192 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-34b5b30b-7480-4c99-9e83-e3a0b5975da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:31.194650 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 209/416] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:08:31 2021] GET /identity/v3/projects/949a39418c3f4e5d83eee096bcff2c25 => generated 302 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:31.202386 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601942dc-f4ae-4230-a54a-34cf8fa7f084 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:31.210585 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 208/417] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:31 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:31.216885 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601942dc-f4ae-4230-a54a-34cf8fa7f084 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:31.226676 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c69d8-8960-4858-97ff-f7d97bb2bc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:31.227633 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c69d8-8960-4858-97ff-f7d97bb2bc16 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:31.227915 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c69d8-8960-4858-97ff-f7d97bb2bc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:31.228240 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c69d8-8960-4858-97ff-f7d97bb2bc16 admin admin] PATH_INFO: `/v3/projects/949a39418c3f4e5d83eee096bcff2c25/groups/fa37380e467347c884df371a191adc53/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:31.230348 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95c69d8-8960-4858-97ff-f7d97bb2bc16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=949a39418c3f4e5d83eee096bcff2c25, group_id=fa37380e467347c884df371a191adc53, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:31.233404 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95c69d8-8960-4858-97ff-f7d97bb2bc16 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:31.237209 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5b30b-7480-4c99-9e83-e3a0b5975da5 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:31.253195 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5b30b-7480-4c99-9e83-e3a0b5975da5 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:31.260398 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730fa0b-8c4b-4bed-b902-867b5421d095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:31.261525 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730fa0b-8c4b-4bed-b902-867b5421d095 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:31.261807 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730fa0b-8c4b-4bed-b902-867b5421d095 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:31.262086 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730fa0b-8c4b-4bed-b902-867b5421d095 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:31.266102 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 210/418] 10.222.0.15 () {58 vars in 1463 bytes} [Mon Nov 29 20:08:31 2021] PUT /identity/v3/projects/949a39418c3f4e5d83eee096bcff2c25/groups/fa37380e467347c884df371a191adc53/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:08:31.284297 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730fa0b-8c4b-4bed-b902-867b5421d095 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:31.291820 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-5730fa0b-8c4b-4bed-b902-867b5421d095 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 29 20:08:31.293347 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 209/419] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Nov 29 20:08:31 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:08:31.301905 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c69d8-8960-4858-97ff-f7d97bb2bc16 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:31.331828 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220a081-572b-4b7d-ad28-3adb354a0e87 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:31.332149 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220a081-572b-4b7d-ad28-3adb354a0e87 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:31.332348 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220a081-572b-4b7d-ad28-3adb354a0e87 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:31.334604 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 210/420] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:31.340678 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14be520-bd57-4632-be7f-faede3d84a7b None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:31.340846 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14be520-bd57-4632-be7f-faede3d84a7b None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:31.341129 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14be520-bd57-4632-be7f-faede3d84a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:31.377808 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-e14be520-bd57-4632-be7f-faede3d84a7b None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:31.379131 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-e14be520-bd57-4632-be7f-faede3d84a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:31.381378 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c69d8-8960-4858-97ff-f7d97bb2bc16 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:31.386995 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6c9d8-c732-4d04-8e3d-49e718503f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:31.388126 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6c9d8-c732-4d04-8e3d-49e718503f8a admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:31.388679 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6c9d8-c732-4d04-8e3d-49e718503f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:31.389314 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6c9d8-c732-4d04-8e3d-49e718503f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:31.390410 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e6c9d8-c732-4d04-8e3d-49e718503f8a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:31.390999 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e6c9d8-c732-4d04-8e3d-49e718503f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:31.392086 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 211/421] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:31 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 29 20:08:31.393478 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e6c9d8-c732-4d04-8e3d-49e718503f8a admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:31.402534 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 211/422] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:08:31 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:31.409280 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14be520-bd57-4632-be7f-faede3d84a7b None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:31.419455 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14be520-bd57-4632-be7f-faede3d84a7b None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:31.424558 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d9402-f9f7-41ec-a071-1cf0cc578135 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:31.424872 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d9402-f9f7-41ec-a071-1cf0cc578135 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:31.425169 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d9402-f9f7-41ec-a071-1cf0cc578135 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:31.425616 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046fd97-d3ea-4198-8399-ea1a7792b607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:31.426700 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046fd97-d3ea-4198-8399-ea1a7792b607 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:31.427211 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046fd97-d3ea-4198-8399-ea1a7792b607 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:31.427448 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 212/423] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:31.427920 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046fd97-d3ea-4198-8399-ea1a7792b607 admin admin] PATH_INFO: `/v3/groups/fa37380e467347c884df371a191adc53` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:31.429423 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046fd97-d3ea-4198-8399-ea1a7792b607 admin admin] RBAC: Authorizing `identity:get_group(group_id=fa37380e467347c884df371a191adc53)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:31.431097 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d9402-f9f7-41ec-a071-1cf0cc578135 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:31.432191 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046fd97-d3ea-4198-8399-ea1a7792b607 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:31.439049 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 212/424] 10.222.0.15 () {56 vars in 1201 bytes} [Mon Nov 29 20:08:31 2021] GET /identity/v3/groups/fa37380e467347c884df371a191adc53 => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:31.441063 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45280c-8e47-4de6-b920-9a369183f6be None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:31.441553 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45280c-8e47-4de6-b920-9a369183f6be None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:31.442021 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45280c-8e47-4de6-b920-9a369183f6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:31.456513 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d9402-f9f7-41ec-a071-1cf0cc578135 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:31.461636 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2bb260-c3de-49c2-8032-21190ddb3316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:31.462650 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2bb260-c3de-49c2-8032-21190ddb3316 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:31.463102 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2bb260-c3de-49c2-8032-21190ddb3316 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:31.463389 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2bb260-c3de-49c2-8032-21190ddb3316 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:31.464085 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-cf45280c-8e47-4de6-b920-9a369183f6be None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:31.465822 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-cf45280c-8e47-4de6-b920-9a369183f6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:31.475860 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 213/425] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:31 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:31.479080 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf45280c-8e47-4de6-b920-9a369183f6be None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:31.480588 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2bb260-c3de-49c2-8032-21190ddb3316 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:31.488133 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-fa2bb260-c3de-49c2-8032-21190ddb3316 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 29 20:08:31.489951 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 213/426] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Nov 29 20:08:31 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:31.491131 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf45280c-8e47-4de6-b920-9a369183f6be None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:31.496208 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2bb260-c3de-49c2-8032-21190ddb3316 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:31.499381 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12197c9e-bf20-4476-81c0-f3cb706c92d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:31.500574 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12197c9e-bf20-4476-81c0-f3cb706c92d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:31.501132 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12197c9e-bf20-4476-81c0-f3cb706c92d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:31.501605 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12197c9e-bf20-4476-81c0-f3cb706c92d8 admin admin] PATH_INFO: `/v3/projects/949a39418c3f4e5d83eee096bcff2c25` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:31.507925 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12197c9e-bf20-4476-81c0-f3cb706c92d8 admin admin] RBAC: Authorizing `identity:get_project(project_id=949a39418c3f4e5d83eee096bcff2c25)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:31.510531 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12197c9e-bf20-4476-81c0-f3cb706c92d8 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:31.514649 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2bb260-c3de-49c2-8032-21190ddb3316 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:31.515795 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 214/427] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:08:31 2021] GET /identity/v3/projects/949a39418c3f4e5d83eee096bcff2c25 => generated 302 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:31.521911 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12197c9e-bf20-4476-81c0-f3cb706c92d8 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:31.527410 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093fa9c7-915e-457a-89d0-66e64db307b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:31.528051 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093fa9c7-915e-457a-89d0-66e64db307b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:31.528389 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093fa9c7-915e-457a-89d0-66e64db307b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:31.528665 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093fa9c7-915e-457a-89d0-66e64db307b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:31.530025 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093fa9c7-915e-457a-89d0-66e64db307b1 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:31.530025 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093fa9c7-915e-457a-89d0-66e64db307b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:31.531680 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093fa9c7-915e-457a-89d0-66e64db307b1 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:31.534387 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12197c9e-bf20-4476-81c0-f3cb706c92d8 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:31.540401 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0aa97-be0e-4980-a63d-21a6e4cf7748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:31.541822 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0aa97-be0e-4980-a63d-21a6e4cf7748 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:31.542307 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0aa97-be0e-4980-a63d-21a6e4cf7748 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:31.542779 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0aa97-be0e-4980-a63d-21a6e4cf7748 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:31.543889 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 214/428] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:08:31 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:31.544826 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093fa9c7-915e-457a-89d0-66e64db307b1 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:31.556864 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093fa9c7-915e-457a-89d0-66e64db307b1 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:31.559333 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0aa97-be0e-4980-a63d-21a6e4cf7748 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:31.561559 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9602f5-7279-4aa1-ac94-25eed0b2acbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:31.562492 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9602f5-7279-4aa1-ac94-25eed0b2acbd admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:31.562825 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9602f5-7279-4aa1-ac94-25eed0b2acbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:31.563119 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9602f5-7279-4aa1-ac94-25eed0b2acbd admin admin] PATH_INFO: `/v3/projects/949a39418c3f4e5d83eee096bcff2c25/groups/fa37380e467347c884df371a191adc53/roles/d63eb17a7e7d455ea5f2c6696d92978c` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:31.565456 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9602f5-7279-4aa1-ac94-25eed0b2acbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=949a39418c3f4e5d83eee096bcff2c25, group_id=fa37380e467347c884df371a191adc53, role_id=d63eb17a7e7d455ea5f2c6696d92978c)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:31.569126 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9602f5-7279-4aa1-ac94-25eed0b2acbd admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:31.570491 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-64d0aa97-be0e-4980-a63d-21a6e4cf7748 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 29 20:08:31.572317 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 215/429] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Nov 29 20:08:31 2021] GET /identity/v3/roles/admin => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:31.573398 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0aa97-be0e-4980-a63d-21a6e4cf7748 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:31.587640 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0aa97-be0e-4980-a63d-21a6e4cf7748 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:31.589451 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 215/430] 10.222.0.15 () {58 vars in 1463 bytes} [Mon Nov 29 20:08:31 2021] PUT /identity/v3/projects/949a39418c3f4e5d83eee096bcff2c25/groups/fa37380e467347c884df371a191adc53/roles/d63eb17a7e7d455ea5f2c6696d92978c => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:08:31.590110 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9602f5-7279-4aa1-ac94-25eed0b2acbd admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:31.687790 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318dce22-b9da-4058-b57e-d740a177a6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:31.690227 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318dce22-b9da-4058-b57e-d740a177a6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:31.690520 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318dce22-b9da-4058-b57e-d740a177a6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:31.690795 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318dce22-b9da-4058-b57e-d740a177a6b1 admin admin] PATH_INFO: `/v3/groups/fa37380e467347c884df371a191adc53` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:31.692301 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318dce22-b9da-4058-b57e-d740a177a6b1 admin admin] RBAC: Authorizing `identity:get_group(group_id=fa37380e467347c884df371a191adc53)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:31.695755 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318dce22-b9da-4058-b57e-d740a177a6b1 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:31.701300 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 216/431] 10.222.0.15 () {56 vars in 1201 bytes} [Mon Nov 29 20:08:31 2021] GET /identity/v3/groups/fa37380e467347c884df371a191adc53 => generated 226 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:31.706446 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9602f5-7279-4aa1-ac94-25eed0b2acbd admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:31.707458 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318dce22-b9da-4058-b57e-d740a177a6b1 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:31.720821 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7da51-63d4-4ade-b34f-cc0752789e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:31.721510 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7da51-63d4-4ade-b34f-cc0752789e1e admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:31.723195 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7da51-63d4-4ade-b34f-cc0752789e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:31.723496 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7da51-63d4-4ade-b34f-cc0752789e1e admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:31.724286 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7da51-63d4-4ade-b34f-cc0752789e1e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:31.724696 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318dce22-b9da-4058-b57e-d740a177a6b1 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:31.725043 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7da51-63d4-4ade-b34f-cc0752789e1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:31.728391 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7da51-63d4-4ade-b34f-cc0752789e1e admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:31.734023 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c3212-decb-47a9-9afe-7093fd9dddfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:31.736819 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c3212-decb-47a9-9afe-7093fd9dddfd admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:31.737162 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c3212-decb-47a9-9afe-7093fd9dddfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:31.737441 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c3212-decb-47a9-9afe-7093fd9dddfd admin admin] PATH_INFO: `/v3/projects/4facf8265b034e41b65929b2699eb944` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:31.741457 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c3212-decb-47a9-9afe-7093fd9dddfd admin admin] RBAC: Authorizing `identity:get_project(project_id=4facf8265b034e41b65929b2699eb944)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:31.743935 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c3212-decb-47a9-9afe-7093fd9dddfd admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:31.745726 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 217/432] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:08:31 2021] GET /identity/v3/projects/4facf8265b034e41b65929b2699eb944 => generated 298 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:31.748218 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 216/433] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:08:31 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:31.754977 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c3212-decb-47a9-9afe-7093fd9dddfd admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:31.755995 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7da51-63d4-4ade-b34f-cc0752789e1e admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:31.773868 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7da51-63d4-4ade-b34f-cc0752789e1e admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:31.776880 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c3212-decb-47a9-9afe-7093fd9dddfd admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:31.784296 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5fc3f-0851-49e9-9682-abe8f74b2cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:31.785571 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5fc3f-0851-49e9-9682-abe8f74b2cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:31.786442 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305ffae-c6ed-47a1-b428-a3f712c1d557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:31.787510 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5fc3f-0851-49e9-9682-abe8f74b2cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:31.787853 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5fc3f-0851-49e9-9682-abe8f74b2cf3 admin admin] PATH_INFO: `/v3/groups/de1227db8c86404087fe80c1a34dbd53` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:31.788171 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305ffae-c6ed-47a1-b428-a3f712c1d557 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:31.788992 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305ffae-c6ed-47a1-b428-a3f712c1d557 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:31.789558 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305ffae-c6ed-47a1-b428-a3f712c1d557 admin admin] PATH_INFO: `/v3/projects/4facf8265b034e41b65929b2699eb944/groups/fa37380e467347c884df371a191adc53/roles/d63eb17a7e7d455ea5f2c6696d92978c` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:31.791027 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5fc3f-0851-49e9-9682-abe8f74b2cf3 admin admin] RBAC: Authorizing `identity:get_group(group_id=de1227db8c86404087fe80c1a34dbd53)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:31.794907 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4305ffae-c6ed-47a1-b428-a3f712c1d557 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4facf8265b034e41b65929b2699eb944, group_id=fa37380e467347c884df371a191adc53, role_id=d63eb17a7e7d455ea5f2c6696d92978c)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:31.795320 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5fc3f-0851-49e9-9682-abe8f74b2cf3 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:31.799613 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 217/434] 10.222.0.15 () {56 vars in 1201 bytes} [Mon Nov 29 20:08:31 2021] GET /identity/v3/groups/de1227db8c86404087fe80c1a34dbd53 => generated 229 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:31.800331 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4305ffae-c6ed-47a1-b428-a3f712c1d557 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:31.806460 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5fc3f-0851-49e9-9682-abe8f74b2cf3 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:31.825644 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 218/435] 10.222.0.15 () {58 vars in 1463 bytes} [Mon Nov 29 20:08:31 2021] PUT /identity/v3/projects/4facf8265b034e41b65929b2699eb944/groups/fa37380e467347c884df371a191adc53/roles/d63eb17a7e7d455ea5f2c6696d92978c => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:08:31.826373 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5fc3f-0851-49e9-9682-abe8f74b2cf3 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:31.902395 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300d596-1f2b-4b6c-9842-8e9acdcd0edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:31.903307 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300d596-1f2b-4b6c-9842-8e9acdcd0edd admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:31.903586 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300d596-1f2b-4b6c-9842-8e9acdcd0edd admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:31.903857 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300d596-1f2b-4b6c-9842-8e9acdcd0edd admin admin] PATH_INFO: `/v3/projects/2a13adf9036b4a4f9b01aa94a92cd3c3` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:31.904902 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300d596-1f2b-4b6c-9842-8e9acdcd0edd admin admin] RBAC: Authorizing `identity:get_project(project_id=2a13adf9036b4a4f9b01aa94a92cd3c3)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:31.906785 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300d596-1f2b-4b6c-9842-8e9acdcd0edd admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:31.908995 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 218/436] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:08:31 2021] GET /identity/v3/projects/2a13adf9036b4a4f9b01aa94a92cd3c3 => generated 344 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:31.918287 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305ffae-c6ed-47a1-b428-a3f712c1d557 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:31.928062 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305ffae-c6ed-47a1-b428-a3f712c1d557 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:31.935617 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8236502-c2a0-4945-aa63-65e48f99bf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:31.936577 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8236502-c2a0-4945-aa63-65e48f99bf5b admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:31.936888 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8236502-c2a0-4945-aa63-65e48f99bf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:31.937170 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8236502-c2a0-4945-aa63-65e48f99bf5b admin admin] PATH_INFO: `/v3/projects/2a13adf9036b4a4f9b01aa94a92cd3c3/groups/de1227db8c86404087fe80c1a34dbd53/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:31.939519 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8236502-c2a0-4945-aa63-65e48f99bf5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a13adf9036b4a4f9b01aa94a92cd3c3, group_id=de1227db8c86404087fe80c1a34dbd53, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:31.942465 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8236502-c2a0-4945-aa63-65e48f99bf5b admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:31.960441 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 219/437] 10.222.0.15 () {58 vars in 1463 bytes} [Mon Nov 29 20:08:31 2021] PUT /identity/v3/projects/2a13adf9036b4a4f9b01aa94a92cd3c3/groups/de1227db8c86404087fe80c1a34dbd53/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:08:33.312329 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590717c0-62f5-4530-88ef-555371f2de61 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:33.313031 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590717c0-62f5-4530-88ef-555371f2de61 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:33.313031 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590717c0-62f5-4530-88ef-555371f2de61 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:33.314944 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 219/438] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:33.321522 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc45492-df2d-4a28-9889-f87152e2d8c3 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:33.322163 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc45492-df2d-4a28-9889-f87152e2d8c3 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:33.322163 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc45492-df2d-4a28-9889-f87152e2d8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:33.341131 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-fcc45492-df2d-4a28-9889-f87152e2d8c3 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:33.342373 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-fcc45492-df2d-4a28-9889-f87152e2d8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:33.410292 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 220/439] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:33 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:33.446570 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590717c0-62f5-4530-88ef-555371f2de61 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:33.459005 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590717c0-62f5-4530-88ef-555371f2de61 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:33.467582 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c988c-ad7f-4928-be2b-5974799dae2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:33.468431 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c988c-ad7f-4928-be2b-5974799dae2b admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:33.468710 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c988c-ad7f-4928-be2b-5974799dae2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:33.468983 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c988c-ad7f-4928-be2b-5974799dae2b admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:33.481123 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c988c-ad7f-4928-be2b-5974799dae2b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:33.492504 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-1c7c988c-ad7f-4928-be2b-5974799dae2b admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 29 20:08:33.494176 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 220/440] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:08:33 2021] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:33.500148 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc45492-df2d-4a28-9889-f87152e2d8c3 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:33.516270 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc45492-df2d-4a28-9889-f87152e2d8c3 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:33.526920 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339578ea-b0ae-4510-ac37-9a064a32ab63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:33.527595 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339578ea-b0ae-4510-ac37-9a064a32ab63 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:33.527875 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339578ea-b0ae-4510-ac37-9a064a32ab63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:33.528150 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339578ea-b0ae-4510-ac37-9a064a32ab63 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:33.528920 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339578ea-b0ae-4510-ac37-9a064a32ab63 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:33.529280 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339578ea-b0ae-4510-ac37-9a064a32ab63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:33.530920 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339578ea-b0ae-4510-ac37-9a064a32ab63 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:33.546692 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 221/441] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Nov 29 20:08:33 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:33.552667 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c988c-ad7f-4928-be2b-5974799dae2b admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:33.562726 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c988c-ad7f-4928-be2b-5974799dae2b admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:33.571474 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca37e3ab-b75a-460f-b5b7-9171e108a78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:33.572136 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37e3ab-b75a-460f-b5b7-9171e108a78f admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:33.572424 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37e3ab-b75a-460f-b5b7-9171e108a78f admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:33.572697 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37e3ab-b75a-460f-b5b7-9171e108a78f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:33.581743 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca37e3ab-b75a-460f-b5b7-9171e108a78f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:33.583544 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca37e3ab-b75a-460f-b5b7-9171e108a78f admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:33.596953 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 221/442] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:08:33 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:08:33.602649 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339578ea-b0ae-4510-ac37-9a064a32ab63 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:33.616727 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339578ea-b0ae-4510-ac37-9a064a32ab63 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:33.627240 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902135e-07e7-409e-8fd2-7fdd519e4287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:33.628160 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902135e-07e7-409e-8fd2-7fdd519e4287 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:33.628395 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902135e-07e7-409e-8fd2-7fdd519e4287 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:33.628671 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902135e-07e7-409e-8fd2-7fdd519e4287 admin admin] PATH_INFO: `/v3/projects/4facf8265b034e41b65929b2699eb944` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:33.635622 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902135e-07e7-409e-8fd2-7fdd519e4287 admin admin] RBAC: Authorizing `identity:get_project(project_id=4facf8265b034e41b65929b2699eb944)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:33.638012 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902135e-07e7-409e-8fd2-7fdd519e4287 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:33.639792 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 222/443] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:08:33 2021] GET /identity/v3/projects/4facf8265b034e41b65929b2699eb944 => generated 298 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:33.645757 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca37e3ab-b75a-460f-b5b7-9171e108a78f admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:33.654975 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca37e3ab-b75a-460f-b5b7-9171e108a78f admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:33.666987 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed12a0-604d-407d-be5d-d7ee46157ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:33.667854 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed12a0-604d-407d-be5d-d7ee46157ebe admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:33.668135 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed12a0-604d-407d-be5d-d7ee46157ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:33.668409 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed12a0-604d-407d-be5d-d7ee46157ebe admin admin] PATH_INFO: `/v3/groups/fa37380e467347c884df371a191adc53` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:33.675591 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed12a0-604d-407d-be5d-d7ee46157ebe admin admin] RBAC: Authorizing `identity:get_group(group_id=fa37380e467347c884df371a191adc53)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:33.677512 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed12a0-604d-407d-be5d-d7ee46157ebe admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:33.679536 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 222/444] 10.222.0.15 () {56 vars in 1201 bytes} [Mon Nov 29 20:08:33 2021] GET /identity/v3/groups/fa37380e467347c884df371a191adc53 => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:33.685431 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902135e-07e7-409e-8fd2-7fdd519e4287 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:33.699980 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902135e-07e7-409e-8fd2-7fdd519e4287 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:33.707004 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2694ca5d-85e7-4e4c-9e08-59625c030cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:33.707676 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694ca5d-85e7-4e4c-9e08-59625c030cd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:33.707958 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694ca5d-85e7-4e4c-9e08-59625c030cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:33.708235 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694ca5d-85e7-4e4c-9e08-59625c030cd8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:33.709104 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2694ca5d-85e7-4e4c-9e08-59625c030cd8 admin admin] RBAC: Adding query filter params (group.id=fa37380e467347c884df371a191adc53, role.id=88a0e2c4c85c4449ad4681edcdc57835, scope.project.id=4facf8265b034e41b65929b2699eb944) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:33.709417 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2694ca5d-85e7-4e4c-9e08-59625c030cd8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:33.711344 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2694ca5d-85e7-4e4c-9e08-59625c030cd8 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:33.720265 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 223/445] 10.222.0.15 () {56 vars in 1397 bytes} [Mon Nov 29 20:08:33 2021] GET /identity/v3/role_assignments?group.id=fa37380e467347c884df371a191adc53&scope.project.id=4facf8265b034e41b65929b2699eb944&role.id=88a0e2c4c85c4449ad4681edcdc57835 => generated 611 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:34.334292 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388ba23-d4d5-4521-9fd8-ba1af0040730 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:34.334292 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388ba23-d4d5-4521-9fd8-ba1af0040730 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:34.334292 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388ba23-d4d5-4521-9fd8-ba1af0040730 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:34.334292 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 223/446] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:34.343462 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b65b8-b3b4-4e34-9db6-4c93dca10923 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:34.343462 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b65b8-b3b4-4e34-9db6-4c93dca10923 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:34.343462 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b65b8-b3b4-4e34-9db6-4c93dca10923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:34.365854 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-ce5b65b8-b3b4-4e34-9db6-4c93dca10923 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:34.367138 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-ce5b65b8-b3b4-4e34-9db6-4c93dca10923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:34.378633 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 224/447] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:34.407842 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388ba23-d4d5-4521-9fd8-ba1af0040730 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:34.420342 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388ba23-d4d5-4521-9fd8-ba1af0040730 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:34.428092 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95508c9-3754-44e4-a988-baef798d5c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:34.428946 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95508c9-3754-44e4-a988-baef798d5c97 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:34.429175 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95508c9-3754-44e4-a988-baef798d5c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:34.429453 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95508c9-3754-44e4-a988-baef798d5c97 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:34.443486 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95508c9-3754-44e4-a988-baef798d5c97 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:34.450403 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-b95508c9-3754-44e4-a988-baef798d5c97 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Nov 29 20:08:34.451911 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 224/448] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:08:34 2021] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:34.458417 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b65b8-b3b4-4e34-9db6-4c93dca10923 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:34.469168 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b65b8-b3b4-4e34-9db6-4c93dca10923 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:34.477425 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af3972-2583-4714-801b-cea32be209be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:34.478112 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af3972-2583-4714-801b-cea32be209be admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:34.478390 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af3972-2583-4714-801b-cea32be209be admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:34.478665 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af3972-2583-4714-801b-cea32be209be admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:34.479478 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af3972-2583-4714-801b-cea32be209be admin admin] RBAC: Adding query filter params (name=member) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:34.479782 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af3972-2583-4714-801b-cea32be209be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:34.481391 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af3972-2583-4714-801b-cea32be209be admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:34.494425 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 225/449] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Nov 29 20:08:34 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:34.500408 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95508c9-3754-44e4-a988-baef798d5c97 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:34.511173 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95508c9-3754-44e4-a988-baef798d5c97 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:34.518418 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e059a-ccb3-403c-8827-5a8a566d8c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:34.519353 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e059a-ccb3-403c-8827-5a8a566d8c46 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:34.519812 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e059a-ccb3-403c-8827-5a8a566d8c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:34.520262 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e059a-ccb3-403c-8827-5a8a566d8c46 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:34.535637 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e059a-ccb3-403c-8827-5a8a566d8c46 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:34.537682 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e059a-ccb3-403c-8827-5a8a566d8c46 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:34.549215 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 225/450] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:08:34 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:08:34.555184 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af3972-2583-4714-801b-cea32be209be admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:34.571199 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af3972-2583-4714-801b-cea32be209be admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:34.575911 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa85a64-0129-4ec0-a32d-8b22f6330407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:34.577021 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa85a64-0129-4ec0-a32d-8b22f6330407 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:34.577513 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa85a64-0129-4ec0-a32d-8b22f6330407 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:34.577970 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa85a64-0129-4ec0-a32d-8b22f6330407 admin admin] PATH_INFO: `/v3/projects/949a39418c3f4e5d83eee096bcff2c25` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:34.579377 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa85a64-0129-4ec0-a32d-8b22f6330407 admin admin] RBAC: Authorizing `identity:get_project(project_id=949a39418c3f4e5d83eee096bcff2c25)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:34.581612 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa85a64-0129-4ec0-a32d-8b22f6330407 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:34.588647 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 226/451] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:08:34 2021] GET /identity/v3/projects/949a39418c3f4e5d83eee096bcff2c25 => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:34.590020 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa85a64-0129-4ec0-a32d-8b22f6330407 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:34.590381 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a286e6-cf4e-480e-885e-31eddef27284 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:34.590678 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a286e6-cf4e-480e-885e-31eddef27284 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:34.591036 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a286e6-cf4e-480e-885e-31eddef27284 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:34.592846 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 226/452] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 29 20:08:34.598657 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39d948-065e-458d-986f-fe62669ddf45 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:34.599171 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39d948-065e-458d-986f-fe62669ddf45 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:34.599457 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c39d948-065e-458d-986f-fe62669ddf45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:34.603025 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa85a64-0129-4ec0-a32d-8b22f6330407 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:34.613150 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf4ea1-e4bd-4201-8731-0e55e96ef0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:34.614422 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf4ea1-e4bd-4201-8731-0e55e96ef0f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:34.614945 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf4ea1-e4bd-4201-8731-0e55e96ef0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:34.615425 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf4ea1-e4bd-4201-8731-0e55e96ef0f1 admin admin] PATH_INFO: `/v3/groups/fa37380e467347c884df371a191adc53` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:34.617617 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf4ea1-e4bd-4201-8731-0e55e96ef0f1 admin admin] RBAC: Authorizing `identity:get_group(group_id=fa37380e467347c884df371a191adc53)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:34.620308 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf4ea1-e4bd-4201-8731-0e55e96ef0f1 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:34.626795 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 227/453] 10.222.0.15 () {56 vars in 1201 bytes} [Mon Nov 29 20:08:34 2021] GET /identity/v3/groups/fa37380e467347c884df371a191adc53 => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:34.629012 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-6c39d948-065e-458d-986f-fe62669ddf45 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:34.630718 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf4ea1-e4bd-4201-8731-0e55e96ef0f1 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:34.631723 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-6c39d948-065e-458d-986f-fe62669ddf45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:34.644159 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf4ea1-e4bd-4201-8731-0e55e96ef0f1 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:34.647991 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 227/454] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:34 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 29 20:08:34.649668 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d750c75-a60e-4ee5-9583-ab5b53cf6600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:34.650322 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d750c75-a60e-4ee5-9583-ab5b53cf6600 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:34.650601 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d750c75-a60e-4ee5-9583-ab5b53cf6600 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:34.650922 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d750c75-a60e-4ee5-9583-ab5b53cf6600 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:34.651780 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d750c75-a60e-4ee5-9583-ab5b53cf6600 admin admin] RBAC: Adding query filter params (group.id=fa37380e467347c884df371a191adc53, role.id=88a0e2c4c85c4449ad4681edcdc57835, scope.project.id=949a39418c3f4e5d83eee096bcff2c25) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:34.652076 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d750c75-a60e-4ee5-9583-ab5b53cf6600 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:34.653922 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d750c75-a60e-4ee5-9583-ab5b53cf6600 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:34.667158 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 228/455] 10.222.0.15 () {56 vars in 1397 bytes} [Mon Nov 29 20:08:34 2021] GET /identity/v3/role_assignments?group.id=fa37380e467347c884df371a191adc53&scope.project.id=949a39418c3f4e5d83eee096bcff2c25&role.id=88a0e2c4c85c4449ad4681edcdc57835 => generated 611 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:34.676030 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39d948-065e-458d-986f-fe62669ddf45 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:34.686877 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c39d948-065e-458d-986f-fe62669ddf45 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:34.691661 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e0037-e570-4804-aedb-b0d7a28496a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:34.692616 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e0037-e570-4804-aedb-b0d7a28496a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:34.692899 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e0037-e570-4804-aedb-b0d7a28496a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:34.693173 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373e0037-e570-4804-aedb-b0d7a28496a8 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:34.705894 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373e0037-e570-4804-aedb-b0d7a28496a8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:34.715405 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-373e0037-e570-4804-aedb-b0d7a28496a8 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 29 20:08:34.717155 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 228/456] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Nov 29 20:08:34 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:34.723232 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d750c75-a60e-4ee5-9583-ab5b53cf6600 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:34.739091 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d750c75-a60e-4ee5-9583-ab5b53cf6600 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:34.744410 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d87a7-45cf-4f75-b6aa-db523ce0aa0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:34.745446 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d87a7-45cf-4f75-b6aa-db523ce0aa0d admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:34.745976 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d87a7-45cf-4f75-b6aa-db523ce0aa0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:34.746461 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d87a7-45cf-4f75-b6aa-db523ce0aa0d admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:34.748762 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d87a7-45cf-4f75-b6aa-db523ce0aa0d admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:34.749366 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d87a7-45cf-4f75-b6aa-db523ce0aa0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:34.751308 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4d87a7-45cf-4f75-b6aa-db523ce0aa0d admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:34.762442 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 229/457] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:08:34 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:34.770874 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e0037-e570-4804-aedb-b0d7a28496a8 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:34.785105 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373e0037-e570-4804-aedb-b0d7a28496a8 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:34.793490 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa3092-d9d0-44f0-b1b6-41e44a4ad22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:34.794561 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa3092-d9d0-44f0-b1b6-41e44a4ad22f admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:34.795125 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa3092-d9d0-44f0-b1b6-41e44a4ad22f admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:34.795640 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa3092-d9d0-44f0-b1b6-41e44a4ad22f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:34.807678 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa3092-d9d0-44f0-b1b6-41e44a4ad22f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:34.809868 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa3092-d9d0-44f0-b1b6-41e44a4ad22f admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:34.825092 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 229/458] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:08:34 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:08:34.833995 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d87a7-45cf-4f75-b6aa-db523ce0aa0d admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:34.844732 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4d87a7-45cf-4f75-b6aa-db523ce0aa0d admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:34.849692 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f27e86-f938-4855-a40c-a7e3c62eb9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:34.850977 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f27e86-f938-4855-a40c-a7e3c62eb9ba admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:34.851459 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f27e86-f938-4855-a40c-a7e3c62eb9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:34.852001 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f27e86-f938-4855-a40c-a7e3c62eb9ba admin admin] PATH_INFO: `/v3/projects/949a39418c3f4e5d83eee096bcff2c25` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:34.853604 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f27e86-f938-4855-a40c-a7e3c62eb9ba admin admin] RBAC: Authorizing `identity:get_project(project_id=949a39418c3f4e5d83eee096bcff2c25)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:34.856063 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f27e86-f938-4855-a40c-a7e3c62eb9ba admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:34.858495 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 230/459] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:08:34 2021] GET /identity/v3/projects/949a39418c3f4e5d83eee096bcff2c25 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:34.864388 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa3092-d9d0-44f0-b1b6-41e44a4ad22f admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:34.874304 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa3092-d9d0-44f0-b1b6-41e44a4ad22f admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:34.879331 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a30b5a-0150-456c-b9c5-ec450a69e60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:34.880591 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a30b5a-0150-456c-b9c5-ec450a69e60b admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:34.881082 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a30b5a-0150-456c-b9c5-ec450a69e60b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:34.881544 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a30b5a-0150-456c-b9c5-ec450a69e60b admin admin] PATH_INFO: `/v3/groups/fa37380e467347c884df371a191adc53` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:34.883090 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a30b5a-0150-456c-b9c5-ec450a69e60b admin admin] RBAC: Authorizing `identity:get_group(group_id=fa37380e467347c884df371a191adc53)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:34.885450 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a30b5a-0150-456c-b9c5-ec450a69e60b admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:34.888119 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 230/460] 10.222.0.15 () {56 vars in 1201 bytes} [Mon Nov 29 20:08:34 2021] GET /identity/v3/groups/fa37380e467347c884df371a191adc53 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:34.894246 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f27e86-f938-4855-a40c-a7e3c62eb9ba admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:34.905270 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f27e86-f938-4855-a40c-a7e3c62eb9ba admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:34.910265 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd4714a-2f41-4d44-b0f7-9a516e590a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:34.911355 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4714a-2f41-4d44-b0f7-9a516e590a88 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:34.911881 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4714a-2f41-4d44-b0f7-9a516e590a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:34.912348 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd4714a-2f41-4d44-b0f7-9a516e590a88 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:34.913507 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd4714a-2f41-4d44-b0f7-9a516e590a88 admin admin] RBAC: Adding query filter params (group.id=fa37380e467347c884df371a191adc53, role.id=d63eb17a7e7d455ea5f2c6696d92978c, scope.project.id=949a39418c3f4e5d83eee096bcff2c25) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:34.914060 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd4714a-2f41-4d44-b0f7-9a516e590a88 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:34.916241 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd4714a-2f41-4d44-b0f7-9a516e590a88 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:34.923668 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 231/461] 10.222.0.15 () {56 vars in 1397 bytes} [Mon Nov 29 20:08:34 2021] GET /identity/v3/role_assignments?group.id=fa37380e467347c884df371a191adc53&scope.project.id=949a39418c3f4e5d83eee096bcff2c25&role.id=d63eb17a7e7d455ea5f2c6696d92978c => generated 611 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:35.063029 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912a378-1ba1-43e6-87bb-a46f4045ce51 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:35.063717 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912a378-1ba1-43e6-87bb-a46f4045ce51 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:35.064201 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912a378-1ba1-43e6-87bb-a46f4045ce51 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:35.066789 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 231/462] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:35 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:35.073633 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536201ba-d873-4e6e-9570-a7667f2b98fd None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:35.074308 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536201ba-d873-4e6e-9570-a7667f2b98fd None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:35.074775 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536201ba-d873-4e6e-9570-a7667f2b98fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:35.094910 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-536201ba-d873-4e6e-9570-a7667f2b98fd None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:35.096189 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-536201ba-d873-4e6e-9570-a7667f2b98fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:35.105886 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 232/463] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:35 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 29 20:08:35.107825 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c79dad-7c8e-4d4e-8595-97b17089054b None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:35.108183 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c79dad-7c8e-4d4e-8595-97b17089054b None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:35.108528 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c79dad-7c8e-4d4e-8595-97b17089054b None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:35.110510 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 232/464] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:35.117119 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13cad0-8500-4651-b8e0-2cc39c240a77 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:35.117682 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13cad0-8500-4651-b8e0-2cc39c240a77 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:35.118159 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13cad0-8500-4651-b8e0-2cc39c240a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:35.129128 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c79dad-7c8e-4d4e-8595-97b17089054b None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:35.138480 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-ef13cad0-8500-4651-b8e0-2cc39c240a77 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:35.140911 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-ef13cad0-8500-4651-b8e0-2cc39c240a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:35.148103 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c79dad-7c8e-4d4e-8595-97b17089054b None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:35.150407 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 233/465] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:35 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:35.154604 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607059c8-b1a0-4466-b921-fb4f8cf9ea96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:35.155474 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607059c8-b1a0-4466-b921-fb4f8cf9ea96 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:35.155757 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607059c8-b1a0-4466-b921-fb4f8cf9ea96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:35.156034 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607059c8-b1a0-4466-b921-fb4f8cf9ea96 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:35.169147 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607059c8-b1a0-4466-b921-fb4f8cf9ea96 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:35.175203 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13cad0-8500-4651-b8e0-2cc39c240a77 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:35.176816 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-607059c8-b1a0-4466-b921-fb4f8cf9ea96 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 29 20:08:35.178303 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 233/466] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Nov 29 20:08:35 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:08:35.184450 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607059c8-b1a0-4466-b921-fb4f8cf9ea96 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:35.185615 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13cad0-8500-4651-b8e0-2cc39c240a77 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:35.191262 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d530899-bec3-4b2a-acc5-f619788b5153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:35.191798 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d530899-bec3-4b2a-acc5-f619788b5153 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:35.192079 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d530899-bec3-4b2a-acc5-f619788b5153 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:35.192349 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d530899-bec3-4b2a-acc5-f619788b5153 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:35.197141 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607059c8-b1a0-4466-b921-fb4f8cf9ea96 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:35.200080 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377c82e-8917-4001-8639-3787d37accb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:35.200792 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377c82e-8917-4001-8639-3787d37accb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:35.201072 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377c82e-8917-4001-8639-3787d37accb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:35.201439 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377c82e-8917-4001-8639-3787d37accb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:35.202264 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377c82e-8917-4001-8639-3787d37accb9 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:35.202568 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377c82e-8917-4001-8639-3787d37accb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:35.204460 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9377c82e-8917-4001-8639-3787d37accb9 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:35.204772 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d530899-bec3-4b2a-acc5-f619788b5153 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:35.211640 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-6d530899-bec3-4b2a-acc5-f619788b5153 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 29 20:08:35.213059 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 234/467] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Nov 29 20:08:35 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:08:35.214003 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 234/468] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:08:35 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:35.219100 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d530899-bec3-4b2a-acc5-f619788b5153 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:35.221249 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377c82e-8917-4001-8639-3787d37accb9 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:35.230135 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d530899-bec3-4b2a-acc5-f619788b5153 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:35.231250 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9377c82e-8917-4001-8639-3787d37accb9 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:35.235672 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32805c-83fb-472e-8abf-19f39edc3a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:35.236333 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32805c-83fb-472e-8abf-19f39edc3a8a admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:35.236611 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32805c-83fb-472e-8abf-19f39edc3a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:35.236885 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32805c-83fb-472e-8abf-19f39edc3a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:35.237146 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d68e98-1c9e-4b23-b9d6-bebe7f0f937a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:35.237641 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc32805c-83fb-472e-8abf-19f39edc3a8a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:35.237791 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d68e98-1c9e-4b23-b9d6-bebe7f0f937a admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:35.237936 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc32805c-83fb-472e-8abf-19f39edc3a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:35.238075 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d68e98-1c9e-4b23-b9d6-bebe7f0f937a admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:35.238335 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d68e98-1c9e-4b23-b9d6-bebe7f0f937a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:35.240136 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc32805c-83fb-472e-8abf-19f39edc3a8a admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:35.246674 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d68e98-1c9e-4b23-b9d6-bebe7f0f937a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:35.248680 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d68e98-1c9e-4b23-b9d6-bebe7f0f937a admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:35.249546 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 235/469] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:08:35 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:35.255593 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32805c-83fb-472e-8abf-19f39edc3a8a admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:35.260120 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 235/470] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:08:35 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 29 20:08:35.266041 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32805c-83fb-472e-8abf-19f39edc3a8a admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:35.266688 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d68e98-1c9e-4b23-b9d6-bebe7f0f937a admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:35.271314 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c4f74-6a0a-4ce5-9246-246f87306b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:35.272011 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c4f74-6a0a-4ce5-9246-246f87306b44 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:35.272277 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c4f74-6a0a-4ce5-9246-246f87306b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:35.272553 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c4f74-6a0a-4ce5-9246-246f87306b44 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:35.276402 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d68e98-1c9e-4b23-b9d6-bebe7f0f937a admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:35.280700 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c4f74-6a0a-4ce5-9246-246f87306b44 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:35.281702 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ebe39-d220-4652-b5ce-893f2dac4072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:35.282437 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c4f74-6a0a-4ce5-9246-246f87306b44 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:35.282539 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ebe39-d220-4652-b5ce-893f2dac4072 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:35.282816 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ebe39-d220-4652-b5ce-893f2dac4072 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:35.283120 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ebe39-d220-4652-b5ce-893f2dac4072 admin admin] PATH_INFO: `/v3/projects/4facf8265b034e41b65929b2699eb944` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:35.284313 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900ebe39-d220-4652-b5ce-893f2dac4072 admin admin] RBAC: Authorizing `identity:get_project(project_id=4facf8265b034e41b65929b2699eb944)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:35.286338 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900ebe39-d220-4652-b5ce-893f2dac4072 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:35.288205 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 236/471] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:08:35 2021] GET /identity/v3/projects/4facf8265b034e41b65929b2699eb944 => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:35.291344 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 236/472] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:08:35 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 29 20:08:35.294995 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ebe39-d220-4652-b5ce-893f2dac4072 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:35.297096 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c4f74-6a0a-4ce5-9246-246f87306b44 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:35.305129 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ebe39-d220-4652-b5ce-893f2dac4072 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:35.306775 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c4f74-6a0a-4ce5-9246-246f87306b44 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:35.310291 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e0ef1-f6ff-41b8-a843-6539c252a72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:35.311088 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4310c6-671a-4770-a1f9-d4fd1355e112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:35.311239 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e0ef1-f6ff-41b8-a843-6539c252a72c admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:35.311527 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e0ef1-f6ff-41b8-a843-6539c252a72c admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:35.311800 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e0ef1-f6ff-41b8-a843-6539c252a72c admin admin] PATH_INFO: `/v3/groups/fa37380e467347c884df371a191adc53` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:35.311911 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4310c6-671a-4770-a1f9-d4fd1355e112 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:35.312174 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4310c6-671a-4770-a1f9-d4fd1355e112 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:35.312438 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4310c6-671a-4770-a1f9-d4fd1355e112 admin admin] PATH_INFO: `/v3/projects/2a13adf9036b4a4f9b01aa94a92cd3c3` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:35.313049 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e0ef1-f6ff-41b8-a843-6539c252a72c admin admin] RBAC: Authorizing `identity:get_group(group_id=fa37380e467347c884df371a191adc53)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:35.313595 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4310c6-671a-4770-a1f9-d4fd1355e112 admin admin] RBAC: Authorizing `identity:get_project(project_id=2a13adf9036b4a4f9b01aa94a92cd3c3)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:35.314966 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e0ef1-f6ff-41b8-a843-6539c252a72c admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:35.315408 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4310c6-671a-4770-a1f9-d4fd1355e112 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:35.316571 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 237/473] 10.222.0.15 () {56 vars in 1201 bytes} [Mon Nov 29 20:08:35 2021] GET /identity/v3/groups/fa37380e467347c884df371a191adc53 => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:35.317220 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 237/474] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:08:35 2021] GET /identity/v3/projects/2a13adf9036b4a4f9b01aa94a92cd3c3 => generated 344 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:35.322581 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e0ef1-f6ff-41b8-a843-6539c252a72c admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:35.323187 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4310c6-671a-4770-a1f9-d4fd1355e112 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:35.332562 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e0ef1-f6ff-41b8-a843-6539c252a72c admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:35.333060 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4310c6-671a-4770-a1f9-d4fd1355e112 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:35.338775 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726157a-c865-4946-a5e8-1aec043c1066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:35.339469 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726157a-c865-4946-a5e8-1aec043c1066 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:35.339752 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726157a-c865-4946-a5e8-1aec043c1066 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:35.340913 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8faad-9432-42cd-9acc-e9610687c513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:35.341052 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726157a-c865-4946-a5e8-1aec043c1066 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:35.341052 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4726157a-c865-4946-a5e8-1aec043c1066 admin admin] RBAC: Adding query filter params (group.id=fa37380e467347c884df371a191adc53, role.id=d63eb17a7e7d455ea5f2c6696d92978c, scope.project.id=4facf8265b034e41b65929b2699eb944) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:35.341189 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8faad-9432-42cd-9acc-e9610687c513 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:35.341189 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8faad-9432-42cd-9acc-e9610687c513 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:35.341317 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4726157a-c865-4946-a5e8-1aec043c1066 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:35.341394 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b8faad-9432-42cd-9acc-e9610687c513 admin admin] PATH_INFO: `/v3/groups/de1227db8c86404087fe80c1a34dbd53` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:35.342693 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b8faad-9432-42cd-9acc-e9610687c513 admin admin] RBAC: Authorizing `identity:get_group(group_id=de1227db8c86404087fe80c1a34dbd53)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:35.343454 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4726157a-c865-4946-a5e8-1aec043c1066 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:35.345514 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b8faad-9432-42cd-9acc-e9610687c513 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:35.346334 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 238/475] 10.222.0.15 () {56 vars in 1201 bytes} [Mon Nov 29 20:08:35 2021] GET /identity/v3/groups/de1227db8c86404087fe80c1a34dbd53 => generated 229 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:35.349975 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 238/476] 10.222.0.15 () {56 vars in 1397 bytes} [Mon Nov 29 20:08:35 2021] GET /identity/v3/role_assignments?group.id=fa37380e467347c884df371a191adc53&scope.project.id=4facf8265b034e41b65929b2699eb944&role.id=d63eb17a7e7d455ea5f2c6696d92978c => generated 611 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:35.357426 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8faad-9432-42cd-9acc-e9610687c513 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:35.369016 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b8faad-9432-42cd-9acc-e9610687c513 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:35.375161 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55b483-dfa6-427a-92da-efd7e76ae8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:35.376112 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55b483-dfa6-427a-92da-efd7e76ae8bf admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:35.376112 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55b483-dfa6-427a-92da-efd7e76ae8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:35.376389 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55b483-dfa6-427a-92da-efd7e76ae8bf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:35.377218 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af55b483-dfa6-427a-92da-efd7e76ae8bf admin admin] RBAC: Adding query filter params (group.id=de1227db8c86404087fe80c1a34dbd53, role.id=33d95c7861b64f1a95af8a333bd626ea, scope.project.id=2a13adf9036b4a4f9b01aa94a92cd3c3) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:35.377523 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af55b483-dfa6-427a-92da-efd7e76ae8bf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:35.381930 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af55b483-dfa6-427a-92da-efd7e76ae8bf admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:35.386244 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 239/477] 10.222.0.15 () {56 vars in 1397 bytes} [Mon Nov 29 20:08:35 2021] GET /identity/v3/role_assignments?group.id=de1227db8c86404087fe80c1a34dbd53&scope.project.id=2a13adf9036b4a4f9b01aa94a92cd3c3&role.id=33d95c7861b64f1a95af8a333bd626ea => generated 611 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:38.557982 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9b934-7fae-4d21-86d7-3ca37eca0ae7 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:38.558506 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9b934-7fae-4d21-86d7-3ca37eca0ae7 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:38.558506 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9b934-7fae-4d21-86d7-3ca37eca0ae7 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:38.560482 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 239/478] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:38.566236 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14639cde-0d39-468d-b5a0-36c38fbac622 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:38.566655 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14639cde-0d39-468d-b5a0-36c38fbac622 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:38.566796 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14639cde-0d39-468d-b5a0-36c38fbac622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:38.591867 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-14639cde-0d39-468d-b5a0-36c38fbac622 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:38.593283 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-14639cde-0d39-468d-b5a0-36c38fbac622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:38.601340 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 240/479] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:38.619364 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f560839-6879-43b7-a868-c791c7ff834d None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:38.619645 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f560839-6879-43b7-a868-c791c7ff834d None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:38.619918 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f560839-6879-43b7-a868-c791c7ff834d None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:38.621998 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 240/480] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:38.627599 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52155313-32a4-4d76-95e0-7e8285a55033 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:38.627886 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52155313-32a4-4d76-95e0-7e8285a55033 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:38.628163 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52155313-32a4-4d76-95e0-7e8285a55033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:38.635753 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f560839-6879-43b7-a868-c791c7ff834d None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:38.656296 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-52155313-32a4-4d76-95e0-7e8285a55033 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:38.657484 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-52155313-32a4-4d76-95e0-7e8285a55033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:38.659721 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f560839-6879-43b7-a868-c791c7ff834d None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:38.666317 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3084b-3fd5-4881-8937-14c81631994e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:38.667188 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3084b-3fd5-4881-8937-14c81631994e admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:38.667468 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3084b-3fd5-4881-8937-14c81631994e admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:38.667742 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3084b-3fd5-4881-8937-14c81631994e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:38.676925 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 241/481] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:38 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:38.687447 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb3084b-3fd5-4881-8937-14c81631994e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:38.689311 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb3084b-3fd5-4881-8937-14c81631994e admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:38.716986 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-5fb3084b-3fd5-4881-8937-14c81631994e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:08:38.718563 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 241/482] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:38.725046 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52155313-32a4-4d76-95e0-7e8285a55033 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:38.733409 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3084b-3fd5-4881-8937-14c81631994e admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:38.742272 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52155313-32a4-4d76-95e0-7e8285a55033 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:38.748721 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3084b-3fd5-4881-8937-14c81631994e admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:38.752504 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e550329-d88f-41f1-a67f-4e52b5459681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:38.753488 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e550329-d88f-41f1-a67f-4e52b5459681 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:38.753962 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e550329-d88f-41f1-a67f-4e52b5459681 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:38.754444 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e550329-d88f-41f1-a67f-4e52b5459681 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:38.755870 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e550329-d88f-41f1-a67f-4e52b5459681 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:38.757217 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e550329-d88f-41f1-a67f-4e52b5459681 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:38.760095 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e550329-d88f-41f1-a67f-4e52b5459681 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:38.763714 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace3504-ae62-42ff-9299-4df19df161af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:38.764804 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace3504-ae62-42ff-9299-4df19df161af admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:38.765297 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace3504-ae62-42ff-9299-4df19df161af admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:38.765765 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace3504-ae62-42ff-9299-4df19df161af admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:38.784190 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace3504-ae62-42ff-9299-4df19df161af admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:38.786436 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 242/483] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:08:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:38.788562 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ace3504-ae62-42ff-9299-4df19df161af admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:38.792605 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e550329-d88f-41f1-a67f-4e52b5459681 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:38.814746 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e550329-d88f-41f1-a67f-4e52b5459681 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:38.823319 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-5ace3504-ae62-42ff-9299-4df19df161af admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:08:38.827054 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6a068-a108-478f-8598-d6017ef63dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:38.827943 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6a068-a108-478f-8598-d6017ef63dab admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:38.828362 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6a068-a108-478f-8598-d6017ef63dab admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:38.828774 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f6a068-a108-478f-8598-d6017ef63dab admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:38.829636 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f6a068-a108-478f-8598-d6017ef63dab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:38.832067 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f6a068-a108-478f-8598-d6017ef63dab admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:38.834346 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 242/484] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:08:38.840591 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace3504-ae62-42ff-9299-4df19df161af admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:38.852363 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace3504-ae62-42ff-9299-4df19df161af admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:38.858716 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261b1e9-35bc-445d-adda-eac771d19907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:38.859699 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261b1e9-35bc-445d-adda-eac771d19907 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:38.859986 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261b1e9-35bc-445d-adda-eac771d19907 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:38.860283 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261b1e9-35bc-445d-adda-eac771d19907 admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:38.867833 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 243/485] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Nov 29 20:08:38 2021] POST /identity/v3/users => generated 246 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 29 20:08:38.868102 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f261b1e9-35bc-445d-adda-eac771d19907 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:38.868447 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f261b1e9-35bc-445d-adda-eac771d19907 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:38.869551 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING py.warnings [None req-f261b1e9-35bc-445d-adda-eac771d19907 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 29 20:08:38.869551 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: warnings.warn(msg) Nov 29 20:08:38.869551 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: Nov 29 20:08:38.870516 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f261b1e9-35bc-445d-adda-eac771d19907 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:38.890662 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 243/486] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:08:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:38.900104 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6a068-a108-478f-8598-d6017ef63dab admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:38.912311 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f6a068-a108-478f-8598-d6017ef63dab admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:38.917454 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32f348-8310-477b-8488-b53006e62fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:38.918137 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32f348-8310-477b-8488-b53006e62fff admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:38.918419 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32f348-8310-477b-8488-b53006e62fff admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:38.918693 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32f348-8310-477b-8488-b53006e62fff admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:38.919448 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a32f348-8310-477b-8488-b53006e62fff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:38.921386 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a32f348-8310-477b-8488-b53006e62fff admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:38.950155 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 244/487] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Nov 29 20:08:38 2021] POST /identity/v3/users => generated 248 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:08:39.088669 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee008e5b-2fae-4bdd-becf-34f89021e077 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:39.089032 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee008e5b-2fae-4bdd-becf-34f89021e077 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:39.089209 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee008e5b-2fae-4bdd-becf-34f89021e077 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:39.091128 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 244/488] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:39.097512 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3852923-c452-49bc-9bd0-127dc5189eaa None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:39.097793 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3852923-c452-49bc-9bd0-127dc5189eaa None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:39.098115 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3852923-c452-49bc-9bd0-127dc5189eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:39.124261 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-a3852923-c452-49bc-9bd0-127dc5189eaa None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:39.125518 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-a3852923-c452-49bc-9bd0-127dc5189eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:39.133964 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 245/489] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:39 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:39.152340 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2274a-d850-4140-9757-3c41d579ebc5 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:39.152672 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2274a-d850-4140-9757-3c41d579ebc5 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:39.152868 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2274a-d850-4140-9757-3c41d579ebc5 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:39.154759 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 245/490] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:39.172530 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2274a-d850-4140-9757-3c41d579ebc5 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:39.175156 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbebe3-c9d7-40d0-9f68-46fb9e8161a7 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:39.175441 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbebe3-c9d7-40d0-9f68-46fb9e8161a7 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:39.175714 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbebe3-c9d7-40d0-9f68-46fb9e8161a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:39.193323 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2274a-d850-4140-9757-3c41d579ebc5 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:39.203517 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9cd2b9-1ce8-4754-8d8d-18ce12c90891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:39.204332 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cd2b9-1ce8-4754-8d8d-18ce12c90891 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:39.204606 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cd2b9-1ce8-4754-8d8d-18ce12c90891 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:39.204873 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cd2b9-1ce8-4754-8d8d-18ce12c90891 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:39.208593 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-42cbebe3-c9d7-40d0-9f68-46fb9e8161a7 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:39.210282 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-42cbebe3-c9d7-40d0-9f68-46fb9e8161a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:39.220521 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 246/491] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:39 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:39.220817 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9cd2b9-1ce8-4754-8d8d-18ce12c90891 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:39.222740 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9cd2b9-1ce8-4754-8d8d-18ce12c90891 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:39.245731 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-5d9cd2b9-1ce8-4754-8d8d-18ce12c90891 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:08:39.248128 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cbebe3-c9d7-40d0-9f68-46fb9e8161a7 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:39.249000 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 246/492] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:39.256152 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9cd2b9-1ce8-4754-8d8d-18ce12c90891 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:39.259391 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cbebe3-c9d7-40d0-9f68-46fb9e8161a7 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:39.265701 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9046369-2534-45a5-bfb5-194b59b47afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:39.267048 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9046369-2534-45a5-bfb5-194b59b47afd admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:39.267750 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9046369-2534-45a5-bfb5-194b59b47afd admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:39.268269 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9046369-2534-45a5-bfb5-194b59b47afd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:39.269501 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9cd2b9-1ce8-4754-8d8d-18ce12c90891 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:39.274895 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef94e2-c8ba-4c4a-934f-157eac43e801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:39.275661 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef94e2-c8ba-4c4a-934f-157eac43e801 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:39.275942 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef94e2-c8ba-4c4a-934f-157eac43e801 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:39.276209 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef94e2-c8ba-4c4a-934f-157eac43e801 admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:39.277050 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef94e2-c8ba-4c4a-934f-157eac43e801 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:39.277346 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef94e2-c8ba-4c4a-934f-157eac43e801 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:39.279641 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef94e2-c8ba-4c4a-934f-157eac43e801 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:39.283306 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9046369-2534-45a5-bfb5-194b59b47afd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:39.285549 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9046369-2534-45a5-bfb5-194b59b47afd admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:39.294184 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 247/493] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:08:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:39.300434 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef94e2-c8ba-4c4a-934f-157eac43e801 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:39.309952 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-b9046369-2534-45a5-bfb5-194b59b47afd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:08:39.311265 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef94e2-c8ba-4c4a-934f-157eac43e801 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:39.312040 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 247/494] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:08:39.316455 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b899bd9-bbdb-4082-9626-ebc8c007e662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:39.317153 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b899bd9-bbdb-4082-9626-ebc8c007e662 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:39.317436 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b899bd9-bbdb-4082-9626-ebc8c007e662 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:39.317711 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b899bd9-bbdb-4082-9626-ebc8c007e662 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:39.318430 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b899bd9-bbdb-4082-9626-ebc8c007e662 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:39.318766 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9046369-2534-45a5-bfb5-194b59b47afd admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:39.320424 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b899bd9-bbdb-4082-9626-ebc8c007e662 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:39.329266 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9046369-2534-45a5-bfb5-194b59b47afd admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:39.335378 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e494d53-5fd4-46f0-8318-efa19113d782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:39.336298 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e494d53-5fd4-46f0-8318-efa19113d782 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:39.336604 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e494d53-5fd4-46f0-8318-efa19113d782 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:39.336854 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e494d53-5fd4-46f0-8318-efa19113d782 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:39.337654 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e494d53-5fd4-46f0-8318-efa19113d782 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:39.337987 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e494d53-5fd4-46f0-8318-efa19113d782 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:39.340504 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e494d53-5fd4-46f0-8318-efa19113d782 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:39.346435 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 248/495] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Nov 29 20:08:39 2021] POST /identity/v3/users => generated 248 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:08:39.357397 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 248/496] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:08:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:39.363598 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b899bd9-bbdb-4082-9626-ebc8c007e662 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:39.374604 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b899bd9-bbdb-4082-9626-ebc8c007e662 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:39.379714 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a71764-a36a-4af2-b89e-876c0e545122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:39.380642 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a71764-a36a-4af2-b89e-876c0e545122 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:39.381116 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a71764-a36a-4af2-b89e-876c0e545122 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:39.381529 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a71764-a36a-4af2-b89e-876c0e545122 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:39.382473 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a71764-a36a-4af2-b89e-876c0e545122 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:39.384840 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a71764-a36a-4af2-b89e-876c0e545122 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:39.413606 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 249/497] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Nov 29 20:08:39 2021] POST /identity/v3/users => generated 249 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 29 20:08:40.404481 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747e9e3-d122-46eb-96f7-ccb004c822da None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:40.405451 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747e9e3-d122-46eb-96f7-ccb004c822da None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:40.405923 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747e9e3-d122-46eb-96f7-ccb004c822da None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:40.408187 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 249/498] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:40 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:40.413829 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52654a61-5d91-47b8-a122-892451cddb0d None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:40.414776 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52654a61-5d91-47b8-a122-892451cddb0d None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:40.415258 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52654a61-5d91-47b8-a122-892451cddb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:40.433379 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-52654a61-5d91-47b8-a122-892451cddb0d None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:40.434959 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-52654a61-5d91-47b8-a122-892451cddb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:40.448994 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 250/499] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:40 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 29 20:08:40.484349 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747e9e3-d122-46eb-96f7-ccb004c822da None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:40.503635 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747e9e3-d122-46eb-96f7-ccb004c822da None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:40.508602 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af18c7-bdd8-4360-83a6-dc411e10a812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:40.509534 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af18c7-bdd8-4360-83a6-dc411e10a812 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:40.510006 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af18c7-bdd8-4360-83a6-dc411e10a812 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:40.510469 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af18c7-bdd8-4360-83a6-dc411e10a812 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:40.511464 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af18c7-bdd8-4360-83a6-dc411e10a812 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:40.513601 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af18c7-bdd8-4360-83a6-dc411e10a812 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:40.525851 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.sql.core [None req-03af18c7-bdd8-4360-83a6-dc411e10a812 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Nov 29 20:08:40.525851 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Nov 29 20:08:40.525851 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [parameters: {'id': 'df28d4ae1e754bbf9aa59ecdbd6c5e97', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Nov 29 20:08:40.525851 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79167) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 29 20:08:40.540709 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-03af18c7-bdd8-4360-83a6-dc411e10a812 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Nov 29 20:08:40.542335 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 250/500] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:08:40 2021] POST /identity/v3/roles => generated 144 bytes in 59 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:40.548998 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52654a61-5d91-47b8-a122-892451cddb0d None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:40.558581 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52654a61-5d91-47b8-a122-892451cddb0d None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:40.566917 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a3d425-545b-43b0-b634-969203530507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:40.568102 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3d425-545b-43b0-b634-969203530507 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:40.568631 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3d425-545b-43b0-b634-969203530507 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:40.569092 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a3d425-545b-43b0-b634-969203530507 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:40.580855 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a3d425-545b-43b0-b634-969203530507 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:40.592772 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-65a3d425-545b-43b0-b634-969203530507 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Nov 29 20:08:40.594740 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 251/501] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Nov 29 20:08:40 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:40.600611 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af18c7-bdd8-4360-83a6-dc411e10a812 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:40.612327 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af18c7-bdd8-4360-83a6-dc411e10a812 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:40.622897 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5842b-4fc9-40fe-93dd-49acb895bb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:40.623623 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5842b-4fc9-40fe-93dd-49acb895bb6a admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:40.623907 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5842b-4fc9-40fe-93dd-49acb895bb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:40.624179 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5842b-4fc9-40fe-93dd-49acb895bb6a admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:40.624965 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5842b-4fc9-40fe-93dd-49acb895bb6a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:40.625267 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5842b-4fc9-40fe-93dd-49acb895bb6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:40.626948 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c5842b-4fc9-40fe-93dd-49acb895bb6a admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:40.642809 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 251/502] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:08:40 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:41.905479 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05650c2f-058b-4dfc-a75f-cdadb9ec87f5 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:41.905998 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05650c2f-058b-4dfc-a75f-cdadb9ec87f5 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:41.905998 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05650c2f-058b-4dfc-a75f-cdadb9ec87f5 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:41.908113 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 252/503] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:41.914035 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1944c4-2cf4-45a2-aba2-c0ac11b6f799 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:41.914503 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1944c4-2cf4-45a2-aba2-c0ac11b6f799 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:41.914575 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1944c4-2cf4-45a2-aba2-c0ac11b6f799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:41.944169 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-3c1944c4-2cf4-45a2-aba2-c0ac11b6f799 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:41.945431 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-3c1944c4-2cf4-45a2-aba2-c0ac11b6f799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:41.953719 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 252/504] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:41 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 29 20:08:41.969876 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396f70e-cc26-46ad-9713-63ba5b61ff58 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:41.970181 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396f70e-cc26-46ad-9713-63ba5b61ff58 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:41.970434 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396f70e-cc26-46ad-9713-63ba5b61ff58 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:41.972472 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 253/505] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:41.982071 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1944c4-2cf4-45a2-aba2-c0ac11b6f799 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:41.990117 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21c699-5ff8-43c9-bbfa-2d1b11e735dd None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:41.990399 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21c699-5ff8-43c9-bbfa-2d1b11e735dd None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:41.990673 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21c699-5ff8-43c9-bbfa-2d1b11e735dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:42.000678 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1944c4-2cf4-45a2-aba2-c0ac11b6f799 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:42.012680 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-de21c699-5ff8-43c9-bbfa-2d1b11e735dd None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:42.013865 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-de21c699-5ff8-43c9-bbfa-2d1b11e735dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:42.017188 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0f097-c521-48c7-a8c2-5ac651dd1b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:42.018000 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0f097-c521-48c7-a8c2-5ac651dd1b54 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:42.018279 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0f097-c521-48c7-a8c2-5ac651dd1b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:42.018551 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0f097-c521-48c7-a8c2-5ac651dd1b54 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:42.036260 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 254/506] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:41 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:42.036867 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d0f097-c521-48c7-a8c2-5ac651dd1b54 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:42.043820 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-d2d0f097-c521-48c7-a8c2-5ac651dd1b54 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 29 20:08:42.045261 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 253/507] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Nov 29 20:08:41 2021] GET /identity/v3/roles/service => generated 85 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:42.051472 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21c699-5ff8-43c9-bbfa-2d1b11e735dd None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:42.063812 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21c699-5ff8-43c9-bbfa-2d1b11e735dd None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:42.071466 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed8e91-14c8-4baa-828a-37051de54fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:42.072136 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed8e91-14c8-4baa-828a-37051de54fff admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:42.072412 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed8e91-14c8-4baa-828a-37051de54fff admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:42.072685 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed8e91-14c8-4baa-828a-37051de54fff admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:42.073458 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed8e91-14c8-4baa-828a-37051de54fff admin admin] RBAC: Adding query filter params (name=service) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:42.073760 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed8e91-14c8-4baa-828a-37051de54fff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:42.075413 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed8e91-14c8-4baa-828a-37051de54fff admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:42.084610 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 255/508] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Nov 29 20:08:42 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:42.089171 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0f097-c521-48c7-a8c2-5ac651dd1b54 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:42.099190 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0f097-c521-48c7-a8c2-5ac651dd1b54 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:42.100684 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed8e91-14c8-4baa-828a-37051de54fff admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:42.111291 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c522e1-330b-4063-a6ee-0028eaa027f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:42.112084 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c522e1-330b-4063-a6ee-0028eaa027f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:42.112348 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c522e1-330b-4063-a6ee-0028eaa027f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:42.112612 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c522e1-330b-4063-a6ee-0028eaa027f8 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:42.116647 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed8e91-14c8-4baa-828a-37051de54fff admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:42.129898 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b2c4f-2967-447c-97ad-c9ff972b265a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:42.130702 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b2c4f-2967-447c-97ad-c9ff972b265a admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:42.131039 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b2c4f-2967-447c-97ad-c9ff972b265a admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:42.131312 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b2c4f-2967-447c-97ad-c9ff972b265a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:42.135466 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c522e1-330b-4063-a6ee-0028eaa027f8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:42.145851 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-e5c522e1-330b-4063-a6ee-0028eaa027f8 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 29 20:08:42.147099 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 254/509] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Nov 29 20:08:42 2021] GET /identity/v3/roles/service => generated 85 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:42.153354 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c522e1-330b-4063-a6ee-0028eaa027f8 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:42.160011 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b2c4f-2967-447c-97ad-c9ff972b265a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:42.161864 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b2c4f-2967-447c-97ad-c9ff972b265a admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:42.163403 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c522e1-330b-4063-a6ee-0028eaa027f8 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:42.168046 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae1d85f-6feb-4604-938f-c6e3d0885d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:42.168699 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1d85f-6feb-4604-938f-c6e3d0885d04 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:42.169033 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1d85f-6feb-4604-938f-c6e3d0885d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:42.169490 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1d85f-6feb-4604-938f-c6e3d0885d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:42.170048 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae1d85f-6feb-4604-938f-c6e3d0885d04 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:42.170392 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae1d85f-6feb-4604-938f-c6e3d0885d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:42.172130 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae1d85f-6feb-4604-938f-c6e3d0885d04 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:42.180937 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 255/510] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Nov 29 20:08:42 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:42.186826 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae1d85f-6feb-4604-938f-c6e3d0885d04 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:42.192814 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-ca0b2c4f-2967-447c-97ad-c9ff972b265a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:08:42.196771 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae1d85f-6feb-4604-938f-c6e3d0885d04 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:42.198952 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 256/511] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:42.200528 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b2c4f-2967-447c-97ad-c9ff972b265a admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:42.201759 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0be39-601f-4a19-a840-2ce7a7d730e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:42.202594 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0be39-601f-4a19-a840-2ce7a7d730e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:42.202894 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0be39-601f-4a19-a840-2ce7a7d730e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:42.203260 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0be39-601f-4a19-a840-2ce7a7d730e6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:42.214960 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0be39-601f-4a19-a840-2ce7a7d730e6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:42.216866 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0be39-601f-4a19-a840-2ce7a7d730e6 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:42.217380 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b2c4f-2967-447c-97ad-c9ff972b265a admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:42.231462 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd900b-7226-4d39-a18a-eae948b642b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:42.232121 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd900b-7226-4d39-a18a-eae948b642b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:42.232403 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd900b-7226-4d39-a18a-eae948b642b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:42.232673 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd900b-7226-4d39-a18a-eae948b642b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:42.233471 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd900b-7226-4d39-a18a-eae948b642b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:42.233770 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd900b-7226-4d39-a18a-eae948b642b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:42.234231 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-0ad0be39-601f-4a19-a840-2ce7a7d730e6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:08:42.235388 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd900b-7226-4d39-a18a-eae948b642b2 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:42.235774 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 256/512] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:42.241510 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0be39-601f-4a19-a840-2ce7a7d730e6 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:42.250996 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0be39-601f-4a19-a840-2ce7a7d730e6 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:42.255356 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 257/513] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:08:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:42.255544 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e129a7b-12f7-4a00-a1dc-4d6a23a3ef40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:42.256027 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e129a7b-12f7-4a00-a1dc-4d6a23a3ef40 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:42.256305 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e129a7b-12f7-4a00-a1dc-4d6a23a3ef40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:42.256576 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e129a7b-12f7-4a00-a1dc-4d6a23a3ef40 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:42.257367 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e129a7b-12f7-4a00-a1dc-4d6a23a3ef40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:42.257672 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e129a7b-12f7-4a00-a1dc-4d6a23a3ef40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:42.259290 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e129a7b-12f7-4a00-a1dc-4d6a23a3ef40 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:42.263275 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd900b-7226-4d39-a18a-eae948b642b2 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:42.272547 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 257/514] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:08:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:42.278304 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e129a7b-12f7-4a00-a1dc-4d6a23a3ef40 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:42.284994 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd900b-7226-4d39-a18a-eae948b642b2 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:42.287923 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e129a7b-12f7-4a00-a1dc-4d6a23a3ef40 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:42.292418 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59236d01-07ee-4e90-9a90-d28dcb7f3a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:42.292664 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcbd996-ec5a-4f72-93bf-9b0842bd3d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:42.293169 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59236d01-07ee-4e90-9a90-d28dcb7f3a85 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:42.293342 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbd996-ec5a-4f72-93bf-9b0842bd3d24 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:42.293534 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59236d01-07ee-4e90-9a90-d28dcb7f3a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:42.293695 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbd996-ec5a-4f72-93bf-9b0842bd3d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:42.293858 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59236d01-07ee-4e90-9a90-d28dcb7f3a85 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:42.294000 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbd996-ec5a-4f72-93bf-9b0842bd3d24 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:42.308196 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59236d01-07ee-4e90-9a90-d28dcb7f3a85 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:42.310272 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcbd996-ec5a-4f72-93bf-9b0842bd3d24 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:42.312574 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcbd996-ec5a-4f72-93bf-9b0842bd3d24 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:42.313817 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59236d01-07ee-4e90-9a90-d28dcb7f3a85 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:42.341066 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-59236d01-07ee-4e90-9a90-d28dcb7f3a85 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 29 20:08:42.342431 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 258/515] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:08:42 2021] GET /identity/v3/users/glance => generated 84 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:08:42.344252 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-bdcbd996-ec5a-4f72-93bf-9b0842bd3d24 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 29 20:08:42.345754 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 258/516] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Nov 29 20:08:42 2021] GET /identity/v3/users/nova => generated 82 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:08:42.348250 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5ae8e-0acb-49ca-94aa-2e5a01f3c68b None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:42.350175 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5ae8e-0acb-49ca-94aa-2e5a01f3c68b None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:42.350175 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5ae8e-0acb-49ca-94aa-2e5a01f3c68b None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:42.351443 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 259/517] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:42.351576 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcbd996-ec5a-4f72-93bf-9b0842bd3d24 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:42.352594 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5ae8e-0acb-49ca-94aa-2e5a01f3c68b None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:42.362072 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcbd996-ec5a-4f72-93bf-9b0842bd3d24 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:42.365550 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5ae8e-0acb-49ca-94aa-2e5a01f3c68b None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:42.367241 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6b53a-0014-4158-81dc-94e23761cdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:42.368011 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6b53a-0014-4158-81dc-94e23761cdee admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:42.368389 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6b53a-0014-4158-81dc-94e23761cdee admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:42.368763 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6b53a-0014-4158-81dc-94e23761cdee admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:42.369868 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6b53a-0014-4158-81dc-94e23761cdee admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:42.370257 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6b53a-0014-4158-81dc-94e23761cdee admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:42.370365 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba6237-c9f7-4cf1-b6f8-84305a985464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:42.371147 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba6237-c9f7-4cf1-b6f8-84305a985464 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:42.371424 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba6237-c9f7-4cf1-b6f8-84305a985464 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:42.371523 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING py.warnings [None req-3db6b53a-0014-4158-81dc-94e23761cdee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 29 20:08:42.371523 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: warnings.warn(msg) Nov 29 20:08:42.371523 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: Nov 29 20:08:42.371692 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba6237-c9f7-4cf1-b6f8-84305a985464 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:42.372564 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba6237-c9f7-4cf1-b6f8-84305a985464 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:42.372867 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba6237-c9f7-4cf1-b6f8-84305a985464 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:42.372968 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6b53a-0014-4158-81dc-94e23761cdee admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:42.374295 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING py.warnings [None req-afba6237-c9f7-4cf1-b6f8-84305a985464 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 29 20:08:42.374295 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: warnings.warn(msg) Nov 29 20:08:42.374295 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: Nov 29 20:08:42.375462 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba6237-c9f7-4cf1-b6f8-84305a985464 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:42.411298 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 259/518] 10.222.0.15 () {56 vars in 1154 bytes} [Mon Nov 29 20:08:42 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:42.412460 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786d3dd-f2c8-4b3d-b90d-c3cf9c4f7324 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:42.413494 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 260/519] 10.222.0.15 () {56 vars in 1158 bytes} [Mon Nov 29 20:08:42 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:42.417706 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786d3dd-f2c8-4b3d-b90d-c3cf9c4f7324 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:42.418337 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786d3dd-f2c8-4b3d-b90d-c3cf9c4f7324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:42.419214 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba6237-c9f7-4cf1-b6f8-84305a985464 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:42.429613 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba6237-c9f7-4cf1-b6f8-84305a985464 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:42.434516 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe19d66-5ece-4979-9f15-7941ea35b74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:42.435272 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe19d66-5ece-4979-9f15-7941ea35b74e admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:42.435551 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe19d66-5ece-4979-9f15-7941ea35b74e admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:42.435875 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe19d66-5ece-4979-9f15-7941ea35b74e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:42.441254 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-4786d3dd-f2c8-4b3d-b90d-c3cf9c4f7324 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:42.442481 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-4786d3dd-f2c8-4b3d-b90d-c3cf9c4f7324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:42.445134 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe19d66-5ece-4979-9f15-7941ea35b74e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:42.447016 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe19d66-5ece-4979-9f15-7941ea35b74e admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:42.450231 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 260/520] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:42 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:42.450825 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786d3dd-f2c8-4b3d-b90d-c3cf9c4f7324 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:42.461241 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 261/521] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:08:42 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:08:42.462746 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554de52-23d8-4f09-9263-2f9bf7460c63 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:42.463276 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554de52-23d8-4f09-9263-2f9bf7460c63 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:42.463742 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554de52-23d8-4f09-9263-2f9bf7460c63 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:42.465589 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 262/522] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:42.466585 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554de52-23d8-4f09-9263-2f9bf7460c63 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:42.469107 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4786d3dd-f2c8-4b3d-b90d-c3cf9c4f7324 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:42.473811 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ed158-2859-4028-9edd-7c599abb82e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:42.474795 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ed158-2859-4028-9edd-7c599abb82e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:42.475215 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ed158-2859-4028-9edd-7c599abb82e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:42.475561 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ed158-2859-4028-9edd-7c599abb82e5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:42.480885 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554de52-23d8-4f09-9263-2f9bf7460c63 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:42.484826 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ed158-2859-4028-9edd-7c599abb82e5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:42.485631 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3be3fd-cc0b-48ce-b5ed-6f689fd49b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:42.486595 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3be3fd-cc0b-48ce-b5ed-6f689fd49b6c admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:42.486699 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ed158-2859-4028-9edd-7c599abb82e5 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:42.487156 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3be3fd-cc0b-48ce-b5ed-6f689fd49b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:42.487605 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3be3fd-cc0b-48ce-b5ed-6f689fd49b6c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:42.495252 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 261/523] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:08:42 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:08:42.496434 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1692c8-2d67-4b5a-9e52-8a6dda815936 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:42.496719 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1692c8-2d67-4b5a-9e52-8a6dda815936 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:42.496995 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1692c8-2d67-4b5a-9e52-8a6dda815936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:42.499207 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3be3fd-cc0b-48ce-b5ed-6f689fd49b6c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:42.501649 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3be3fd-cc0b-48ce-b5ed-6f689fd49b6c admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:42.514902 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-cf1692c8-2d67-4b5a-9e52-8a6dda815936 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:42.516094 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-cf1692c8-2d67-4b5a-9e52-8a6dda815936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:42.521447 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-ae3be3fd-cc0b-48ce-b5ed-6f689fd49b6c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:08:42.523333 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 263/524] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:08:42.523741 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 262/525] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:42 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:42.524498 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3be3fd-cc0b-48ce-b5ed-6f689fd49b6c admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:42.524602 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1692c8-2d67-4b5a-9e52-8a6dda815936 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:42.533653 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1692c8-2d67-4b5a-9e52-8a6dda815936 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:42.540301 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7907cf-e2f6-47cd-abda-49febd04c837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:42.541385 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7907cf-e2f6-47cd-abda-49febd04c837 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:42.541491 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3be3fd-cc0b-48ce-b5ed-6f689fd49b6c admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:42.542090 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7907cf-e2f6-47cd-abda-49febd04c837 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:42.542660 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7907cf-e2f6-47cd-abda-49febd04c837 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:42.545985 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8f384-4cfd-458d-a4be-b1f4708da426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:42.546834 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8f384-4cfd-458d-a4be-b1f4708da426 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:42.547215 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8f384-4cfd-458d-a4be-b1f4708da426 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:42.547562 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8f384-4cfd-458d-a4be-b1f4708da426 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:42.555328 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7907cf-e2f6-47cd-abda-49febd04c837 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:42.557450 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7907cf-e2f6-47cd-abda-49febd04c837 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:42.557790 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c8f384-4cfd-458d-a4be-b1f4708da426 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:42.564692 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-f3c8f384-4cfd-458d-a4be-b1f4708da426 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 29 20:08:42.565875 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 264/526] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Nov 29 20:08:42 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:42.566631 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8f384-4cfd-458d-a4be-b1f4708da426 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:42.576515 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8f384-4cfd-458d-a4be-b1f4708da426 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:42.579018 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-8a7907cf-e2f6-47cd-abda-49febd04c837 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:08:42.580577 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 263/527] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:42.581502 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7907cf-e2f6-47cd-abda-49febd04c837 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:42.581618 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53888b1-9392-476d-8cd5-3b198b649ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:42.582153 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53888b1-9392-476d-8cd5-3b198b649ded admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:42.582439 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53888b1-9392-476d-8cd5-3b198b649ded admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:42.582783 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53888b1-9392-476d-8cd5-3b198b649ded admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:42.583643 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53888b1-9392-476d-8cd5-3b198b649ded admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:42.584012 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53888b1-9392-476d-8cd5-3b198b649ded admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:42.585717 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53888b1-9392-476d-8cd5-3b198b649ded admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:42.591256 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7907cf-e2f6-47cd-abda-49febd04c837 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:42.595632 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59392a9b-6e69-43f1-b0b6-736a5f71811e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:42.596386 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59392a9b-6e69-43f1-b0b6-736a5f71811e admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:42.596665 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59392a9b-6e69-43f1-b0b6-736a5f71811e admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:42.596932 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59392a9b-6e69-43f1-b0b6-736a5f71811e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:42.597391 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 265/528] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:08:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:42.598181 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53888b1-9392-476d-8cd5-3b198b649ded admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:42.610769 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53888b1-9392-476d-8cd5-3b198b649ded admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:42.612446 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59392a9b-6e69-43f1-b0b6-736a5f71811e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:42.615296 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10433354-a70b-4cb3-95e6-efc1643c1a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:42.615946 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10433354-a70b-4cb3-95e6-efc1643c1a95 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:42.616230 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10433354-a70b-4cb3-95e6-efc1643c1a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:42.616505 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10433354-a70b-4cb3-95e6-efc1643c1a95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:42.617257 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10433354-a70b-4cb3-95e6-efc1643c1a95 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:42.617565 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10433354-a70b-4cb3-95e6-efc1643c1a95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:42.619187 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10433354-a70b-4cb3-95e6-efc1643c1a95 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:42.619292 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-59392a9b-6e69-43f1-b0b6-736a5f71811e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 29 20:08:42.620458 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 264/529] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Nov 29 20:08:42 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:42.626231 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59392a9b-6e69-43f1-b0b6-736a5f71811e admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:42.627636 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 266/530] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Nov 29 20:08:42 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:42.628293 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10433354-a70b-4cb3-95e6-efc1643c1a95 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:42.637859 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10433354-a70b-4cb3-95e6-efc1643c1a95 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:42.640987 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59392a9b-6e69-43f1-b0b6-736a5f71811e admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:42.642450 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f4a8a-ee54-4664-90d1-6e53032b7021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:42.643247 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f4a8a-ee54-4664-90d1-6e53032b7021 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:42.643529 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f4a8a-ee54-4664-90d1-6e53032b7021 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:42.643802 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f4a8a-ee54-4664-90d1-6e53032b7021 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:42.645692 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1e303-dbff-49f9-a3e2-2c1472bdf845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:42.646312 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1e303-dbff-49f9-a3e2-2c1472bdf845 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:42.646713 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1e303-dbff-49f9-a3e2-2c1472bdf845 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:42.646921 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1e303-dbff-49f9-a3e2-2c1472bdf845 admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:42.647628 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb1e303-dbff-49f9-a3e2-2c1472bdf845 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:42.647935 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb1e303-dbff-49f9-a3e2-2c1472bdf845 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:42.649545 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb1e303-dbff-49f9-a3e2-2c1472bdf845 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:42.650897 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f4a8a-ee54-4664-90d1-6e53032b7021 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:42.652900 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f4a8a-ee54-4664-90d1-6e53032b7021 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:42.666053 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 265/531] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:08:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:42.666053 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1e303-dbff-49f9-a3e2-2c1472bdf845 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:42.666387 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-bf2f4a8a-ee54-4664-90d1-6e53032b7021 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 29 20:08:42.667663 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 267/532] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:08:42 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:42.668423 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f4a8a-ee54-4664-90d1-6e53032b7021 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:42.679155 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1e303-dbff-49f9-a3e2-2c1472bdf845 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:42.680265 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f4a8a-ee54-4664-90d1-6e53032b7021 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:42.683434 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3d3f9-be97-49e9-a84e-48d56cfa6622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:42.684112 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3d3f9-be97-49e9-a84e-48d56cfa6622 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:42.684402 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3d3f9-be97-49e9-a84e-48d56cfa6622 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:42.684686 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa3d3f9-be97-49e9-a84e-48d56cfa6622 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:42.684863 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca22025-69be-4be8-9d84-a6e4bd19f5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:42.685465 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa3d3f9-be97-49e9-a84e-48d56cfa6622 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:42.685618 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca22025-69be-4be8-9d84-a6e4bd19f5a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:42.685770 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa3d3f9-be97-49e9-a84e-48d56cfa6622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:42.685912 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca22025-69be-4be8-9d84-a6e4bd19f5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:42.686267 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca22025-69be-4be8-9d84-a6e4bd19f5a5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:42.687424 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa3d3f9-be97-49e9-a84e-48d56cfa6622 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:42.695590 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 266/533] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Nov 29 20:08:42 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:42.696220 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3d3f9-be97-49e9-a84e-48d56cfa6622 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:42.701167 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca22025-69be-4be8-9d84-a6e4bd19f5a5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:42.703081 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca22025-69be-4be8-9d84-a6e4bd19f5a5 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:42.705374 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa3d3f9-be97-49e9-a84e-48d56cfa6622 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:42.709645 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1d99c-cf55-461b-b3d3-f403421cbbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:42.710419 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1d99c-cf55-461b-b3d3-f403421cbbc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:42.710697 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1d99c-cf55-461b-b3d3-f403421cbbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:42.711071 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1d99c-cf55-461b-b3d3-f403421cbbc0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:42.718065 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1d99c-cf55-461b-b3d3-f403421cbbc0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:42.720064 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1d99c-cf55-461b-b3d3-f403421cbbc0 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:42.720161 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-3ca22025-69be-4be8-9d84-a6e4bd19f5a5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:08:42.726484 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 268/534] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:42.726484 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca22025-69be-4be8-9d84-a6e4bd19f5a5 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:42.731473 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca22025-69be-4be8-9d84-a6e4bd19f5a5 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:42.736058 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87c3dd-45da-48f3-952e-b5510742af40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:42.736688 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87c3dd-45da-48f3-952e-b5510742af40 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:42.736967 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87c3dd-45da-48f3-952e-b5510742af40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:42.737238 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87c3dd-45da-48f3-952e-b5510742af40 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:42.738024 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87c3dd-45da-48f3-952e-b5510742af40 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:42.738359 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87c3dd-45da-48f3-952e-b5510742af40 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:42.738839 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-75a1d99c-cf55-461b-b3d3-f403421cbbc0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 29 20:08:42.739393 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING py.warnings [None req-9b87c3dd-45da-48f3-952e-b5510742af40 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 29 20:08:42.739393 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: warnings.warn(msg) Nov 29 20:08:42.739393 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: Nov 29 20:08:42.740503 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87c3dd-45da-48f3-952e-b5510742af40 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:42.744969 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 267/535] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:08:42 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:42.745694 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1d99c-cf55-461b-b3d3-f403421cbbc0 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:42.754897 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1d99c-cf55-461b-b3d3-f403421cbbc0 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:42.764468 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 269/536] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Nov 29 20:08:42 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:42.764468 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87c3dd-45da-48f3-952e-b5510742af40 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:42.764979 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057b99a-0d1f-40ed-a415-daf807361e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:42.765758 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057b99a-0d1f-40ed-a415-daf807361e77 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:42.766017 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057b99a-0d1f-40ed-a415-daf807361e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:42.766283 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057b99a-0d1f-40ed-a415-daf807361e77 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:42.772980 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87c3dd-45da-48f3-952e-b5510742af40 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:42.776544 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8057b99a-0d1f-40ed-a415-daf807361e77 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:42.777762 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f8b24-3538-4efb-a6ee-eed766605bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:42.778373 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f8b24-3538-4efb-a6ee-eed766605bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:42.778494 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8057b99a-0d1f-40ed-a415-daf807361e77 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:42.778747 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f8b24-3538-4efb-a6ee-eed766605bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:42.778998 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f8b24-3538-4efb-a6ee-eed766605bc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:42.779658 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f8b24-3538-4efb-a6ee-eed766605bc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:42.780010 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f8b24-3538-4efb-a6ee-eed766605bc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:42.781607 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f8b24-3538-4efb-a6ee-eed766605bc9 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:42.792597 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 270/537] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:08:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:42.793361 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f8b24-3538-4efb-a6ee-eed766605bc9 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:42.796001 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-8057b99a-0d1f-40ed-a415-daf807361e77 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:08:42.800284 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 268/538] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:42.800284 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057b99a-0d1f-40ed-a415-daf807361e77 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:42.807241 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057b99a-0d1f-40ed-a415-daf807361e77 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:42.811015 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f8b24-3538-4efb-a6ee-eed766605bc9 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:42.814042 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bccc92a-d801-43be-b4d5-3e026cc3f4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:42.814685 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bccc92a-d801-43be-b4d5-3e026cc3f4c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:42.815028 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bccc92a-d801-43be-b4d5-3e026cc3f4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:42.815310 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bccc92a-d801-43be-b4d5-3e026cc3f4c6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:42.816051 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92dd6d9-6d83-4dc3-bf7e-0c7a079b4ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:42.816258 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bccc92a-d801-43be-b4d5-3e026cc3f4c6 admin admin] RBAC: Adding query filter params (role.id=4851b1a48d8a4188b335219acbede502, scope.project.id=6f4cba10fe824640b2ed37aab02346ac, user.id=5f76a8c3d04e440b92d12ced18d97941) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:42.816562 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bccc92a-d801-43be-b4d5-3e026cc3f4c6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:42.816711 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92dd6d9-6d83-4dc3-bf7e-0c7a079b4ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:42.816969 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92dd6d9-6d83-4dc3-bf7e-0c7a079b4ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:42.817268 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92dd6d9-6d83-4dc3-bf7e-0c7a079b4ab8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:42.818029 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92dd6d9-6d83-4dc3-bf7e-0c7a079b4ab8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:42.818336 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92dd6d9-6d83-4dc3-bf7e-0c7a079b4ab8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:42.818425 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bccc92a-d801-43be-b4d5-3e026cc3f4c6 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:42.820257 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92dd6d9-6d83-4dc3-bf7e-0c7a079b4ab8 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:42.824241 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 269/539] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:08:42 2021] GET /identity/v3/role_assignments?user.id=5f76a8c3d04e440b92d12ced18d97941&scope.project.id=6f4cba10fe824640b2ed37aab02346ac&role.id=4851b1a48d8a4188b335219acbede502 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:42.832948 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bccc92a-d801-43be-b4d5-3e026cc3f4c6 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:42.838270 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 271/540] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Nov 29 20:08:42 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:42.843233 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92dd6d9-6d83-4dc3-bf7e-0c7a079b4ab8 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:42.846326 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bccc92a-d801-43be-b4d5-3e026cc3f4c6 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:42.851089 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cd47b-7183-4848-85aa-ae3331f7ee34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:42.851912 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cd47b-7183-4848-85aa-ae3331f7ee34 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:42.852193 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cd47b-7183-4848-85aa-ae3331f7ee34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:42.852469 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cd47b-7183-4848-85aa-ae3331f7ee34 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:42.859699 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92dd6d9-6d83-4dc3-bf7e-0c7a079b4ab8 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:42.860821 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01cd47b-7183-4848-85aa-ae3331f7ee34 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:42.862875 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01cd47b-7183-4848-85aa-ae3331f7ee34 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:42.865460 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d38f04-db07-45e3-9cbf-6fe0d3b3e715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:42.866555 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d38f04-db07-45e3-9cbf-6fe0d3b3e715 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:42.867167 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d38f04-db07-45e3-9cbf-6fe0d3b3e715 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:42.867673 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d38f04-db07-45e3-9cbf-6fe0d3b3e715 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:42.868690 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d38f04-db07-45e3-9cbf-6fe0d3b3e715 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:42.869279 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d38f04-db07-45e3-9cbf-6fe0d3b3e715 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:42.871283 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d38f04-db07-45e3-9cbf-6fe0d3b3e715 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:42.878097 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-b01cd47b-7183-4848-85aa-ae3331f7ee34 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 29 20:08:42.879594 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 270/541] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:08:42 2021] GET /identity/v3/users/cinder => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:42.880142 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cd47b-7183-4848-85aa-ae3331f7ee34 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:42.885812 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 272/542] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:08:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:42.887560 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d38f04-db07-45e3-9cbf-6fe0d3b3e715 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:42.896034 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cd47b-7183-4848-85aa-ae3331f7ee34 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:42.899502 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d38f04-db07-45e3-9cbf-6fe0d3b3e715 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:42.900895 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea9624-d5d7-4a60-81f4-bcdac80fca9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:42.901682 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea9624-d5d7-4a60-81f4-bcdac80fca9e admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:42.902085 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea9624-d5d7-4a60-81f4-bcdac80fca9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:42.902426 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea9624-d5d7-4a60-81f4-bcdac80fca9e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:42.903515 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beea9624-d5d7-4a60-81f4-bcdac80fca9e admin admin] RBAC: Adding query filter params (role.id=4851b1a48d8a4188b335219acbede502, scope.project.id=6f4cba10fe824640b2ed37aab02346ac, user.id=bcc415af1f5a42febbdbd187e066cf85) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:42.903943 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beea9624-d5d7-4a60-81f4-bcdac80fca9e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:42.905768 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13b0db-dd9b-4895-85ba-5aabce9393d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:42.906081 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beea9624-d5d7-4a60-81f4-bcdac80fca9e admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:42.907220 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13b0db-dd9b-4895-85ba-5aabce9393d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:42.907634 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13b0db-dd9b-4895-85ba-5aabce9393d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:42.908068 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13b0db-dd9b-4895-85ba-5aabce9393d0 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:42.909097 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13b0db-dd9b-4895-85ba-5aabce9393d0 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:42.909674 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13b0db-dd9b-4895-85ba-5aabce9393d0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:42.911908 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13b0db-dd9b-4895-85ba-5aabce9393d0 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:42.918902 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 271/543] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:08:42 2021] GET /identity/v3/role_assignments?user.id=bcc415af1f5a42febbdbd187e066cf85&scope.project.id=6f4cba10fe824640b2ed37aab02346ac&role.id=4851b1a48d8a4188b335219acbede502 => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:42.918902 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea9624-d5d7-4a60-81f4-bcdac80fca9e admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:42.936950 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea9624-d5d7-4a60-81f4-bcdac80fca9e admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:42.948887 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e0986-62c5-48d2-bda3-9958dc25abda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:42.950992 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e0986-62c5-48d2-bda3-9958dc25abda admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:42.951271 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e0986-62c5-48d2-bda3-9958dc25abda admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:42.951544 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e0986-62c5-48d2-bda3-9958dc25abda admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:42.961465 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 273/544] 10.222.0.15 () {56 vars in 1158 bytes} [Mon Nov 29 20:08:42 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:42.964960 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13b0db-dd9b-4895-85ba-5aabce9393d0 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:42.969672 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e0986-62c5-48d2-bda3-9958dc25abda admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:42.973168 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e0986-62c5-48d2-bda3-9958dc25abda admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:42.985384 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13b0db-dd9b-4895-85ba-5aabce9393d0 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:42.996010 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945b507-5b2f-45bc-b34a-f472622c1add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:42.996723 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945b507-5b2f-45bc-b34a-f472622c1add admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:42.996999 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945b507-5b2f-45bc-b34a-f472622c1add admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:42.997266 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945b507-5b2f-45bc-b34a-f472622c1add admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:43.008032 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-be5e0986-62c5-48d2-bda3-9958dc25abda admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 29 20:08:43.010810 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 272/545] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Nov 29 20:08:42 2021] GET /identity/v3/users/neutron => generated 85 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:43.017424 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945b507-5b2f-45bc-b34a-f472622c1add admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:43.019332 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b945b507-5b2f-45bc-b34a-f472622c1add admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:43.026641 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e0986-62c5-48d2-bda3-9958dc25abda admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:43.040991 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e0986-62c5-48d2-bda3-9958dc25abda admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:43.045216 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 274/546] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:08:42 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:08:43.048959 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bff34-1373-45fe-b288-adb06abcc9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:43.049704 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bff34-1373-45fe-b288-adb06abcc9fc admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:43.049984 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bff34-1373-45fe-b288-adb06abcc9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:43.051181 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945b507-5b2f-45bc-b34a-f472622c1add admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:43.054688 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bff34-1373-45fe-b288-adb06abcc9fc admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:43.055711 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3bff34-1373-45fe-b288-adb06abcc9fc admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:43.056023 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3bff34-1373-45fe-b288-adb06abcc9fc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:43.060277 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3bff34-1373-45fe-b288-adb06abcc9fc admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:43.065914 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b945b507-5b2f-45bc-b34a-f472622c1add admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:43.080907 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb2006-cc35-495f-aa08-150c2184e41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:43.081718 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb2006-cc35-495f-aa08-150c2184e41c admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:43.082041 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb2006-cc35-495f-aa08-150c2184e41c admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:43.082315 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb2006-cc35-495f-aa08-150c2184e41c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:43.094463 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 273/547] 10.222.0.15 () {56 vars in 1160 bytes} [Mon Nov 29 20:08:43 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:43.097687 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb2006-cc35-495f-aa08-150c2184e41c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:43.099725 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb2006-cc35-495f-aa08-150c2184e41c admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:43.100482 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bff34-1373-45fe-b288-adb06abcc9fc admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:43.111033 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bff34-1373-45fe-b288-adb06abcc9fc admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:43.124302 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65f829-3605-4616-958c-3e1aaee33b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:43.125010 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65f829-3605-4616-958c-3e1aaee33b5c admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:43.125289 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65f829-3605-4616-958c-3e1aaee33b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:43.125559 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65f829-3605-4616-958c-3e1aaee33b5c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:43.133146 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-56bb2006-cc35-495f-aa08-150c2184e41c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:08:43.136165 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 275/548] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:43.140513 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a65f829-3605-4616-958c-3e1aaee33b5c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:43.142721 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb2006-cc35-495f-aa08-150c2184e41c admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:43.143925 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a65f829-3605-4616-958c-3e1aaee33b5c admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:43.160011 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb2006-cc35-495f-aa08-150c2184e41c admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:43.171477 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 274/549] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:08:43 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:08:43.174977 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509aa57f-b25a-45cb-b1fe-b43ce8cb8924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:43.174977 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509aa57f-b25a-45cb-b1fe-b43ce8cb8924 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:43.174977 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509aa57f-b25a-45cb-b1fe-b43ce8cb8924 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:43.174977 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509aa57f-b25a-45cb-b1fe-b43ce8cb8924 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:43.175658 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509aa57f-b25a-45cb-b1fe-b43ce8cb8924 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:43.175966 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509aa57f-b25a-45cb-b1fe-b43ce8cb8924 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:43.178102 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509aa57f-b25a-45cb-b1fe-b43ce8cb8924 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:43.181099 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65f829-3605-4616-958c-3e1aaee33b5c admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:43.191154 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65f829-3605-4616-958c-3e1aaee33b5c admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:43.198737 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff543dc-4a3d-4364-8fd9-c92be510e929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:43.201129 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff543dc-4a3d-4364-8fd9-c92be510e929 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:43.201129 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff543dc-4a3d-4364-8fd9-c92be510e929 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:43.201129 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff543dc-4a3d-4364-8fd9-c92be510e929 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:43.205053 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 276/550] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:08:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:43.213375 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff543dc-4a3d-4364-8fd9-c92be510e929 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:43.214610 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509aa57f-b25a-45cb-b1fe-b43ce8cb8924 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:43.215498 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff543dc-4a3d-4364-8fd9-c92be510e929 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:43.228169 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509aa57f-b25a-45cb-b1fe-b43ce8cb8924 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:43.235200 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-6ff543dc-4a3d-4364-8fd9-c92be510e929 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:08:43.236860 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 275/551] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:43.238978 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1727b9-d206-4792-9866-7c7143c2e08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:43.240007 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1727b9-d206-4792-9866-7c7143c2e08e admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:43.240445 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1727b9-d206-4792-9866-7c7143c2e08e admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:43.240870 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1727b9-d206-4792-9866-7c7143c2e08e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:43.247413 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff543dc-4a3d-4364-8fd9-c92be510e929 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:43.259078 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff543dc-4a3d-4364-8fd9-c92be510e929 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:43.260121 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1727b9-d206-4792-9866-7c7143c2e08e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:43.262632 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1727b9-d206-4792-9866-7c7143c2e08e admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:43.264529 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed226365-1709-4201-ad1b-eb7777d41868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:43.265462 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed226365-1709-4201-ad1b-eb7777d41868 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:43.265814 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed226365-1709-4201-ad1b-eb7777d41868 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:43.266159 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed226365-1709-4201-ad1b-eb7777d41868 admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:43.267088 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed226365-1709-4201-ad1b-eb7777d41868 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:43.269062 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed226365-1709-4201-ad1b-eb7777d41868 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:43.269616 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed226365-1709-4201-ad1b-eb7777d41868 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:43.283406 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 276/552] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:08:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:43.288358 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-9f1727b9-d206-4792-9866-7c7143c2e08e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 29 20:08:43.293735 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 277/553] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:08:43 2021] GET /identity/v3/projects/service => generated 88 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:43.295414 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed226365-1709-4201-ad1b-eb7777d41868 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:43.299380 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1727b9-d206-4792-9866-7c7143c2e08e admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:43.312834 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed226365-1709-4201-ad1b-eb7777d41868 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:43.315104 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1727b9-d206-4792-9866-7c7143c2e08e admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:43.322447 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e237395-a7fd-4385-a2fe-3181077ba0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:43.323848 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e237395-a7fd-4385-a2fe-3181077ba0b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:43.324612 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18998d53-455b-42ad-a838-5b13823087b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:43.325615 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18998d53-455b-42ad-a838-5b13823087b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:43.326086 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e237395-a7fd-4385-a2fe-3181077ba0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:43.326541 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e237395-a7fd-4385-a2fe-3181077ba0b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:43.327577 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e237395-a7fd-4385-a2fe-3181077ba0b7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:43.328054 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18998d53-455b-42ad-a838-5b13823087b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:43.328505 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18998d53-455b-42ad-a838-5b13823087b2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:43.329522 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e237395-a7fd-4385-a2fe-3181077ba0b7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:43.331748 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e237395-a7fd-4385-a2fe-3181077ba0b7 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:43.344778 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18998d53-455b-42ad-a838-5b13823087b2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:43.347090 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18998d53-455b-42ad-a838-5b13823087b2 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:43.358544 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 278/554] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Nov 29 20:08:43 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:43.359765 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e237395-a7fd-4385-a2fe-3181077ba0b7 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:43.372032 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e237395-a7fd-4385-a2fe-3181077ba0b7 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:43.373289 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-18998d53-455b-42ad-a838-5b13823087b2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 29 20:08:43.379268 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 277/555] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:08:43 2021] GET /identity/v3/projects/service => generated 88 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:08:43.382436 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18998d53-455b-42ad-a838-5b13823087b2 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:43.382915 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce0f755-521d-4c8b-aa1b-5364c9334155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:43.383920 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0f755-521d-4c8b-aa1b-5364c9334155 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:43.384387 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0f755-521d-4c8b-aa1b-5364c9334155 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:43.384861 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce0f755-521d-4c8b-aa1b-5364c9334155 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:43.385890 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce0f755-521d-4c8b-aa1b-5364c9334155 admin admin] RBAC: Adding query filter params (role.id=4851b1a48d8a4188b335219acbede502, scope.project.id=6f4cba10fe824640b2ed37aab02346ac, user.id=9508e6f2ac414098872e2584f1ed7393) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:43.386388 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce0f755-521d-4c8b-aa1b-5364c9334155 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:43.388790 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce0f755-521d-4c8b-aa1b-5364c9334155 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:43.398866 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18998d53-455b-42ad-a838-5b13823087b2 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:43.401465 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a814c-b682-4286-981d-fbcfcbfc6be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:43.402800 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a814c-b682-4286-981d-fbcfcbfc6be4 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:43.403224 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 279/556] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:08:43 2021] GET /identity/v3/role_assignments?user.id=9508e6f2ac414098872e2584f1ed7393&scope.project.id=6f4cba10fe824640b2ed37aab02346ac&role.id=4851b1a48d8a4188b335219acbede502 => generated 259 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:43.403496 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a814c-b682-4286-981d-fbcfcbfc6be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:43.403700 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a814c-b682-4286-981d-fbcfcbfc6be4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:43.404559 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a814c-b682-4286-981d-fbcfcbfc6be4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:43.405894 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a814c-b682-4286-981d-fbcfcbfc6be4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:43.406369 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING py.warnings [None req-bd2a814c-b682-4286-981d-fbcfcbfc6be4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 29 20:08:43.406369 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: warnings.warn(msg) Nov 29 20:08:43.406369 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: Nov 29 20:08:43.407611 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a814c-b682-4286-981d-fbcfcbfc6be4 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:43.427917 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 278/557] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Nov 29 20:08:43 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:43.434544 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce0f755-521d-4c8b-aa1b-5364c9334155 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:43.445240 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce0f755-521d-4c8b-aa1b-5364c9334155 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:43.455061 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166855a6-ff90-4936-a4f3-8b4973dc8b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:43.455746 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166855a6-ff90-4936-a4f3-8b4973dc8b40 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:43.456074 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166855a6-ff90-4936-a4f3-8b4973dc8b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:43.456349 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166855a6-ff90-4936-a4f3-8b4973dc8b40 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:43.457261 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166855a6-ff90-4936-a4f3-8b4973dc8b40 admin admin] RBAC: Adding query filter params (role.id=4851b1a48d8a4188b335219acbede502, scope.project.id=6f4cba10fe824640b2ed37aab02346ac, user.id=821fb4ce82de47ca873fc22d29d4f957) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:43.457573 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166855a6-ff90-4936-a4f3-8b4973dc8b40 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:43.459576 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166855a6-ff90-4936-a4f3-8b4973dc8b40 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:43.466032 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 280/558] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:08:43 2021] GET /identity/v3/role_assignments?user.id=821fb4ce82de47ca873fc22d29d4f957&scope.project.id=6f4cba10fe824640b2ed37aab02346ac&role.id=4851b1a48d8a4188b335219acbede502 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:43.659175 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ce8db-77b5-4262-8d7f-1349d02d0834 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:43.659361 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ce8db-77b5-4262-8d7f-1349d02d0834 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:43.659634 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35ce8db-77b5-4262-8d7f-1349d02d0834 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:43.661445 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 279/559] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:43.668002 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8692b6c-e29f-4ad2-8715-b0963b11fda1 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:43.668288 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8692b6c-e29f-4ad2-8715-b0963b11fda1 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:43.668565 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8692b6c-e29f-4ad2-8715-b0963b11fda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:43.702584 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-f8692b6c-e29f-4ad2-8715-b0963b11fda1 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:43.703844 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-f8692b6c-e29f-4ad2-8715-b0963b11fda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:43.714813 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 281/560] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:43 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 29 20:08:43.747850 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ce8db-77b5-4262-8d7f-1349d02d0834 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:43.760794 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35ce8db-77b5-4262-8d7f-1349d02d0834 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:43.771908 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ff33b-1339-4820-a4f7-2cebc8bcebab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:43.771908 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ff33b-1339-4820-a4f7-2cebc8bcebab admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:43.771908 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ff33b-1339-4820-a4f7-2cebc8bcebab admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:43.772566 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ff33b-1339-4820-a4f7-2cebc8bcebab admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:43.783913 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ff33b-1339-4820-a4f7-2cebc8bcebab admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:43.785850 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ff33b-1339-4820-a4f7-2cebc8bcebab admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:43.806217 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-5f2ff33b-1339-4820-a4f7-2cebc8bcebab admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:08:43.807794 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 280/561] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:43.813914 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8692b6c-e29f-4ad2-8715-b0963b11fda1 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:43.823294 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8692b6c-e29f-4ad2-8715-b0963b11fda1 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:43.828200 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99067b78-1f33-4491-98e6-379a362ffa66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:43.828906 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99067b78-1f33-4491-98e6-379a362ffa66 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:43.829188 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99067b78-1f33-4491-98e6-379a362ffa66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:43.829459 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99067b78-1f33-4491-98e6-379a362ffa66 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:43.830475 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99067b78-1f33-4491-98e6-379a362ffa66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:43.830475 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99067b78-1f33-4491-98e6-379a362ffa66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:43.834868 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99067b78-1f33-4491-98e6-379a362ffa66 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:43.845107 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 282/562] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:08:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:43.851012 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ff33b-1339-4820-a4f7-2cebc8bcebab admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:43.863355 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ff33b-1339-4820-a4f7-2cebc8bcebab admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:43.874833 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79314b29-84b3-4678-8e90-2e20df2c2881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:43.875618 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79314b29-84b3-4678-8e90-2e20df2c2881 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:43.875898 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79314b29-84b3-4678-8e90-2e20df2c2881 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:43.876204 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79314b29-84b3-4678-8e90-2e20df2c2881 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:43.876958 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79314b29-84b3-4678-8e90-2e20df2c2881 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:43.879089 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79314b29-84b3-4678-8e90-2e20df2c2881 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:43.913441 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 281/563] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Nov 29 20:08:43 2021] POST /identity/v3/users => generated 247 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:08:45.624704 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964da9cf-006c-430c-8111-4c4050c1afcb None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:45.625286 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964da9cf-006c-430c-8111-4c4050c1afcb None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:45.625286 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964da9cf-006c-430c-8111-4c4050c1afcb None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:45.627331 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 283/564] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:45.648867 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07cdaa6-1887-4086-b277-f1932086c768 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:45.649360 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07cdaa6-1887-4086-b277-f1932086c768 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:45.649431 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07cdaa6-1887-4086-b277-f1932086c768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:45.675803 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-e07cdaa6-1887-4086-b277-f1932086c768 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:45.677116 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-e07cdaa6-1887-4086-b277-f1932086c768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:45.685145 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 282/565] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:45 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:45.721012 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964da9cf-006c-430c-8111-4c4050c1afcb None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:45.734769 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964da9cf-006c-430c-8111-4c4050c1afcb None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:45.734965 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645ffcf-aeb3-4ea4-ba8d-eaf2b6e7d782 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:45.735219 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645ffcf-aeb3-4ea4-ba8d-eaf2b6e7d782 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:45.735387 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645ffcf-aeb3-4ea4-ba8d-eaf2b6e7d782 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:45.737413 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 283/566] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 29 20:08:45.739128 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8be93f-a7cf-4591-ab3d-c8f335aafab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:45.739921 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8be93f-a7cf-4591-ab3d-c8f335aafab6 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:45.740201 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8be93f-a7cf-4591-ab3d-c8f335aafab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:45.740475 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8be93f-a7cf-4591-ab3d-c8f335aafab6 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:45.752378 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e7aa1-1214-47d3-a05c-32cd06553a29 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:45.752661 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e7aa1-1214-47d3-a05c-32cd06553a29 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:45.752938 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e7aa1-1214-47d3-a05c-32cd06553a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:45.755967 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8be93f-a7cf-4591-ab3d-c8f335aafab6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:45.763203 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-0b8be93f-a7cf-4591-ab3d-c8f335aafab6 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 29 20:08:45.764742 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 284/567] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Nov 29 20:08:45 2021] GET /identity/v3/roles/service => generated 85 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:45.770880 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8be93f-a7cf-4591-ab3d-c8f335aafab6 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:45.784712 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8be93f-a7cf-4591-ab3d-c8f335aafab6 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:45.794790 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47bb57-2d33-456f-9177-db4ec38bbeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:45.795484 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47bb57-2d33-456f-9177-db4ec38bbeba admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:45.795792 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47bb57-2d33-456f-9177-db4ec38bbeba admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:45.796306 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47bb57-2d33-456f-9177-db4ec38bbeba admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:45.797073 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b47bb57-2d33-456f-9177-db4ec38bbeba admin admin] RBAC: Adding query filter params (name=service) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:45.797374 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b47bb57-2d33-456f-9177-db4ec38bbeba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:45.798999 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b47bb57-2d33-456f-9177-db4ec38bbeba admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:45.804338 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-560e7aa1-1214-47d3-a05c-32cd06553a29 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:45.805526 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-560e7aa1-1214-47d3-a05c-32cd06553a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:45.814468 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 285/568] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Nov 29 20:08:45 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:45.820667 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47bb57-2d33-456f-9177-db4ec38bbeba admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:45.830841 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47bb57-2d33-456f-9177-db4ec38bbeba admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:45.832549 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 284/569] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:45 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Nov 29 20:08:45.835887 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8161065a-7893-47da-9211-7ad075fd9847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:45.836686 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161065a-7893-47da-9211-7ad075fd9847 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:45.836961 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161065a-7893-47da-9211-7ad075fd9847 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:45.837226 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161065a-7893-47da-9211-7ad075fd9847 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:45.848019 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8161065a-7893-47da-9211-7ad075fd9847 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:45.849868 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8161065a-7893-47da-9211-7ad075fd9847 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:45.862730 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e7aa1-1214-47d3-a05c-32cd06553a29 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:45.868353 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-8161065a-7893-47da-9211-7ad075fd9847 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:08:45.869869 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 286/570] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:08:45.875841 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8161065a-7893-47da-9211-7ad075fd9847 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:45.884327 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e7aa1-1214-47d3-a05c-32cd06553a29 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:45.885410 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8161065a-7893-47da-9211-7ad075fd9847 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:45.890183 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a5072-65cf-4e73-952f-8d89921d22a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:45.890821 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a5072-65cf-4e73-952f-8d89921d22a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:45.891116 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a5072-65cf-4e73-952f-8d89921d22a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:45.891481 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724a5072-65cf-4e73-952f-8d89921d22a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:45.892387 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724a5072-65cf-4e73-952f-8d89921d22a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:45.892691 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724a5072-65cf-4e73-952f-8d89921d22a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:45.894272 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724a5072-65cf-4e73-952f-8d89921d22a7 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:45.899491 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff3c96-56ab-442e-97bb-c4f323ac742d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:45.900304 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff3c96-56ab-442e-97bb-c4f323ac742d admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:45.900582 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff3c96-56ab-442e-97bb-c4f323ac742d admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:45.900850 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff3c96-56ab-442e-97bb-c4f323ac742d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:45.906433 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 287/571] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:08:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:45.912143 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a5072-65cf-4e73-952f-8d89921d22a7 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:45.916047 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff3c96-56ab-442e-97bb-c4f323ac742d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:45.921582 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724a5072-65cf-4e73-952f-8d89921d22a7 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:45.925873 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e20b8-d802-48bd-b7ee-a42c1732a11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:45.926654 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e20b8-d802-48bd-b7ee-a42c1732a11b admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:45.926959 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e20b8-d802-48bd-b7ee-a42c1732a11b admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:45.927235 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e20b8-d802-48bd-b7ee-a42c1732a11b admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:45.931129 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-8cff3c96-56ab-442e-97bb-c4f323ac742d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 29 20:08:45.932704 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 285/572] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Nov 29 20:08:45 2021] GET /identity/v3/roles/service => generated 85 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:08:45.940320 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff3c96-56ab-442e-97bb-c4f323ac742d admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:45.941451 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e20b8-d802-48bd-b7ee-a42c1732a11b admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:45.943520 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e20b8-d802-48bd-b7ee-a42c1732a11b admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:45.958843 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff3c96-56ab-442e-97bb-c4f323ac742d admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:45.967083 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-812e20b8-d802-48bd-b7ee-a42c1732a11b admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 29 20:08:45.968359 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 288/573] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Nov 29 20:08:45 2021] GET /identity/v3/users/nova => generated 82 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:45.974516 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e20b8-d802-48bd-b7ee-a42c1732a11b admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:45.984236 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e20b8-d802-48bd-b7ee-a42c1732a11b admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:45.986712 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cdb9a2-feae-412e-aec0-2d551bf86cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:45.987423 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdb9a2-feae-412e-aec0-2d551bf86cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:45.987701 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdb9a2-feae-412e-aec0-2d551bf86cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:45.987974 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdb9a2-feae-412e-aec0-2d551bf86cb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:45.988756 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cdb9a2-feae-412e-aec0-2d551bf86cb8 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:45.988858 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71cfe48-2b7b-471e-98b4-244055c02842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:45.989059 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cdb9a2-feae-412e-aec0-2d551bf86cb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:45.989634 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71cfe48-2b7b-471e-98b4-244055c02842 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:45.989983 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71cfe48-2b7b-471e-98b4-244055c02842 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:45.990317 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71cfe48-2b7b-471e-98b4-244055c02842 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:45.990668 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cdb9a2-feae-412e-aec0-2d551bf86cb8 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:45.991392 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71cfe48-2b7b-471e-98b4-244055c02842 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:45.991754 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71cfe48-2b7b-471e-98b4-244055c02842 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:45.993719 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71cfe48-2b7b-471e-98b4-244055c02842 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:46.006333 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 286/574] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Nov 29 20:08:45 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:46.013482 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cdb9a2-feae-412e-aec0-2d551bf86cb8 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:46.016660 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 289/575] 10.222.0.15 () {56 vars in 1154 bytes} [Mon Nov 29 20:08:45 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:46.019201 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71cfe48-2b7b-471e-98b4-244055c02842 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:46.029625 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71cfe48-2b7b-471e-98b4-244055c02842 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:46.034102 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cfb19f-4b29-43e2-a416-18af9a67556d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:46.034913 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfb19f-4b29-43e2-a416-18af9a67556d admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:46.035331 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfb19f-4b29-43e2-a416-18af9a67556d admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:46.035604 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfb19f-4b29-43e2-a416-18af9a67556d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:46.037254 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cdb9a2-feae-412e-aec0-2d551bf86cb8 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:46.046305 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cfb19f-4b29-43e2-a416-18af9a67556d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:46.048188 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cfb19f-4b29-43e2-a416-18af9a67556d admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:46.059574 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25a2807-dc72-42a2-ba41-ac947ba00b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:46.060389 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a2807-dc72-42a2-ba41-ac947ba00b20 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:46.060668 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a2807-dc72-42a2-ba41-ac947ba00b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:46.060940 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25a2807-dc72-42a2-ba41-ac947ba00b20 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:46.066132 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-96cfb19f-4b29-43e2-a416-18af9a67556d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:08:46.067359 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 290/576] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:08:46.071619 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240bfa4-398c-41f4-a206-a385e08ffdc7 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:46.071905 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240bfa4-398c-41f4-a206-a385e08ffdc7 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:46.072181 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240bfa4-398c-41f4-a206-a385e08ffdc7 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:46.073916 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 291/577] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:46 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:46.074605 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240bfa4-398c-41f4-a206-a385e08ffdc7 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:46.079754 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a2807-dc72-42a2-ba41-ac947ba00b20 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:46.081622 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25a2807-dc72-42a2-ba41-ac947ba00b20 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:46.096987 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240bfa4-398c-41f4-a206-a385e08ffdc7 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:46.100005 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-e25a2807-dc72-42a2-ba41-ac947ba00b20 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:08:46.101526 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 287/578] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:08:46.102253 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86606d7d-4cb7-4251-8ecb-c700f510b17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:46.102774 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68279aef-81a1-4a08-b165-b82cd83f50db None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:46.103083 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68279aef-81a1-4a08-b165-b82cd83f50db None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:46.103359 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68279aef-81a1-4a08-b165-b82cd83f50db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:46.103774 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86606d7d-4cb7-4251-8ecb-c700f510b17b admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:46.104230 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86606d7d-4cb7-4251-8ecb-c700f510b17b admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:46.104806 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86606d7d-4cb7-4251-8ecb-c700f510b17b admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:46.106106 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86606d7d-4cb7-4251-8ecb-c700f510b17b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:46.106694 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86606d7d-4cb7-4251-8ecb-c700f510b17b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:46.108968 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86606d7d-4cb7-4251-8ecb-c700f510b17b admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:46.122461 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-68279aef-81a1-4a08-b165-b82cd83f50db None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:46.122925 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 292/579] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:08:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:46.123803 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-68279aef-81a1-4a08-b165-b82cd83f50db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:46.124423 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86606d7d-4cb7-4251-8ecb-c700f510b17b admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:46.138970 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 288/580] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:46 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:46.138970 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68279aef-81a1-4a08-b165-b82cd83f50db None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:46.148411 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86606d7d-4cb7-4251-8ecb-c700f510b17b admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:46.154142 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68279aef-81a1-4a08-b165-b82cd83f50db None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:46.159460 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1654ce8-604f-44b9-829f-5d05e8fa6360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:46.160134 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1654ce8-604f-44b9-829f-5d05e8fa6360 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:46.160418 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1654ce8-604f-44b9-829f-5d05e8fa6360 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:46.160692 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1654ce8-604f-44b9-829f-5d05e8fa6360 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:46.161436 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1654ce8-604f-44b9-829f-5d05e8fa6360 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:46.161740 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1654ce8-604f-44b9-829f-5d05e8fa6360 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:46.163493 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1654ce8-604f-44b9-829f-5d05e8fa6360 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:46.173310 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53d244-a9b0-4172-b331-4a9ae9d431f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:46.174117 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53d244-a9b0-4172-b331-4a9ae9d431f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:46.174398 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53d244-a9b0-4172-b331-4a9ae9d431f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:46.174673 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a53d244-a9b0-4172-b331-4a9ae9d431f9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:46.183854 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53d244-a9b0-4172-b331-4a9ae9d431f9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:46.185808 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a53d244-a9b0-4172-b331-4a9ae9d431f9 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:46.193144 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 293/581] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:08:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:46.193144 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1654ce8-604f-44b9-829f-5d05e8fa6360 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:46.204551 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1654ce8-604f-44b9-829f-5d05e8fa6360 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:46.206798 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-0a53d244-a9b0-4172-b331-4a9ae9d431f9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 29 20:08:46.208089 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 289/582] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:08:46 2021] GET /identity/v3/projects/service => generated 88 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:46.208935 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53d244-a9b0-4172-b331-4a9ae9d431f9 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:46.210033 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0509455-5403-4e21-a0a0-652221dfb2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:46.211079 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0509455-5403-4e21-a0a0-652221dfb2b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:46.211550 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0509455-5403-4e21-a0a0-652221dfb2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:46.212008 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0509455-5403-4e21-a0a0-652221dfb2b9 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:46.219333 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a53d244-a9b0-4172-b331-4a9ae9d431f9 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:46.224090 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c6fb1-45c5-40aa-bd42-5de80e02e62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:46.224859 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c6fb1-45c5-40aa-bd42-5de80e02e62e admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:46.225192 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c6fb1-45c5-40aa-bd42-5de80e02e62e admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:46.225465 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c6fb1-45c5-40aa-bd42-5de80e02e62e admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:46.225895 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0509455-5403-4e21-a0a0-652221dfb2b9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:46.233378 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c6fb1-45c5-40aa-bd42-5de80e02e62e admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:46.234425 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-d0509455-5403-4e21-a0a0-652221dfb2b9 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 29 20:08:46.235501 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c6fb1-45c5-40aa-bd42-5de80e02e62e admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:46.236261 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 294/583] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Nov 29 20:08:46 2021] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:46.237566 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0509455-5403-4e21-a0a0-652221dfb2b9 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:46.248095 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0509455-5403-4e21-a0a0-652221dfb2b9 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:46.249811 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-0e5c6fb1-45c5-40aa-bd42-5de80e02e62e admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 29 20:08:46.251467 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 290/584] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:08:46 2021] GET /identity/v3/users/glance => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:46.253439 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332c7f0-dc8e-4acb-94bf-4edca121544f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:46.254311 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332c7f0-dc8e-4acb-94bf-4edca121544f admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:46.254795 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332c7f0-dc8e-4acb-94bf-4edca121544f admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:46.255273 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332c7f0-dc8e-4acb-94bf-4edca121544f admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:46.256376 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9332c7f0-dc8e-4acb-94bf-4edca121544f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:46.256869 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9332c7f0-dc8e-4acb-94bf-4edca121544f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:46.257218 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c6fb1-45c5-40aa-bd42-5de80e02e62e admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:46.259370 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9332c7f0-dc8e-4acb-94bf-4edca121544f admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:46.267567 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c6fb1-45c5-40aa-bd42-5de80e02e62e admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:46.272609 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f7882-2746-4964-83ea-a15bd7d1d27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:46.273343 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f7882-2746-4964-83ea-a15bd7d1d27f admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:46.273627 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f7882-2746-4964-83ea-a15bd7d1d27f admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:46.273908 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f7882-2746-4964-83ea-a15bd7d1d27f admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:46.274718 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f7882-2746-4964-83ea-a15bd7d1d27f admin admin] RBAC: Adding query filter params (name=service) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:46.275060 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f7882-2746-4964-83ea-a15bd7d1d27f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:46.276120 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 295/585] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Nov 29 20:08:46 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:46.276874 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f7882-2746-4964-83ea-a15bd7d1d27f admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:46.277414 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332c7f0-dc8e-4acb-94bf-4edca121544f admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:46.286351 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 291/586] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Nov 29 20:08:46 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:46.287205 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f7882-2746-4964-83ea-a15bd7d1d27f admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:46.289098 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332c7f0-dc8e-4acb-94bf-4edca121544f admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:46.294457 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10075c-75df-4b17-a919-220802408cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:46.295659 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10075c-75df-4b17-a919-220802408cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:46.296172 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10075c-75df-4b17-a919-220802408cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:46.296630 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10075c-75df-4b17-a919-220802408cb6 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:46.297122 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f7882-2746-4964-83ea-a15bd7d1d27f admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:46.297984 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb10075c-75df-4b17-a919-220802408cb6 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:46.298582 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb10075c-75df-4b17-a919-220802408cb6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:46.301167 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb10075c-75df-4b17-a919-220802408cb6 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:46.302033 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f7a66-f2c9-4669-80d9-4e1dd688a235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:46.302996 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f7a66-f2c9-4669-80d9-4e1dd688a235 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:46.303329 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f7a66-f2c9-4669-80d9-4e1dd688a235 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:46.303607 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f7a66-f2c9-4669-80d9-4e1dd688a235 admin admin] PATH_INFO: `/v3/projects/6f4cba10fe824640b2ed37aab02346ac/users/5f76a8c3d04e440b92d12ced18d97941/roles/4851b1a48d8a4188b335219acbede502` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:46.318648 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f7a66-f2c9-4669-80d9-4e1dd688a235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f4cba10fe824640b2ed37aab02346ac, user_id=5f76a8c3d04e440b92d12ced18d97941, role_id=4851b1a48d8a4188b335219acbede502)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:46.321466 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66f7a66-f2c9-4669-80d9-4e1dd688a235 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:46.323225 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 296/587] 10.222.0.15 () {56 vars in 1158 bytes} [Mon Nov 29 20:08:46 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:46.324471 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10075c-75df-4b17-a919-220802408cb6 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:46.338424 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10075c-75df-4b17-a919-220802408cb6 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:46.341889 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 292/588] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Nov 29 20:08:46 2021] PUT /identity/v3/projects/6f4cba10fe824640b2ed37aab02346ac/users/5f76a8c3d04e440b92d12ced18d97941/roles/4851b1a48d8a4188b335219acbede502 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:08:46.342924 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f7a66-f2c9-4669-80d9-4e1dd688a235 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:46.412372 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66f7a66-f2c9-4669-80d9-4e1dd688a235 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:46.413286 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf6496-e1a0-4368-b0db-241b77c975c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:46.414468 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf6496-e1a0-4368-b0db-241b77c975c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:46.415048 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf6496-e1a0-4368-b0db-241b77c975c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:46.415569 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf6496-e1a0-4368-b0db-241b77c975c2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:46.417281 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70764d-c0e3-46ab-beac-7c451f16190e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:46.418195 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70764d-c0e3-46ab-beac-7c451f16190e admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:46.418461 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70764d-c0e3-46ab-beac-7c451f16190e admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:46.418878 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b70764d-c0e3-46ab-beac-7c451f16190e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:46.429308 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdf6496-e1a0-4368-b0db-241b77c975c2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:46.431149 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b70764d-c0e3-46ab-beac-7c451f16190e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:46.431807 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdf6496-e1a0-4368-b0db-241b77c975c2 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:46.433182 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b70764d-c0e3-46ab-beac-7c451f16190e admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:46.449471 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-0cdf6496-e1a0-4368-b0db-241b77c975c2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:08:46.450922 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-2b70764d-c0e3-46ab-beac-7c451f16190e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:08:46.451341 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 297/589] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 127 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:46.452449 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 293/590] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 110 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:46.464007 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70764d-c0e3-46ab-beac-7c451f16190e admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:46.464199 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf6496-e1a0-4368-b0db-241b77c975c2 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:46.474396 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf6496-e1a0-4368-b0db-241b77c975c2 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:46.477050 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b70764d-c0e3-46ab-beac-7c451f16190e admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:46.482956 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439060a1-c3da-4647-be02-90ae0d9e5255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:46.484986 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439060a1-c3da-4647-be02-90ae0d9e5255 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:46.485911 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439060a1-c3da-4647-be02-90ae0d9e5255 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:46.486721 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439060a1-c3da-4647-be02-90ae0d9e5255 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:46.488263 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439060a1-c3da-4647-be02-90ae0d9e5255 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:46.489137 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f3919-04e2-47ec-a577-e434134c8581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:46.489666 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439060a1-c3da-4647-be02-90ae0d9e5255 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:46.490525 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f3919-04e2-47ec-a577-e434134c8581 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:46.492502 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439060a1-c3da-4647-be02-90ae0d9e5255 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:46.493048 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f3919-04e2-47ec-a577-e434134c8581 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:46.493511 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f3919-04e2-47ec-a577-e434134c8581 admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:46.494468 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f3919-04e2-47ec-a577-e434134c8581 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:46.496812 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f3919-04e2-47ec-a577-e434134c8581 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:46.498665 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f3919-04e2-47ec-a577-e434134c8581 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:46.520786 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 298/591] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:08:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:46.523749 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d706b-d723-4069-a649-d50e8c536c73 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:46.524244 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d706b-d723-4069-a649-d50e8c536c73 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:46.524706 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78d706b-d723-4069-a649-d50e8c536c73 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:46.525301 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 294/592] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:08:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:46.527233 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 299/593] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:46 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:46.530985 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f3919-04e2-47ec-a577-e434134c8581 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:46.533212 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d706b-d723-4069-a649-d50e8c536c73 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:46.541694 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f3919-04e2-47ec-a577-e434134c8581 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:46.547196 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78d706b-d723-4069-a649-d50e8c536c73 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:46.548703 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a6cce-795a-41f8-9896-1e11a79de06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:46.549709 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a6cce-795a-41f8-9896-1e11a79de06f admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:46.550168 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a6cce-795a-41f8-9896-1e11a79de06f admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:46.550570 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a6cce-795a-41f8-9896-1e11a79de06f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:46.552450 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b405f8-71ca-4990-b877-68adfdcb68fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:46.553657 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b405f8-71ca-4990-b877-68adfdcb68fc admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:46.553996 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b405f8-71ca-4990-b877-68adfdcb68fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:46.554370 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b405f8-71ca-4990-b877-68adfdcb68fc admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:46.560370 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a6cce-795a-41f8-9896-1e11a79de06f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:46.562804 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a6cce-795a-41f8-9896-1e11a79de06f admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:46.564096 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b405f8-71ca-4990-b877-68adfdcb68fc admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:46.566280 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b405f8-71ca-4990-b877-68adfdcb68fc admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:46.577851 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-925a6cce-795a-41f8-9896-1e11a79de06f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 29 20:08:46.579701 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 295/594] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:08:46 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:46.580982 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-89b405f8-71ca-4990-b877-68adfdcb68fc admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 29 20:08:46.581408 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105f017-14c7-407e-801b-4de099b56b6c None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:46.581849 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105f017-14c7-407e-801b-4de099b56b6c None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:46.582258 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105f017-14c7-407e-801b-4de099b56b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:46.582838 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 300/595] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:08:46 2021] GET /identity/v3/users/cinder => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:46.585582 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b405f8-71ca-4990-b877-68adfdcb68fc admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:46.595972 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b405f8-71ca-4990-b877-68adfdcb68fc admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:46.600737 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942efef-7b1e-4511-a544-51acc3962824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:46.601573 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942efef-7b1e-4511-a544-51acc3962824 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:46.601947 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942efef-7b1e-4511-a544-51acc3962824 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:46.602315 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942efef-7b1e-4511-a544-51acc3962824 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:46.603291 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c942efef-7b1e-4511-a544-51acc3962824 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:46.603621 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-0105f017-14c7-407e-801b-4de099b56b6c None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:46.603732 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c942efef-7b1e-4511-a544-51acc3962824 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:46.605048 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-0105f017-14c7-407e-801b-4de099b56b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:46.605776 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c942efef-7b1e-4511-a544-51acc3962824 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:46.613546 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 296/596] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:46 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:46.614636 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105f017-14c7-407e-801b-4de099b56b6c None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:46.624442 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105f017-14c7-407e-801b-4de099b56b6c None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:46.626628 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 301/597] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Nov 29 20:08:46 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:46.633276 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942efef-7b1e-4511-a544-51acc3962824 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:46.633692 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392929d6-c3b9-4d34-aad8-f535abd2845a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:46.634632 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392929d6-c3b9-4d34-aad8-f535abd2845a admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:46.635079 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392929d6-c3b9-4d34-aad8-f535abd2845a admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:46.635482 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392929d6-c3b9-4d34-aad8-f535abd2845a admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:46.636488 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392929d6-c3b9-4d34-aad8-f535abd2845a admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:46.636924 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392929d6-c3b9-4d34-aad8-f535abd2845a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:46.639327 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392929d6-c3b9-4d34-aad8-f535abd2845a admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:46.644557 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942efef-7b1e-4511-a544-51acc3962824 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:46.658528 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 297/598] 10.222.0.15 () {56 vars in 1158 bytes} [Mon Nov 29 20:08:46 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:46.660421 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76532c1-e284-4dc2-a1d3-dcbdc8997075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:46.661326 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76532c1-e284-4dc2-a1d3-dcbdc8997075 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:46.661600 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76532c1-e284-4dc2-a1d3-dcbdc8997075 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:46.661870 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76532c1-e284-4dc2-a1d3-dcbdc8997075 admin admin] PATH_INFO: `/v3/projects/6f4cba10fe824640b2ed37aab02346ac/users/bcc415af1f5a42febbdbd187e066cf85/roles/4851b1a48d8a4188b335219acbede502` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:46.666230 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392929d6-c3b9-4d34-aad8-f535abd2845a admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:46.676209 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392929d6-c3b9-4d34-aad8-f535abd2845a admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:46.680424 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76532c1-e284-4dc2-a1d3-dcbdc8997075 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f4cba10fe824640b2ed37aab02346ac, user_id=bcc415af1f5a42febbdbd187e066cf85, role_id=4851b1a48d8a4188b335219acbede502)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:46.681264 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab488a-071f-4316-a834-0a27b3eb9923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:46.682330 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab488a-071f-4316-a834-0a27b3eb9923 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:46.682607 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab488a-071f-4316-a834-0a27b3eb9923 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:46.682901 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab488a-071f-4316-a834-0a27b3eb9923 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:46.683082 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76532c1-e284-4dc2-a1d3-dcbdc8997075 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:46.694035 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab488a-071f-4316-a834-0a27b3eb9923 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:46.695802 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab488a-071f-4316-a834-0a27b3eb9923 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:46.699101 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 302/599] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Nov 29 20:08:46 2021] PUT /identity/v3/projects/6f4cba10fe824640b2ed37aab02346ac/users/bcc415af1f5a42febbdbd187e066cf85/roles/4851b1a48d8a4188b335219acbede502 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:08:46.699879 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76532c1-e284-4dc2-a1d3-dcbdc8997075 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:46.717633 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-4dab488a-071f-4316-a834-0a27b3eb9923 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:08:46.719251 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 298/600] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:46.725193 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab488a-071f-4316-a834-0a27b3eb9923 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:46.737660 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab488a-071f-4316-a834-0a27b3eb9923 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:46.768981 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76532c1-e284-4dc2-a1d3-dcbdc8997075 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:46.773786 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90ae4d-a04b-4997-b9fe-f65b8ee6a402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:46.774707 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90ae4d-a04b-4997-b9fe-f65b8ee6a402 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:46.775057 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90ae4d-a04b-4997-b9fe-f65b8ee6a402 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:46.775329 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc90ae4d-a04b-4997-b9fe-f65b8ee6a402 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:46.788721 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc90ae4d-a04b-4997-b9fe-f65b8ee6a402 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:46.796607 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-fc90ae4d-a04b-4997-b9fe-f65b8ee6a402 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 29 20:08:46.798314 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 303/601] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Nov 29 20:08:46 2021] GET /identity/v3/roles/service => generated 85 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:46.809157 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90ae4d-a04b-4997-b9fe-f65b8ee6a402 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:46.825066 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc90ae4d-a04b-4997-b9fe-f65b8ee6a402 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:46.839206 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e5c924-413a-4a33-af3e-15e0d4e633ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:46.842078 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5c924-413a-4a33-af3e-15e0d4e633ed admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:46.842386 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5c924-413a-4a33-af3e-15e0d4e633ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:46.842691 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5c924-413a-4a33-af3e-15e0d4e633ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:46.844247 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e5c924-413a-4a33-af3e-15e0d4e633ed admin admin] RBAC: Adding query filter params (name=service) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:46.844576 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e5c924-413a-4a33-af3e-15e0d4e633ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:46.846754 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3c234-6430-4b70-8f80-e2236d3d095d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:46.847566 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3c234-6430-4b70-8f80-e2236d3d095d admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:46.847840 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3c234-6430-4b70-8f80-e2236d3d095d admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:46.848126 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b3c234-6430-4b70-8f80-e2236d3d095d admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:46.849327 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e5c924-413a-4a33-af3e-15e0d4e633ed admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:46.850433 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b3c234-6430-4b70-8f80-e2236d3d095d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:46.850791 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b3c234-6430-4b70-8f80-e2236d3d095d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:46.854330 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b3c234-6430-4b70-8f80-e2236d3d095d admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:46.876823 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 304/602] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Nov 29 20:08:46 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:46.882488 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 299/603] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:08:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:46.885196 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e5c924-413a-4a33-af3e-15e0d4e633ed admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:46.892214 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3c234-6430-4b70-8f80-e2236d3d095d admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:46.901765 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e5c924-413a-4a33-af3e-15e0d4e633ed admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:46.913457 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca23efa7-8cb1-46a8-9e1f-756296a06b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:46.913963 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b3c234-6430-4b70-8f80-e2236d3d095d admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:46.915534 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23efa7-8cb1-46a8-9e1f-756296a06b3e admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:46.915820 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23efa7-8cb1-46a8-9e1f-756296a06b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:46.916632 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca23efa7-8cb1-46a8-9e1f-756296a06b3e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:46.923411 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2967e-62c5-4de5-98e7-05d255ee603b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:46.925555 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2967e-62c5-4de5-98e7-05d255ee603b admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:46.931364 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2967e-62c5-4de5-98e7-05d255ee603b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:46.931673 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2967e-62c5-4de5-98e7-05d255ee603b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:46.933297 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca23efa7-8cb1-46a8-9e1f-756296a06b3e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:46.935312 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca23efa7-8cb1-46a8-9e1f-756296a06b3e admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:46.948142 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c2967e-62c5-4de5-98e7-05d255ee603b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:46.950531 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c2967e-62c5-4de5-98e7-05d255ee603b admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:46.954835 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-ca23efa7-8cb1-46a8-9e1f-756296a06b3e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:08:46.961658 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 305/604] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:46.963000 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca23efa7-8cb1-46a8-9e1f-756296a06b3e admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:46.971233 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-64c2967e-62c5-4de5-98e7-05d255ee603b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 29 20:08:46.972675 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 300/605] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:08:46 2021] GET /identity/v3/projects/service => generated 88 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:46.978977 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2967e-62c5-4de5-98e7-05d255ee603b admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:46.979709 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca23efa7-8cb1-46a8-9e1f-756296a06b3e admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:46.990371 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2967e-62c5-4de5-98e7-05d255ee603b admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:46.990885 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d328e3-5467-4796-a63c-4595635f32b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:46.991604 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d328e3-5467-4796-a63c-4595635f32b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:46.991884 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d328e3-5467-4796-a63c-4595635f32b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:46.992151 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d328e3-5467-4796-a63c-4595635f32b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:46.993054 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d328e3-5467-4796-a63c-4595635f32b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:46.993401 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d328e3-5467-4796-a63c-4595635f32b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:46.995081 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d328e3-5467-4796-a63c-4595635f32b9 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:46.996843 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1a625-61f7-4031-9917-975fd9e125ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:46.997710 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1a625-61f7-4031-9917-975fd9e125ab admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:46.998200 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1a625-61f7-4031-9917-975fd9e125ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:46.998677 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1a625-61f7-4031-9917-975fd9e125ab admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:46.999774 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d1a625-61f7-4031-9917-975fd9e125ab admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:47.000281 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d1a625-61f7-4031-9917-975fd9e125ab admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:47.002312 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d1a625-61f7-4031-9917-975fd9e125ab admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:47.021107 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 301/606] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Nov 29 20:08:46 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:47.023364 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 306/607] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:08:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:47.029660 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1a625-61f7-4031-9917-975fd9e125ab admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:47.036804 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d328e3-5467-4796-a63c-4595635f32b9 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:47.048128 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1a625-61f7-4031-9917-975fd9e125ab admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:47.049021 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d328e3-5467-4796-a63c-4595635f32b9 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:47.053633 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc20ca5-7e70-4d60-a4bc-97ef271d11e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:47.053760 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb041d33-0218-47cf-9099-64b925bbccb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:47.054551 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc20ca5-7e70-4d60-a4bc-97ef271d11e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:47.054831 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc20ca5-7e70-4d60-a4bc-97ef271d11e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:47.055184 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc20ca5-7e70-4d60-a4bc-97ef271d11e0 admin admin] PATH_INFO: `/v3/projects/6f4cba10fe824640b2ed37aab02346ac/users/9508e6f2ac414098872e2584f1ed7393/roles/4851b1a48d8a4188b335219acbede502` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:47.055418 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb041d33-0218-47cf-9099-64b925bbccb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:47.055988 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb041d33-0218-47cf-9099-64b925bbccb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:47.056615 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb041d33-0218-47cf-9099-64b925bbccb1 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:47.066069 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb041d33-0218-47cf-9099-64b925bbccb1 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:47.068430 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb041d33-0218-47cf-9099-64b925bbccb1 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:47.074406 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc20ca5-7e70-4d60-a4bc-97ef271d11e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f4cba10fe824640b2ed37aab02346ac, user_id=9508e6f2ac414098872e2584f1ed7393, role_id=4851b1a48d8a4188b335219acbede502)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:47.077184 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc20ca5-7e70-4d60-a4bc-97ef271d11e0 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:47.085275 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-eb041d33-0218-47cf-9099-64b925bbccb1 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 29 20:08:47.087165 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 302/608] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Nov 29 20:08:47 2021] GET /identity/v3/users/neutron => generated 85 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:47.093563 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb041d33-0218-47cf-9099-64b925bbccb1 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:47.095862 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 307/609] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Nov 29 20:08:47 2021] PUT /identity/v3/projects/6f4cba10fe824640b2ed37aab02346ac/users/9508e6f2ac414098872e2584f1ed7393/roles/4851b1a48d8a4188b335219acbede502 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:08:47.108559 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb041d33-0218-47cf-9099-64b925bbccb1 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:47.171915 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13ae59-e8fd-4958-9e55-d156286e42ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:47.172512 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13ae59-e8fd-4958-9e55-d156286e42ee admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:47.172836 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13ae59-e8fd-4958-9e55-d156286e42ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:47.173109 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13ae59-e8fd-4958-9e55-d156286e42ee admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:47.174131 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d13ae59-e8fd-4958-9e55-d156286e42ee admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:47.174485 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d13ae59-e8fd-4958-9e55-d156286e42ee admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:47.176458 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d13ae59-e8fd-4958-9e55-d156286e42ee admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:47.197662 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 303/610] 10.222.0.15 () {56 vars in 1160 bytes} [Mon Nov 29 20:08:47 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:47.204195 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc20ca5-7e70-4d60-a4bc-97ef271d11e0 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:47.223611 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc20ca5-7e70-4d60-a4bc-97ef271d11e0 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:47.231986 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d2825-0414-482f-8487-e4d8b036ab9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:47.232904 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d2825-0414-482f-8487-e4d8b036ab9e admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:47.233297 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d2825-0414-482f-8487-e4d8b036ab9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:47.233644 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d2825-0414-482f-8487-e4d8b036ab9e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:47.249350 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d2825-0414-482f-8487-e4d8b036ab9e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:47.251331 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d2825-0414-482f-8487-e4d8b036ab9e admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:47.270299 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ebd01-39c1-4a2d-b88b-9ec0ef9a3f14 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:47.270973 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ebd01-39c1-4a2d-b88b-9ec0ef9a3f14 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:47.271508 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ebd01-39c1-4a2d-b88b-9ec0ef9a3f14 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:47.273733 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 304/611] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 29 20:08:47.274977 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-ee6d2825-0414-482f-8487-e4d8b036ab9e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:08:47.279587 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 308/612] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:47.280569 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cae321-1070-4431-bb79-54386812f8fd None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:47.280858 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cae321-1070-4431-bb79-54386812f8fd None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:47.281133 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cae321-1070-4431-bb79-54386812f8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:47.288314 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d2825-0414-482f-8487-e4d8b036ab9e admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:47.300142 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d2825-0414-482f-8487-e4d8b036ab9e admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:47.309315 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba004e8a-0aea-4768-837f-0490acc932c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:47.310394 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba004e8a-0aea-4768-837f-0490acc932c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:47.310910 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba004e8a-0aea-4768-837f-0490acc932c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:47.311410 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba004e8a-0aea-4768-837f-0490acc932c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:47.312509 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba004e8a-0aea-4768-837f-0490acc932c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:47.313073 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba004e8a-0aea-4768-837f-0490acc932c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:47.314988 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba004e8a-0aea-4768-837f-0490acc932c6 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:47.316014 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-26cae321-1070-4431-bb79-54386812f8fd None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:47.317526 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-26cae321-1070-4431-bb79-54386812f8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:47.334974 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 309/613] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:08:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:47.336611 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 305/614] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:47 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:47.337041 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba004e8a-0aea-4768-837f-0490acc932c6 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:47.354184 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba004e8a-0aea-4768-837f-0490acc932c6 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:47.365084 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb7c59-4417-44d4-8672-13ff96aea67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:47.366249 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb7c59-4417-44d4-8672-13ff96aea67a admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:47.366744 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb7c59-4417-44d4-8672-13ff96aea67a admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:47.367231 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffeb7c59-4417-44d4-8672-13ff96aea67a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:47.380195 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeb7c59-4417-44d4-8672-13ff96aea67a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:47.382633 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffeb7c59-4417-44d4-8672-13ff96aea67a admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:47.402037 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cae321-1070-4431-bb79-54386812f8fd None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:47.402504 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-ffeb7c59-4417-44d4-8672-13ff96aea67a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 29 20:08:47.404022 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 310/615] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:08:47 2021] GET /identity/v3/projects/service => generated 88 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:47.410043 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb7c59-4417-44d4-8672-13ff96aea67a admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:47.416836 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cae321-1070-4431-bb79-54386812f8fd None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:47.421276 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffeb7c59-4417-44d4-8672-13ff96aea67a admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:47.425934 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00e0ea-cdfa-486f-9185-7a35884a5bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:47.426067 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388ff4b-fe2f-459b-ac3a-0625f7f51615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:47.426643 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00e0ea-cdfa-486f-9185-7a35884a5bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:47.426749 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388ff4b-fe2f-459b-ac3a-0625f7f51615 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:47.427067 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00e0ea-cdfa-486f-9185-7a35884a5bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:47.427169 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388ff4b-fe2f-459b-ac3a-0625f7f51615 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:47.427361 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388ff4b-fe2f-459b-ac3a-0625f7f51615 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:47.427492 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00e0ea-cdfa-486f-9185-7a35884a5bb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:47.428489 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee00e0ea-cdfa-486f-9185-7a35884a5bb0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:47.428852 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee00e0ea-cdfa-486f-9185-7a35884a5bb0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:47.431012 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee00e0ea-cdfa-486f-9185-7a35884a5bb0 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:47.441662 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5388ff4b-fe2f-459b-ac3a-0625f7f51615 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:47.445995 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 311/616] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Nov 29 20:08:47 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:47.451667 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00e0ea-cdfa-486f-9185-7a35884a5bb0 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:47.451801 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-5388ff4b-fe2f-459b-ac3a-0625f7f51615 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 29 20:08:47.453487 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 306/617] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Nov 29 20:08:47 2021] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:47.461821 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00e0ea-cdfa-486f-9185-7a35884a5bb0 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:47.462966 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388ff4b-fe2f-459b-ac3a-0625f7f51615 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:47.470573 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63b6a4-4f8a-4fd7-be92-2414eae6da56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:47.471688 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63b6a4-4f8a-4fd7-be92-2414eae6da56 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:47.472170 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63b6a4-4f8a-4fd7-be92-2414eae6da56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:47.472578 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63b6a4-4f8a-4fd7-be92-2414eae6da56 admin admin] PATH_INFO: `/v3/projects/6f4cba10fe824640b2ed37aab02346ac/users/821fb4ce82de47ca873fc22d29d4f957/roles/4851b1a48d8a4188b335219acbede502` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:47.472686 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388ff4b-fe2f-459b-ac3a-0625f7f51615 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:47.478284 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0fb73e-fb99-426f-9130-74edb7da7070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:47.478971 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fb73e-fb99-426f-9130-74edb7da7070 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:47.479307 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fb73e-fb99-426f-9130-74edb7da7070 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:47.479628 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fb73e-fb99-426f-9130-74edb7da7070 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:47.480394 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0fb73e-fb99-426f-9130-74edb7da7070 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:47.480739 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0fb73e-fb99-426f-9130-74edb7da7070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:47.482453 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0fb73e-fb99-426f-9130-74edb7da7070 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:47.489943 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f63b6a4-4f8a-4fd7-be92-2414eae6da56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f4cba10fe824640b2ed37aab02346ac, user_id=821fb4ce82de47ca873fc22d29d4f957, role_id=4851b1a48d8a4188b335219acbede502)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:47.492775 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f63b6a4-4f8a-4fd7-be92-2414eae6da56 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:47.492978 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 307/618] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Nov 29 20:08:47 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:47.501771 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0fb73e-fb99-426f-9130-74edb7da7070 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:47.510384 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 312/619] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Nov 29 20:08:47 2021] PUT /identity/v3/projects/6f4cba10fe824640b2ed37aab02346ac/users/821fb4ce82de47ca873fc22d29d4f957/roles/4851b1a48d8a4188b335219acbede502 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:08:47.517394 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0fb73e-fb99-426f-9130-74edb7da7070 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:47.577717 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaacb063-5eb2-43fd-ad8e-5a91fd308c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:47.578756 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaacb063-5eb2-43fd-ad8e-5a91fd308c4a admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:47.579230 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaacb063-5eb2-43fd-ad8e-5a91fd308c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:47.579670 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaacb063-5eb2-43fd-ad8e-5a91fd308c4a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:47.592561 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaacb063-5eb2-43fd-ad8e-5a91fd308c4a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:47.594836 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaacb063-5eb2-43fd-ad8e-5a91fd308c4a admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:47.613070 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-aaacb063-5eb2-43fd-ad8e-5a91fd308c4a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:08:47.615030 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 308/620] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 114 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:08:47.623306 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63b6a4-4f8a-4fd7-be92-2414eae6da56 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:47.634448 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63b6a4-4f8a-4fd7-be92-2414eae6da56 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:47.642692 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550dd83-b9db-4cde-8ba1-9376b6bb0262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:47.643682 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550dd83-b9db-4cde-8ba1-9376b6bb0262 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:47.644113 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550dd83-b9db-4cde-8ba1-9376b6bb0262 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:47.644552 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4550dd83-b9db-4cde-8ba1-9376b6bb0262 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:47.645464 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4550dd83-b9db-4cde-8ba1-9376b6bb0262 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:47.645903 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4550dd83-b9db-4cde-8ba1-9376b6bb0262 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:47.647879 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4550dd83-b9db-4cde-8ba1-9376b6bb0262 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:47.660983 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 313/621] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:08:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:47.667841 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaacb063-5eb2-43fd-ad8e-5a91fd308c4a admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:47.678567 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaacb063-5eb2-43fd-ad8e-5a91fd308c4a admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:47.687072 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8226f3-3394-4380-bd4b-c6e1cfee5a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:47.688096 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8226f3-3394-4380-bd4b-c6e1cfee5a32 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:47.688509 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8226f3-3394-4380-bd4b-c6e1cfee5a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:47.689024 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8226f3-3394-4380-bd4b-c6e1cfee5a32 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:47.699286 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8226f3-3394-4380-bd4b-c6e1cfee5a32 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:47.701588 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8226f3-3394-4380-bd4b-c6e1cfee5a32 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:47.720744 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-8a8226f3-3394-4380-bd4b-c6e1cfee5a32 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 29 20:08:47.722514 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 309/622] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Nov 29 20:08:47 2021] GET /identity/v3/users/swift => generated 83 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:47.731252 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550dd83-b9db-4cde-8ba1-9376b6bb0262 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:47.744802 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4550dd83-b9db-4cde-8ba1-9376b6bb0262 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:47.751128 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b01bb-28e1-486d-9cfe-14e83d9ed32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:47.752041 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b01bb-28e1-486d-9cfe-14e83d9ed32f admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:47.752524 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b01bb-28e1-486d-9cfe-14e83d9ed32f admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:47.752991 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b01bb-28e1-486d-9cfe-14e83d9ed32f admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:47.754033 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b01bb-28e1-486d-9cfe-14e83d9ed32f admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:47.754478 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b01bb-28e1-486d-9cfe-14e83d9ed32f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:47.756593 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b01bb-28e1-486d-9cfe-14e83d9ed32f admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:47.786968 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 314/623] 10.222.0.15 () {56 vars in 1156 bytes} [Mon Nov 29 20:08:47 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:47.793861 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8226f3-3394-4380-bd4b-c6e1cfee5a32 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:47.809018 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8226f3-3394-4380-bd4b-c6e1cfee5a32 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:47.816456 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257586c-c7fa-49c9-8a33-406ebebc2cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:47.817401 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257586c-c7fa-49c9-8a33-406ebebc2cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:47.817817 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257586c-c7fa-49c9-8a33-406ebebc2cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:47.818273 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257586c-c7fa-49c9-8a33-406ebebc2cb5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:47.832026 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257586c-c7fa-49c9-8a33-406ebebc2cb5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:47.834086 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257586c-c7fa-49c9-8a33-406ebebc2cb5 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:47.849230 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 310/624] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:08:47 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:08:47.855230 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b01bb-28e1-486d-9cfe-14e83d9ed32f admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:47.873944 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b01bb-28e1-486d-9cfe-14e83d9ed32f admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:47.880468 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f452a9b-2ff3-41b7-902d-eed082235cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:47.881324 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f452a9b-2ff3-41b7-902d-eed082235cad admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:47.881648 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f452a9b-2ff3-41b7-902d-eed082235cad admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:47.881924 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f452a9b-2ff3-41b7-902d-eed082235cad admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:47.893250 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f452a9b-2ff3-41b7-902d-eed082235cad admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:47.895225 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f452a9b-2ff3-41b7-902d-eed082235cad admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:47.913192 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-0f452a9b-2ff3-41b7-902d-eed082235cad admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:08:47.914684 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 315/625] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:47.920388 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257586c-c7fa-49c9-8a33-406ebebc2cb5 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:47.929466 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257586c-c7fa-49c9-8a33-406ebebc2cb5 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:47.933996 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568f01f-51d6-4a8d-8f71-7c4a6af5b255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:47.934776 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568f01f-51d6-4a8d-8f71-7c4a6af5b255 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:47.935157 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568f01f-51d6-4a8d-8f71-7c4a6af5b255 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:47.935433 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568f01f-51d6-4a8d-8f71-7c4a6af5b255 admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:47.936170 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568f01f-51d6-4a8d-8f71-7c4a6af5b255 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:47.936527 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568f01f-51d6-4a8d-8f71-7c4a6af5b255 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:47.938166 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568f01f-51d6-4a8d-8f71-7c4a6af5b255 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:47.950959 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 311/626] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:08:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:47.956567 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f452a9b-2ff3-41b7-902d-eed082235cad admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:47.967209 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f452a9b-2ff3-41b7-902d-eed082235cad admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:47.971765 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b68b2c-5845-4ce7-a174-56084a33f0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:47.972594 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b68b2c-5845-4ce7-a174-56084a33f0fa admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:47.972876 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b68b2c-5845-4ce7-a174-56084a33f0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:47.973192 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b68b2c-5845-4ce7-a174-56084a33f0fa admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:47.980027 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b68b2c-5845-4ce7-a174-56084a33f0fa admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:47.981970 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b68b2c-5845-4ce7-a174-56084a33f0fa admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:47.995047 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-d8b68b2c-5845-4ce7-a174-56084a33f0fa admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 29 20:08:47.996412 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 316/627] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:08:47 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:48.002537 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568f01f-51d6-4a8d-8f71-7c4a6af5b255 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:48.012315 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568f01f-51d6-4a8d-8f71-7c4a6af5b255 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:48.017236 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e6a7ed-9cdf-4ada-953c-79201c183b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:48.017893 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6a7ed-9cdf-4ada-953c-79201c183b22 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:48.018172 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6a7ed-9cdf-4ada-953c-79201c183b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:48.018443 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6a7ed-9cdf-4ada-953c-79201c183b22 admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:48.019269 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e6a7ed-9cdf-4ada-953c-79201c183b22 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:48.019575 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e6a7ed-9cdf-4ada-953c-79201c183b22 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:48.021409 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e6a7ed-9cdf-4ada-953c-79201c183b22 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:48.034534 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 312/628] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Nov 29 20:08:48 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:48.040556 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b68b2c-5845-4ce7-a174-56084a33f0fa admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:48.056578 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b68b2c-5845-4ce7-a174-56084a33f0fa admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:48.067029 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e645963-cec6-4d47-888b-e7b47287d8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:48.067691 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e645963-cec6-4d47-888b-e7b47287d8a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:48.067970 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e645963-cec6-4d47-888b-e7b47287d8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:48.068245 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e645963-cec6-4d47-888b-e7b47287d8a7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:48.069090 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e645963-cec6-4d47-888b-e7b47287d8a7 admin admin] RBAC: Adding query filter params (role.id=4851b1a48d8a4188b335219acbede502, scope.project.id=6f4cba10fe824640b2ed37aab02346ac, user.id=51fc6fd9b37447bba1759a702b86ce6c) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:48.069394 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e645963-cec6-4d47-888b-e7b47287d8a7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:48.071266 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e645963-cec6-4d47-888b-e7b47287d8a7 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:48.083423 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 317/629] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:08:48 2021] GET /identity/v3/role_assignments?user.id=51fc6fd9b37447bba1759a702b86ce6c&scope.project.id=6f4cba10fe824640b2ed37aab02346ac&role.id=4851b1a48d8a4188b335219acbede502 => generated 259 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:49.335737 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f5865-31e1-4886-9947-f7156a06f4d2 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:49.336291 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f5865-31e1-4886-9947-f7156a06f4d2 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:49.336291 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f5865-31e1-4886-9947-f7156a06f4d2 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:49.338459 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 313/630] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:49.356801 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe94e5c-b337-478f-a921-f1795ccc7322 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:49.357288 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe94e5c-b337-478f-a921-f1795ccc7322 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:49.357361 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe94e5c-b337-478f-a921-f1795ccc7322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:49.384031 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-cbe94e5c-b337-478f-a921-f1795ccc7322 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:49.385286 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-cbe94e5c-b337-478f-a921-f1795ccc7322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:49.394143 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 318/631] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:49 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:49.436380 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f5865-31e1-4886-9947-f7156a06f4d2 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:49.452917 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f5865-31e1-4886-9947-f7156a06f4d2 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:49.462369 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a75fb2-2a4e-4a56-8bd6-2733b6612d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:49.463205 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a75fb2-2a4e-4a56-8bd6-2733b6612d8d admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:49.463484 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a75fb2-2a4e-4a56-8bd6-2733b6612d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:49.463762 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a75fb2-2a4e-4a56-8bd6-2733b6612d8d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:49.479768 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a75fb2-2a4e-4a56-8bd6-2733b6612d8d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:49.486685 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-c7a75fb2-2a4e-4a56-8bd6-2733b6612d8d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 29 20:08:49.487967 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 314/632] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Nov 29 20:08:49 2021] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:08:49.494361 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe94e5c-b337-478f-a921-f1795ccc7322 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:49.508973 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe94e5c-b337-478f-a921-f1795ccc7322 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:49.518870 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e4293-d26b-4c4f-9bd3-b4c32909a58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:49.518870 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e4293-d26b-4c4f-9bd3-b4c32909a58e admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:49.518870 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e4293-d26b-4c4f-9bd3-b4c32909a58e admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:49.518870 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e4293-d26b-4c4f-9bd3-b4c32909a58e admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:49.519201 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01e4293-d26b-4c4f-9bd3-b4c32909a58e admin admin] RBAC: Adding query filter params (name=service) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:49.519201 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01e4293-d26b-4c4f-9bd3-b4c32909a58e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:49.520574 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01e4293-d26b-4c4f-9bd3-b4c32909a58e admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:49.530199 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 319/633] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Nov 29 20:08:49 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:49.536047 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a75fb2-2a4e-4a56-8bd6-2733b6612d8d admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:49.553245 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a75fb2-2a4e-4a56-8bd6-2733b6612d8d admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:49.565956 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bbf5c7-b085-4308-b83a-467a00dd7214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:49.566772 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbf5c7-b085-4308-b83a-467a00dd7214 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:49.567082 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbf5c7-b085-4308-b83a-467a00dd7214 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:49.567355 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbf5c7-b085-4308-b83a-467a00dd7214 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:49.582495 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bbf5c7-b085-4308-b83a-467a00dd7214 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:49.584386 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bbf5c7-b085-4308-b83a-467a00dd7214 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:49.609139 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-90bbf5c7-b085-4308-b83a-467a00dd7214 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:08:49.610582 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 315/634] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:49.616556 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e4293-d26b-4c4f-9bd3-b4c32909a58e admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:49.632463 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e4293-d26b-4c4f-9bd3-b4c32909a58e admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:49.646169 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932eb1e-f286-4dcd-8ecf-7f8a5732395c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:49.647147 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932eb1e-f286-4dcd-8ecf-7f8a5732395c admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:49.647617 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932eb1e-f286-4dcd-8ecf-7f8a5732395c admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:49.648073 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f932eb1e-f286-4dcd-8ecf-7f8a5732395c admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:49.649026 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f932eb1e-f286-4dcd-8ecf-7f8a5732395c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:49.649515 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f932eb1e-f286-4dcd-8ecf-7f8a5732395c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:49.651316 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f932eb1e-f286-4dcd-8ecf-7f8a5732395c admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:49.664841 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 320/635] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:08:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:49.670817 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bbf5c7-b085-4308-b83a-467a00dd7214 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:49.686760 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bbf5c7-b085-4308-b83a-467a00dd7214 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:49.695356 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a868fa-9fd4-43e1-92e3-dd6295f9b869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:49.696196 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a868fa-9fd4-43e1-92e3-dd6295f9b869 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:49.696476 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a868fa-9fd4-43e1-92e3-dd6295f9b869 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:49.696749 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a868fa-9fd4-43e1-92e3-dd6295f9b869 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:49.710971 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a868fa-9fd4-43e1-92e3-dd6295f9b869 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:49.713002 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a868fa-9fd4-43e1-92e3-dd6295f9b869 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:49.728371 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-70a868fa-9fd4-43e1-92e3-dd6295f9b869 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 29 20:08:49.729746 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 316/636] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Nov 29 20:08:49 2021] GET /identity/v3/users/nova => generated 82 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:49.735815 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932eb1e-f286-4dcd-8ecf-7f8a5732395c admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:49.746362 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f932eb1e-f286-4dcd-8ecf-7f8a5732395c admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:49.758945 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e58119-5776-4c26-8a74-c970b9cea2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:49.759854 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e58119-5776-4c26-8a74-c970b9cea2f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:49.760319 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e58119-5776-4c26-8a74-c970b9cea2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:49.760778 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e58119-5776-4c26-8a74-c970b9cea2f7 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:49.761834 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e58119-5776-4c26-8a74-c970b9cea2f7 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:49.762325 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e58119-5776-4c26-8a74-c970b9cea2f7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:49.764777 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e58119-5776-4c26-8a74-c970b9cea2f7 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:49.788943 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 321/637] 10.222.0.15 () {56 vars in 1154 bytes} [Mon Nov 29 20:08:49 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:49.794786 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a868fa-9fd4-43e1-92e3-dd6295f9b869 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:49.805730 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a868fa-9fd4-43e1-92e3-dd6295f9b869 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:49.812438 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6554f6-945b-4285-b1ca-f55f82af19fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:49.813191 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6554f6-945b-4285-b1ca-f55f82af19fa admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:49.813478 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6554f6-945b-4285-b1ca-f55f82af19fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:49.813752 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6554f6-945b-4285-b1ca-f55f82af19fa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:49.824671 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6554f6-945b-4285-b1ca-f55f82af19fa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:49.826534 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6554f6-945b-4285-b1ca-f55f82af19fa admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:49.840634 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 317/638] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:08:49 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:08:49.846536 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e58119-5776-4c26-8a74-c970b9cea2f7 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:49.858269 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e58119-5776-4c26-8a74-c970b9cea2f7 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:49.864794 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4bd17-f93d-4097-89d4-e835763df15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:49.865526 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4bd17-f93d-4097-89d4-e835763df15e admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:49.865859 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4bd17-f93d-4097-89d4-e835763df15e admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:49.866135 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4bd17-f93d-4097-89d4-e835763df15e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:49.880063 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4bd17-f93d-4097-89d4-e835763df15e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:49.881914 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4bd17-f93d-4097-89d4-e835763df15e admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:49.902445 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-3dc4bd17-f93d-4097-89d4-e835763df15e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:08:49.903710 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 322/639] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:49.909845 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6554f6-945b-4285-b1ca-f55f82af19fa admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:49.919034 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6554f6-945b-4285-b1ca-f55f82af19fa admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:49.926983 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e920687-607a-4337-8049-10c4644202f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:49.927642 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e920687-607a-4337-8049-10c4644202f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:49.927922 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e920687-607a-4337-8049-10c4644202f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:49.928192 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e920687-607a-4337-8049-10c4644202f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:49.928927 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e920687-607a-4337-8049-10c4644202f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:49.929231 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e920687-607a-4337-8049-10c4644202f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:49.930814 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e920687-607a-4337-8049-10c4644202f5 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:49.945464 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 318/640] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:08:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:49.951452 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4bd17-f93d-4097-89d4-e835763df15e admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:49.962289 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4bd17-f93d-4097-89d4-e835763df15e admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:49.968319 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65b40d-ebec-47ec-baab-295f8d18849e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:49.969169 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65b40d-ebec-47ec-baab-295f8d18849e admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:49.969508 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65b40d-ebec-47ec-baab-295f8d18849e admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:49.969786 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65b40d-ebec-47ec-baab-295f8d18849e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:49.988411 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65b40d-ebec-47ec-baab-295f8d18849e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:49.990424 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65b40d-ebec-47ec-baab-295f8d18849e admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:50.014717 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-9c65b40d-ebec-47ec-baab-295f8d18849e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 29 20:08:50.016372 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 323/641] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:08:49 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:50.022559 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e920687-607a-4337-8049-10c4644202f5 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:50.041144 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e920687-607a-4337-8049-10c4644202f5 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:50.055564 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd756a-98be-45ea-9303-9481f9b36a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:50.056250 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd756a-98be-45ea-9303-9481f9b36a9b admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:50.056537 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd756a-98be-45ea-9303-9481f9b36a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:50.056812 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd756a-98be-45ea-9303-9481f9b36a9b admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:50.057631 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd756a-98be-45ea-9303-9481f9b36a9b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:50.057941 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd756a-98be-45ea-9303-9481f9b36a9b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:50.059840 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bd756a-98be-45ea-9303-9481f9b36a9b admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:50.072659 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e370f-63a5-44cb-868a-91f288f55abb None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:50.072983 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 319/642] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Nov 29 20:08:50 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:50.073108 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e370f-63a5-44cb-868a-91f288f55abb None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:50.073277 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e370f-63a5-44cb-868a-91f288f55abb None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:50.075365 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 324/643] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 29 20:08:50.081637 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd756a-98be-45ea-9303-9481f9b36a9b admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:50.087798 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffd63e-2d7a-49a1-adf9-eaabe0282ec1 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:50.088075 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffd63e-2d7a-49a1-adf9-eaabe0282ec1 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:50.088345 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffd63e-2d7a-49a1-adf9-eaabe0282ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:50.097534 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd756a-98be-45ea-9303-9481f9b36a9b admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:50.112666 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec255c4-9acf-4fbf-bc2d-d0662d6e01a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:50.113332 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec255c4-9acf-4fbf-bc2d-d0662d6e01a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:50.113607 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec255c4-9acf-4fbf-bc2d-d0662d6e01a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:50.113878 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec255c4-9acf-4fbf-bc2d-d0662d6e01a2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:50.114725 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec255c4-9acf-4fbf-bc2d-d0662d6e01a2 admin admin] RBAC: Adding query filter params (role.id=4851b1a48d8a4188b335219acbede502, scope.project.id=6f4cba10fe824640b2ed37aab02346ac, user.id=5f76a8c3d04e440b92d12ced18d97941) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:50.115108 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec255c4-9acf-4fbf-bc2d-d0662d6e01a2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:50.116891 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec255c4-9acf-4fbf-bc2d-d0662d6e01a2 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:50.119706 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-96ffd63e-2d7a-49a1-adf9-eaabe0282ec1 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:50.120896 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-96ffd63e-2d7a-49a1-adf9-eaabe0282ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:50.127218 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 320/644] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:08:50 2021] GET /identity/v3/role_assignments?user.id=5f76a8c3d04e440b92d12ced18d97941&scope.project.id=6f4cba10fe824640b2ed37aab02346ac&role.id=4851b1a48d8a4188b335219acbede502 => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:50.132595 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 325/645] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:50.149335 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125bdab7-2a1a-446b-8a70-6c27c284280a None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:50.149689 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125bdab7-2a1a-446b-8a70-6c27c284280a None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:50.149885 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125bdab7-2a1a-446b-8a70-6c27c284280a None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:50.151805 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 321/646] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:50.158366 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bc43b-d980-48a7-8045-2a74f891aa1b None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:50.158677 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bc43b-d980-48a7-8045-2a74f891aa1b None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:50.158936 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bc43b-d980-48a7-8045-2a74f891aa1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:50.166023 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125bdab7-2a1a-446b-8a70-6c27c284280a None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:50.184597 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125bdab7-2a1a-446b-8a70-6c27c284280a None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:50.194322 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1d2f4-1e49-4ce6-a804-b9f2fdd067bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:50.195261 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1d2f4-1e49-4ce6-a804-b9f2fdd067bd admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:50.195539 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1d2f4-1e49-4ce6-a804-b9f2fdd067bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:50.195815 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab1d2f4-1e49-4ce6-a804-b9f2fdd067bd admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:50.197141 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-cf5bc43b-d980-48a7-8045-2a74f891aa1b None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:50.198377 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-cf5bc43b-d980-48a7-8045-2a74f891aa1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:50.216881 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 326/647] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:50.219883 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab1d2f4-1e49-4ce6-a804-b9f2fdd067bd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:50.227215 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-aab1d2f4-1e49-4ce6-a804-b9f2fdd067bd admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 29 20:08:50.228661 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 322/648] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Nov 29 20:08:50 2021] GET /identity/v3/roles/service => generated 85 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:08:50.235158 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5bc43b-d980-48a7-8045-2a74f891aa1b None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:50.245343 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5bc43b-d980-48a7-8045-2a74f891aa1b None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:50.250086 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa016c2-d984-4805-9f21-d5b958bab24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:50.250764 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa016c2-d984-4805-9f21-d5b958bab24a admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:50.251112 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa016c2-d984-4805-9f21-d5b958bab24a admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:50.251434 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa016c2-d984-4805-9f21-d5b958bab24a admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:50.252201 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa016c2-d984-4805-9f21-d5b958bab24a admin admin] RBAC: Adding query filter params (name=service) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:50.252554 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa016c2-d984-4805-9f21-d5b958bab24a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:50.254269 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa016c2-d984-4805-9f21-d5b958bab24a admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:50.263936 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1d2f4-1e49-4ce6-a804-b9f2fdd067bd admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:50.278082 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 327/649] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Nov 29 20:08:50 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:50.279661 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa016c2-d984-4805-9f21-d5b958bab24a admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:50.282522 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab1d2f4-1e49-4ce6-a804-b9f2fdd067bd admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:50.292569 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3675a768-2cf1-4caa-ad07-264b84cbf02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:50.293430 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675a768-2cf1-4caa-ad07-264b84cbf02d admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:50.293697 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675a768-2cf1-4caa-ad07-264b84cbf02d admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:50.293966 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675a768-2cf1-4caa-ad07-264b84cbf02d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:50.300738 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa016c2-d984-4805-9f21-d5b958bab24a admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:50.311271 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04f190-c531-4527-ac66-804d74758a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:50.313401 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04f190-c531-4527-ac66-804d74758a69 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:50.314748 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04f190-c531-4527-ac66-804d74758a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:50.315043 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04f190-c531-4527-ac66-804d74758a69 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:50.316515 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3675a768-2cf1-4caa-ad07-264b84cbf02d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:50.330585 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-3675a768-2cf1-4caa-ad07-264b84cbf02d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 29 20:08:50.333773 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 323/650] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Nov 29 20:08:50 2021] GET /identity/v3/roles/service => generated 85 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:08:50.336411 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa04f190-c531-4527-ac66-804d74758a69 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:50.338405 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa04f190-c531-4527-ac66-804d74758a69 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:50.341292 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3675a768-2cf1-4caa-ad07-264b84cbf02d admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:50.358824 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3675a768-2cf1-4caa-ad07-264b84cbf02d admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:50.370036 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b8b72-fa4f-4a0f-ae49-492827266633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:50.370680 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b8b72-fa4f-4a0f-ae49-492827266633 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:50.370983 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b8b72-fa4f-4a0f-ae49-492827266633 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:50.371249 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b8b72-fa4f-4a0f-ae49-492827266633 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:50.372128 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b8b72-fa4f-4a0f-ae49-492827266633 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:50.372429 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b8b72-fa4f-4a0f-ae49-492827266633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:50.375672 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b8b72-fa4f-4a0f-ae49-492827266633 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:50.377054 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-aa04f190-c531-4527-ac66-804d74758a69 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:08:50.378525 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 328/651] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:08:50.385569 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04f190-c531-4527-ac66-804d74758a69 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:50.393920 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 324/652] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Nov 29 20:08:50 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:50.398884 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa04f190-c531-4527-ac66-804d74758a69 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:50.400080 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b8b72-fa4f-4a0f-ae49-492827266633 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:50.406444 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd39002-5a0e-4659-9965-1a18e3bd1c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:50.407149 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd39002-5a0e-4659-9965-1a18e3bd1c13 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:50.407445 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd39002-5a0e-4659-9965-1a18e3bd1c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:50.407759 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd39002-5a0e-4659-9965-1a18e3bd1c13 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:50.408507 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd39002-5a0e-4659-9965-1a18e3bd1c13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:50.408864 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd39002-5a0e-4659-9965-1a18e3bd1c13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:50.410562 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd39002-5a0e-4659-9965-1a18e3bd1c13 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:50.411910 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b8b72-fa4f-4a0f-ae49-492827266633 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:50.416429 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04de0c-e43d-4ce3-afdc-43d9dd224a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:50.417214 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04de0c-e43d-4ce3-afdc-43d9dd224a01 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:50.417489 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04de0c-e43d-4ce3-afdc-43d9dd224a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:50.417750 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04de0c-e43d-4ce3-afdc-43d9dd224a01 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:50.424063 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 329/653] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:08:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:50.428620 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b04de0c-e43d-4ce3-afdc-43d9dd224a01 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:50.429931 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd39002-5a0e-4659-9965-1a18e3bd1c13 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:50.430553 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b04de0c-e43d-4ce3-afdc-43d9dd224a01 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:50.440043 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd39002-5a0e-4659-9965-1a18e3bd1c13 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:50.444635 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755e400-36e4-4ff7-9266-310b679c0bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:50.445429 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755e400-36e4-4ff7-9266-310b679c0bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:50.445765 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755e400-36e4-4ff7-9266-310b679c0bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:50.446043 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4755e400-36e4-4ff7-9266-310b679c0bc1 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:50.449179 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-3b04de0c-e43d-4ce3-afdc-43d9dd224a01 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:08:50.451457 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 325/654] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:08:50.456056 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4755e400-36e4-4ff7-9266-310b679c0bc1 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:50.458145 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4755e400-36e4-4ff7-9266-310b679c0bc1 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:50.459451 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04de0c-e43d-4ce3-afdc-43d9dd224a01 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:50.469814 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04de0c-e43d-4ce3-afdc-43d9dd224a01 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:50.474732 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18479f-6c47-4536-8b4a-49a216169052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:50.475357 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-4755e400-36e4-4ff7-9266-310b679c0bc1 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Nov 29 20:08:50.476411 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18479f-6c47-4536-8b4a-49a216169052 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:50.476553 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 330/655] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:08:50 2021] GET /identity/v3/users/glance => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:08:50.477227 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18479f-6c47-4536-8b4a-49a216169052 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:50.477966 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18479f-6c47-4536-8b4a-49a216169052 admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:50.479286 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a18479f-6c47-4536-8b4a-49a216169052 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:50.479818 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a18479f-6c47-4536-8b4a-49a216169052 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:50.481679 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a18479f-6c47-4536-8b4a-49a216169052 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:50.483170 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755e400-36e4-4ff7-9266-310b679c0bc1 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:50.493027 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4755e400-36e4-4ff7-9266-310b679c0bc1 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:50.496053 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 326/656] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:08:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:50.500194 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea63d8-2db8-4d80-8d5a-89ef118a9882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:50.500859 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea63d8-2db8-4d80-8d5a-89ef118a9882 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:50.501132 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea63d8-2db8-4d80-8d5a-89ef118a9882 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:50.501399 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea63d8-2db8-4d80-8d5a-89ef118a9882 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:50.502472 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea63d8-2db8-4d80-8d5a-89ef118a9882 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:50.502720 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea63d8-2db8-4d80-8d5a-89ef118a9882 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:50.503867 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18479f-6c47-4536-8b4a-49a216169052 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:50.504592 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea63d8-2db8-4d80-8d5a-89ef118a9882 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:50.517475 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18479f-6c47-4536-8b4a-49a216169052 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:50.523547 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c1fae7-f59d-4bb0-959e-30f6c22fa125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:50.524655 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1fae7-f59d-4bb0-959e-30f6c22fa125 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:50.525201 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1fae7-f59d-4bb0-959e-30f6c22fa125 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:50.525674 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c1fae7-f59d-4bb0-959e-30f6c22fa125 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:50.526091 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 331/657] 10.222.0.15 () {56 vars in 1158 bytes} [Mon Nov 29 20:08:50 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:50.527422 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d2fd3-1891-4425-a007-1cf5496ea0e3 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:50.527705 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d2fd3-1891-4425-a007-1cf5496ea0e3 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:50.527974 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d2fd3-1891-4425-a007-1cf5496ea0e3 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:50.529591 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 332/658] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:50.535681 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d2fd3-1891-4425-a007-1cf5496ea0e3 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:50.541141 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c1fae7-f59d-4bb0-959e-30f6c22fa125 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:50.543418 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c1fae7-f59d-4bb0-959e-30f6c22fa125 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:50.549296 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d2fd3-1891-4425-a007-1cf5496ea0e3 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:50.553975 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876ca43-beda-47e9-9d76-7a98c4ce8813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:50.554834 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876ca43-beda-47e9-9d76-7a98c4ce8813 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:50.555236 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876ca43-beda-47e9-9d76-7a98c4ce8813 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:50.555607 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876ca43-beda-47e9-9d76-7a98c4ce8813 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:50.557341 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-e1c1fae7-f59d-4bb0-959e-30f6c22fa125 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 29 20:08:50.558720 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 327/659] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:08:50 2021] GET /identity/v3/users/cinder => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:50.559702 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091128e-7898-4436-a5fd-6258aa03e0ca None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:50.559977 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091128e-7898-4436-a5fd-6258aa03e0ca None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:50.560245 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091128e-7898-4436-a5fd-6258aa03e0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:50.571401 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876ca43-beda-47e9-9d76-7a98c4ce8813 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:50.573405 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876ca43-beda-47e9-9d76-7a98c4ce8813 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:50.578774 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-f091128e-7898-4436-a5fd-6258aa03e0ca None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:50.580001 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-f091128e-7898-4436-a5fd-6258aa03e0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:50.584403 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 333/660] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:08:50 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:08:50.586176 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876ca43-beda-47e9-9d76-7a98c4ce8813 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:50.590155 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 328/661] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:50.595966 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091128e-7898-4436-a5fd-6258aa03e0ca None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:50.599212 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876ca43-beda-47e9-9d76-7a98c4ce8813 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:50.603746 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b64a5-5d61-4b36-bdaf-17faf5160035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:50.604401 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b64a5-5d61-4b36-bdaf-17faf5160035 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:50.604676 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b64a5-5d61-4b36-bdaf-17faf5160035 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:50.604996 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b64a5-5d61-4b36-bdaf-17faf5160035 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:50.605234 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091128e-7898-4436-a5fd-6258aa03e0ca None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:50.605925 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b64a5-5d61-4b36-bdaf-17faf5160035 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:50.606224 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b64a5-5d61-4b36-bdaf-17faf5160035 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:50.608312 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b64a5-5d61-4b36-bdaf-17faf5160035 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:50.609815 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee9283-f715-4ae1-b83b-a421fc5309a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:50.610588 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee9283-f715-4ae1-b83b-a421fc5309a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:50.610893 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee9283-f715-4ae1-b83b-a421fc5309a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:50.611681 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee9283-f715-4ae1-b83b-a421fc5309a8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:50.622534 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee9283-f715-4ae1-b83b-a421fc5309a8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:50.624480 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee9283-f715-4ae1-b83b-a421fc5309a8 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:50.626794 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 334/662] 10.222.0.15 () {56 vars in 1158 bytes} [Mon Nov 29 20:08:50 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:50.632586 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b64a5-5d61-4b36-bdaf-17faf5160035 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:50.642151 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-35ee9283-f715-4ae1-b83b-a421fc5309a8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:08:50.645461 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b64a5-5d61-4b36-bdaf-17faf5160035 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:50.645574 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 329/663] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:50.645574 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee9283-f715-4ae1-b83b-a421fc5309a8 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:50.653285 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea81e49d-1663-46b8-9f00-7d99bd65afa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:50.653934 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81e49d-1663-46b8-9f00-7d99bd65afa8 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:50.654261 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81e49d-1663-46b8-9f00-7d99bd65afa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:50.654762 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81e49d-1663-46b8-9f00-7d99bd65afa8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:50.659505 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee9283-f715-4ae1-b83b-a421fc5309a8 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:50.664054 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf4fadd-3fab-4752-96b5-08ad50b0d2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:50.664305 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea81e49d-1663-46b8-9f00-7d99bd65afa8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:50.664836 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4fadd-3fab-4752-96b5-08ad50b0d2f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:50.665112 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4fadd-3fab-4752-96b5-08ad50b0d2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:50.665383 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4fadd-3fab-4752-96b5-08ad50b0d2f7 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:50.666098 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea81e49d-1663-46b8-9f00-7d99bd65afa8 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:50.675690 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf4fadd-3fab-4752-96b5-08ad50b0d2f7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:50.676794 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 335/664] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:08:50 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:08:50.677583 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea81e49d-1663-46b8-9f00-7d99bd65afa8 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:50.687974 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea81e49d-1663-46b8-9f00-7d99bd65afa8 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:50.688109 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-fdf4fadd-3fab-4752-96b5-08ad50b0d2f7 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 29 20:08:50.694671 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 330/665] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Nov 29 20:08:50 2021] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:50.695676 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf4fadd-3fab-4752-96b5-08ad50b0d2f7 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:50.696118 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90fa1a-f2c2-4191-a5cb-1a51ad36ee06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:50.696874 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90fa1a-f2c2-4191-a5cb-1a51ad36ee06 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:50.697197 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90fa1a-f2c2-4191-a5cb-1a51ad36ee06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:50.697465 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90fa1a-f2c2-4191-a5cb-1a51ad36ee06 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:50.698279 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90fa1a-f2c2-4191-a5cb-1a51ad36ee06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:50.698584 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90fa1a-f2c2-4191-a5cb-1a51ad36ee06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:50.700253 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90fa1a-f2c2-4191-a5cb-1a51ad36ee06 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:50.707408 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf4fadd-3fab-4752-96b5-08ad50b0d2f7 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:50.711944 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466512e2-67e1-4646-9dcd-8eba27326af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:50.712721 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466512e2-67e1-4646-9dcd-8eba27326af8 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:50.713003 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466512e2-67e1-4646-9dcd-8eba27326af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:50.713285 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466512e2-67e1-4646-9dcd-8eba27326af8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:50.713764 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 336/666] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:08:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:50.719893 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90fa1a-f2c2-4191-a5cb-1a51ad36ee06 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:50.727866 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466512e2-67e1-4646-9dcd-8eba27326af8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:50.729725 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466512e2-67e1-4646-9dcd-8eba27326af8 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:50.730983 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90fa1a-f2c2-4191-a5cb-1a51ad36ee06 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:50.736230 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0053f-9d01-44a3-bf78-e99dae9cda00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:50.737314 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0053f-9d01-44a3-bf78-e99dae9cda00 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:50.737593 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0053f-9d01-44a3-bf78-e99dae9cda00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:50.737863 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc0053f-9d01-44a3-bf78-e99dae9cda00 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:50.739112 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc0053f-9d01-44a3-bf78-e99dae9cda00 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:50.739349 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc0053f-9d01-44a3-bf78-e99dae9cda00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:50.741204 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc0053f-9d01-44a3-bf78-e99dae9cda00 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:50.748377 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-466512e2-67e1-4646-9dcd-8eba27326af8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:08:50.749736 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 337/667] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Nov 29 20:08:50 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:50.750553 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0053f-9d01-44a3-bf78-e99dae9cda00 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:50.755140 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 331/668] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:50.755967 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466512e2-67e1-4646-9dcd-8eba27326af8 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:50.765532 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc0053f-9d01-44a3-bf78-e99dae9cda00 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:50.771123 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466512e2-67e1-4646-9dcd-8eba27326af8 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:50.771403 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54552025-b0bc-43b6-8a2a-717ff2e7ae5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:50.772312 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54552025-b0bc-43b6-8a2a-717ff2e7ae5e admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:50.772668 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54552025-b0bc-43b6-8a2a-717ff2e7ae5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:50.772921 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54552025-b0bc-43b6-8a2a-717ff2e7ae5e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:50.775801 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e0a51-d6be-4fb1-a11f-7071b34fae7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:50.776592 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e0a51-d6be-4fb1-a11f-7071b34fae7e admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:50.776872 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e0a51-d6be-4fb1-a11f-7071b34fae7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:50.777143 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e0a51-d6be-4fb1-a11f-7071b34fae7e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:50.781615 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54552025-b0bc-43b6-8a2a-717ff2e7ae5e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:50.784165 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54552025-b0bc-43b6-8a2a-717ff2e7ae5e admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:50.787452 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e0a51-d6be-4fb1-a11f-7071b34fae7e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:50.789291 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e0a51-d6be-4fb1-a11f-7071b34fae7e admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:50.799573 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-54552025-b0bc-43b6-8a2a-717ff2e7ae5e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 29 20:08:50.800923 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 338/669] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:08:50 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:50.801869 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54552025-b0bc-43b6-8a2a-717ff2e7ae5e admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:50.805901 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-1f6e0a51-d6be-4fb1-a11f-7071b34fae7e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:08:50.807381 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 332/670] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:50.813551 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d9c05-a9fa-49b2-81e8-a785080fbf66 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:50.813835 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d9c05-a9fa-49b2-81e8-a785080fbf66 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:50.814114 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8d9c05-a9fa-49b2-81e8-a785080fbf66 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:50.815895 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 333/671] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:50 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:50.816572 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d9c05-a9fa-49b2-81e8-a785080fbf66 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:50.822981 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54552025-b0bc-43b6-8a2a-717ff2e7ae5e admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:50.830973 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8d9c05-a9fa-49b2-81e8-a785080fbf66 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:50.831318 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feecacd6-6d9f-464e-a0a3-ec57d24e1150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:50.831989 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecacd6-6d9f-464e-a0a3-ec57d24e1150 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:50.832272 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecacd6-6d9f-464e-a0a3-ec57d24e1150 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:50.832549 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feecacd6-6d9f-464e-a0a3-ec57d24e1150 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:50.833288 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feecacd6-6d9f-464e-a0a3-ec57d24e1150 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:50.833592 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feecacd6-6d9f-464e-a0a3-ec57d24e1150 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:50.835230 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feecacd6-6d9f-464e-a0a3-ec57d24e1150 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:50.836253 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38702b7-bc63-4cc3-9269-856985f0700b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:50.836897 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38702b7-bc63-4cc3-9269-856985f0700b admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:50.837183 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38702b7-bc63-4cc3-9269-856985f0700b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:50.837438 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38702b7-bc63-4cc3-9269-856985f0700b admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:50.838256 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38702b7-bc63-4cc3-9269-856985f0700b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:50.838545 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38702b7-bc63-4cc3-9269-856985f0700b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:50.840430 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38702b7-bc63-4cc3-9269-856985f0700b admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:50.847582 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 339/672] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:08:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:50.852514 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 334/673] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Nov 29 20:08:50 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:50.853624 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feecacd6-6d9f-464e-a0a3-ec57d24e1150 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:50.856115 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0f796-90c5-4c9d-9b09-a140954650a0 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:50.856608 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0f796-90c5-4c9d-9b09-a140954650a0 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:50.857067 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d0f796-90c5-4c9d-9b09-a140954650a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:50.863484 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feecacd6-6d9f-464e-a0a3-ec57d24e1150 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:50.867921 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5729a3-231d-4bb0-b05c-8bb9af10d6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:50.868571 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5729a3-231d-4bb0-b05c-8bb9af10d6f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:50.868852 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5729a3-231d-4bb0-b05c-8bb9af10d6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:50.869126 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5729a3-231d-4bb0-b05c-8bb9af10d6f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:50.869853 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5729a3-231d-4bb0-b05c-8bb9af10d6f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:50.870156 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5729a3-231d-4bb0-b05c-8bb9af10d6f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:50.871842 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5729a3-231d-4bb0-b05c-8bb9af10d6f7 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:50.877613 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-83d0f796-90c5-4c9d-9b09-a140954650a0 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:50.879462 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-83d0f796-90c5-4c9d-9b09-a140954650a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:50.883310 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 340/674] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:08:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:50.883903 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5729a3-231d-4bb0-b05c-8bb9af10d6f7 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:50.893212 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 335/675] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:50 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:50.894182 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d0f796-90c5-4c9d-9b09-a140954650a0 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:50.902808 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d0f796-90c5-4c9d-9b09-a140954650a0 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:50.903640 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5729a3-231d-4bb0-b05c-8bb9af10d6f7 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:50.907253 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f266b-598e-4d7b-ac06-1b19cee58f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:50.907864 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f266b-598e-4d7b-ac06-1b19cee58f0c admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:50.908152 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f266b-598e-4d7b-ac06-1b19cee58f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:50.908403 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f266b-598e-4d7b-ac06-1b19cee58f0c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:50.909099 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41df42-c5e9-4329-9ee5-fa8d707cefee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:50.909224 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f266b-598e-4d7b-ac06-1b19cee58f0c admin admin] RBAC: Adding query filter params (role.id=4851b1a48d8a4188b335219acbede502, scope.project.id=6f4cba10fe824640b2ed37aab02346ac, user.id=bcc415af1f5a42febbdbd187e066cf85) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:50.909529 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f266b-598e-4d7b-ac06-1b19cee58f0c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:50.910344 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41df42-c5e9-4329-9ee5-fa8d707cefee admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:50.910828 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41df42-c5e9-4329-9ee5-fa8d707cefee admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:50.911301 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca41df42-c5e9-4329-9ee5-fa8d707cefee admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:50.911420 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f266b-598e-4d7b-ac06-1b19cee58f0c admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:50.917431 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 336/676] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:08:50 2021] GET /identity/v3/role_assignments?user.id=bcc415af1f5a42febbdbd187e066cf85&scope.project.id=6f4cba10fe824640b2ed37aab02346ac&role.id=4851b1a48d8a4188b335219acbede502 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:50.918316 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f266b-598e-4d7b-ac06-1b19cee58f0c admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:50.919938 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca41df42-c5e9-4329-9ee5-fa8d707cefee admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:50.922362 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca41df42-c5e9-4329-9ee5-fa8d707cefee admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:50.927998 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f266b-598e-4d7b-ac06-1b19cee58f0c admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:50.932736 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b8ca5-3bb1-4495-aa9a-04f9364e0fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:50.933622 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b8ca5-3bb1-4495-aa9a-04f9364e0fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:50.933900 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b8ca5-3bb1-4495-aa9a-04f9364e0fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:50.934169 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b8ca5-3bb1-4495-aa9a-04f9364e0fb8 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:50.940279 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-ca41df42-c5e9-4329-9ee5-fa8d707cefee admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 29 20:08:50.946924 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 341/677] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:08:50 2021] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:50.946924 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41df42-c5e9-4329-9ee5-fa8d707cefee admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:50.948813 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b8ca5-3bb1-4495-aa9a-04f9364e0fb8 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:50.950886 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b8ca5-3bb1-4495-aa9a-04f9364e0fb8 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:50.959347 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca41df42-c5e9-4329-9ee5-fa8d707cefee admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:50.964885 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb765d-71d5-4089-83f8-47d5b1b26c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:50.966128 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb765d-71d5-4089-83f8-47d5b1b26c3c admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:50.966613 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb765d-71d5-4089-83f8-47d5b1b26c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:50.967171 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb765d-71d5-4089-83f8-47d5b1b26c3c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:50.968385 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-974b8ca5-3bb1-4495-aa9a-04f9364e0fb8 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Nov 29 20:08:50.969643 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 337/678] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Nov 29 20:08:50 2021] GET /identity/v3/users/neutron => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:50.970490 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b8ca5-3bb1-4495-aa9a-04f9364e0fb8 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:50.980627 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b8ca5-3bb1-4495-aa9a-04f9364e0fb8 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:50.983209 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb765d-71d5-4089-83f8-47d5b1b26c3c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:50.985485 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef10106-105b-4c8f-8de1-0d3349f4512b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:50.986156 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef10106-105b-4c8f-8de1-0d3349f4512b admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:50.986474 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef10106-105b-4c8f-8de1-0d3349f4512b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:50.986753 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef10106-105b-4c8f-8de1-0d3349f4512b admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:50.987597 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef10106-105b-4c8f-8de1-0d3349f4512b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:50.987939 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef10106-105b-4c8f-8de1-0d3349f4512b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:50.989918 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef10106-105b-4c8f-8de1-0d3349f4512b admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:51.000787 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-8ceb765d-71d5-4089-83f8-47d5b1b26c3c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 29 20:08:51.008899 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 338/680] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Nov 29 20:08:50 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:51.008899 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef10106-105b-4c8f-8de1-0d3349f4512b admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:51.009175 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 342/680] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Nov 29 20:08:50 2021] GET /identity/v3/roles/service => generated 85 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:51.012277 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb765d-71d5-4089-83f8-47d5b1b26c3c admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:51.020906 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef10106-105b-4c8f-8de1-0d3349f4512b admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:51.025892 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb25cf-bfc7-4895-89dd-0103f2229d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:51.026643 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb25cf-bfc7-4895-89dd-0103f2229d88 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:51.026956 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb25cf-bfc7-4895-89dd-0103f2229d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:51.027230 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb25cf-bfc7-4895-89dd-0103f2229d88 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:51.028148 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb25cf-bfc7-4895-89dd-0103f2229d88 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:51.028452 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb25cf-bfc7-4895-89dd-0103f2229d88 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:51.029971 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb765d-71d5-4089-83f8-47d5b1b26c3c admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:51.030429 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb25cf-bfc7-4895-89dd-0103f2229d88 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:51.037148 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c1544-42bd-48de-ba2b-1d6394340666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:51.038595 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c1544-42bd-48de-ba2b-1d6394340666 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:51.039673 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c1544-42bd-48de-ba2b-1d6394340666 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:51.040365 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c1544-42bd-48de-ba2b-1d6394340666 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:51.043209 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489c1544-42bd-48de-ba2b-1d6394340666 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:51.043532 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489c1544-42bd-48de-ba2b-1d6394340666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:51.049194 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489c1544-42bd-48de-ba2b-1d6394340666 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:51.052120 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 339/681] 10.222.0.15 () {56 vars in 1160 bytes} [Mon Nov 29 20:08:51 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:51.052861 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb25cf-bfc7-4895-89dd-0103f2229d88 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:51.062895 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb25cf-bfc7-4895-89dd-0103f2229d88 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:51.064978 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 343/682] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Nov 29 20:08:51 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:51.066484 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c1544-42bd-48de-ba2b-1d6394340666 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:51.067822 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65377c8b-60be-4899-8edf-230c21753cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:51.068684 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65377c8b-60be-4899-8edf-230c21753cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:51.069127 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65377c8b-60be-4899-8edf-230c21753cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:51.069567 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65377c8b-60be-4899-8edf-230c21753cf0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:51.070650 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65377c8b-60be-4899-8edf-230c21753cf0 admin admin] RBAC: Adding query filter params (role.id=4851b1a48d8a4188b335219acbede502, scope.project.id=6f4cba10fe824640b2ed37aab02346ac, user.id=9508e6f2ac414098872e2584f1ed7393) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:51.071120 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65377c8b-60be-4899-8edf-230c21753cf0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:51.073215 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65377c8b-60be-4899-8edf-230c21753cf0 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:51.080098 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c1544-42bd-48de-ba2b-1d6394340666 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:51.080577 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 340/683] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:08:51 2021] GET /identity/v3/role_assignments?user.id=9508e6f2ac414098872e2584f1ed7393&scope.project.id=6f4cba10fe824640b2ed37aab02346ac&role.id=4851b1a48d8a4188b335219acbede502 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:51.081772 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65377c8b-60be-4899-8edf-230c21753cf0 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:51.095593 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a8db7-79c7-4563-98d6-5a7bed1e27e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:51.097110 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a8db7-79c7-4563-98d6-5a7bed1e27e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:51.098546 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a8db7-79c7-4563-98d6-5a7bed1e27e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:51.099001 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a8db7-79c7-4563-98d6-5a7bed1e27e5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:51.107321 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65377c8b-60be-4899-8edf-230c21753cf0 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:51.117313 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909e547-e91c-41aa-afe5-5e5d76ac85dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:51.118524 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a8db7-79c7-4563-98d6-5a7bed1e27e5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:51.119702 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909e547-e91c-41aa-afe5-5e5d76ac85dd admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:51.121195 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909e547-e91c-41aa-afe5-5e5d76ac85dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:51.121659 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909e547-e91c-41aa-afe5-5e5d76ac85dd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:51.122804 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924a8db7-79c7-4563-98d6-5a7bed1e27e5 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:51.142058 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b909e547-e91c-41aa-afe5-5e5d76ac85dd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:51.144192 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b909e547-e91c-41aa-afe5-5e5d76ac85dd admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:51.146071 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 344/684] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:08:51 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:08:51.152195 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a8db7-79c7-4563-98d6-5a7bed1e27e5 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:51.163480 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-b909e547-e91c-41aa-afe5-5e5d76ac85dd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:08:51.165034 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 341/685] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:51.168581 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a8db7-79c7-4563-98d6-5a7bed1e27e5 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:51.172188 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909e547-e91c-41aa-afe5-5e5d76ac85dd admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:51.181682 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce5928-343d-4d44-92fd-138bc921f1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:51.182655 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce5928-343d-4d44-92fd-138bc921f1c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:51.183060 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce5928-343d-4d44-92fd-138bc921f1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:51.183456 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce5928-343d-4d44-92fd-138bc921f1c0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:51.184040 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909e547-e91c-41aa-afe5-5e5d76ac85dd admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:51.194687 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea5aa9-8fd6-4797-ae1a-bee32b5ad776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:51.196765 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea5aa9-8fd6-4797-ae1a-bee32b5ad776 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:51.197271 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea5aa9-8fd6-4797-ae1a-bee32b5ad776 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:51.198382 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea5aa9-8fd6-4797-ae1a-bee32b5ad776 admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:51.199917 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea5aa9-8fd6-4797-ae1a-bee32b5ad776 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:51.201505 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea5aa9-8fd6-4797-ae1a-bee32b5ad776 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:51.204224 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea5aa9-8fd6-4797-ae1a-bee32b5ad776 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:51.209945 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce5928-343d-4d44-92fd-138bc921f1c0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:51.214560 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce5928-343d-4d44-92fd-138bc921f1c0 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:51.223830 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 342/686] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:08:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:51.232411 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea5aa9-8fd6-4797-ae1a-bee32b5ad776 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:51.240472 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-88ce5928-343d-4d44-92fd-138bc921f1c0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:08:51.242314 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 345/687] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:08:51.244821 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea5aa9-8fd6-4797-ae1a-bee32b5ad776 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:51.251128 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce5928-343d-4d44-92fd-138bc921f1c0 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:51.264176 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce5928-343d-4d44-92fd-138bc921f1c0 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:51.264739 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479051e-b571-4f5c-bf1e-a492370d59f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:51.267360 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479051e-b571-4f5c-bf1e-a492370d59f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:51.267360 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479051e-b571-4f5c-bf1e-a492370d59f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:51.267360 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479051e-b571-4f5c-bf1e-a492370d59f9 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:51.272777 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02629dc-f65b-41a3-93d8-7510c2286195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:51.273751 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02629dc-f65b-41a3-93d8-7510c2286195 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:51.274244 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02629dc-f65b-41a3-93d8-7510c2286195 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:51.274695 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02629dc-f65b-41a3-93d8-7510c2286195 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:51.275666 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02629dc-f65b-41a3-93d8-7510c2286195 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:51.276203 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02629dc-f65b-41a3-93d8-7510c2286195 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:51.278101 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02629dc-f65b-41a3-93d8-7510c2286195 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:51.279347 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5479051e-b571-4f5c-bf1e-a492370d59f9 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:51.281667 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5479051e-b571-4f5c-bf1e-a492370d59f9 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:51.291872 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 346/688] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:08:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:51.298363 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02629dc-f65b-41a3-93d8-7510c2286195 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:51.298682 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-5479051e-b571-4f5c-bf1e-a492370d59f9 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 29 20:08:51.300468 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 343/689] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Nov 29 20:08:51 2021] GET /identity/v3/users/swift => generated 83 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:51.306827 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479051e-b571-4f5c-bf1e-a492370d59f9 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:51.309533 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02629dc-f65b-41a3-93d8-7510c2286195 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:51.315335 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72391cff-17fe-4a23-8f09-7ab8a0da86f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:51.316287 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72391cff-17fe-4a23-8f09-7ab8a0da86f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:51.316667 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72391cff-17fe-4a23-8f09-7ab8a0da86f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:51.317042 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72391cff-17fe-4a23-8f09-7ab8a0da86f8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:51.318199 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479051e-b571-4f5c-bf1e-a492370d59f9 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:51.323120 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf07c7-cf5a-4296-a297-8f3b01372433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:51.323996 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf07c7-cf5a-4296-a297-8f3b01372433 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:51.324442 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf07c7-cf5a-4296-a297-8f3b01372433 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:51.324852 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf07c7-cf5a-4296-a297-8f3b01372433 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:51.325837 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf07c7-cf5a-4296-a297-8f3b01372433 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:51.326196 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72391cff-17fe-4a23-8f09-7ab8a0da86f8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:51.326436 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf07c7-cf5a-4296-a297-8f3b01372433 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:51.328493 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72391cff-17fe-4a23-8f09-7ab8a0da86f8 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:51.328682 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf07c7-cf5a-4296-a297-8f3b01372433 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:51.344205 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-72391cff-17fe-4a23-8f09-7ab8a0da86f8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 29 20:08:51.348493 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 344/691] 10.222.0.15 () {56 vars in 1156 bytes} [Mon Nov 29 20:08:51 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:51.348960 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 347/691] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:08:51 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:51.353183 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72391cff-17fe-4a23-8f09-7ab8a0da86f8 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:51.355613 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf07c7-cf5a-4296-a297-8f3b01372433 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:51.363765 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72391cff-17fe-4a23-8f09-7ab8a0da86f8 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:51.370376 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf07c7-cf5a-4296-a297-8f3b01372433 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:51.376095 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb06996-5b88-4d66-8c7b-b6ad4779f34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:51.376988 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb06996-5b88-4d66-8c7b-b6ad4779f34d admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:51.377421 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb06996-5b88-4d66-8c7b-b6ad4779f34d admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:51.378266 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb06996-5b88-4d66-8c7b-b6ad4779f34d admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:51.378716 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddce44b-e687-4852-85fa-333a3f0015e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:51.379184 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb06996-5b88-4d66-8c7b-b6ad4779f34d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:51.379486 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb06996-5b88-4d66-8c7b-b6ad4779f34d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:51.379915 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddce44b-e687-4852-85fa-333a3f0015e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:51.380311 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddce44b-e687-4852-85fa-333a3f0015e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:51.380731 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddce44b-e687-4852-85fa-333a3f0015e3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:51.381369 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb06996-5b88-4d66-8c7b-b6ad4779f34d admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:51.396735 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 348/692] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Nov 29 20:08:51 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:51.402997 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddce44b-e687-4852-85fa-333a3f0015e3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:51.403271 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb06996-5b88-4d66-8c7b-b6ad4779f34d admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:51.404887 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddce44b-e687-4852-85fa-333a3f0015e3 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:51.414422 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb06996-5b88-4d66-8c7b-b6ad4779f34d admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:51.419682 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ef7a1-205a-4a73-94c9-fc7b88e061e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:51.420369 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ef7a1-205a-4a73-94c9-fc7b88e061e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:51.420652 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ef7a1-205a-4a73-94c9-fc7b88e061e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:51.420962 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542ef7a1-205a-4a73-94c9-fc7b88e061e6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:51.421837 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ef7a1-205a-4a73-94c9-fc7b88e061e6 admin admin] RBAC: Adding query filter params (role.id=4851b1a48d8a4188b335219acbede502, scope.project.id=6f4cba10fe824640b2ed37aab02346ac, user.id=821fb4ce82de47ca873fc22d29d4f957) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:51.422150 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ef7a1-205a-4a73-94c9-fc7b88e061e6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:51.424020 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542ef7a1-205a-4a73-94c9-fc7b88e061e6 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:51.425363 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-8ddce44b-e687-4852-85fa-333a3f0015e3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:08:51.426751 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 345/693] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:08:51.432116 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 349/694] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:08:51 2021] GET /identity/v3/role_assignments?user.id=821fb4ce82de47ca873fc22d29d4f957&scope.project.id=6f4cba10fe824640b2ed37aab02346ac&role.id=4851b1a48d8a4188b335219acbede502 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:51.433967 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddce44b-e687-4852-85fa-333a3f0015e3 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:51.448858 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddce44b-e687-4852-85fa-333a3f0015e3 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:51.454560 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf91cc-be70-44c0-8e3f-a614d9cc2893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:51.455294 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf91cc-be70-44c0-8e3f-a614d9cc2893 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:51.455574 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf91cc-be70-44c0-8e3f-a614d9cc2893 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:51.455843 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf91cc-be70-44c0-8e3f-a614d9cc2893 admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:51.456595 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf91cc-be70-44c0-8e3f-a614d9cc2893 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:51.456898 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf91cc-be70-44c0-8e3f-a614d9cc2893 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:51.458558 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf91cc-be70-44c0-8e3f-a614d9cc2893 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:51.474287 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 346/695] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:08:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:51.480431 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ef7a1-205a-4a73-94c9-fc7b88e061e6 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:51.497168 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542ef7a1-205a-4a73-94c9-fc7b88e061e6 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:51.503955 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe9b2e-bce9-42d7-8947-980ff0a3869d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:51.505096 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe9b2e-bce9-42d7-8947-980ff0a3869d admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:51.505634 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe9b2e-bce9-42d7-8947-980ff0a3869d admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:51.506083 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe9b2e-bce9-42d7-8947-980ff0a3869d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:51.520401 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe9b2e-bce9-42d7-8947-980ff0a3869d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:51.522412 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe9b2e-bce9-42d7-8947-980ff0a3869d admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:51.542990 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-70fe9b2e-bce9-42d7-8947-980ff0a3869d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 29 20:08:51.544524 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 350/696] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:08:51 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:51.550706 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf91cc-be70-44c0-8e3f-a614d9cc2893 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:51.563961 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf91cc-be70-44c0-8e3f-a614d9cc2893 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:51.587783 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f878c-9227-4495-9ec6-c6fdb721cd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:51.588472 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f878c-9227-4495-9ec6-c6fdb721cd5f admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:51.588752 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f878c-9227-4495-9ec6-c6fdb721cd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:51.589020 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f878c-9227-4495-9ec6-c6fdb721cd5f admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:51.589840 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f878c-9227-4495-9ec6-c6fdb721cd5f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:51.590143 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f878c-9227-4495-9ec6-c6fdb721cd5f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:51.592021 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f878c-9227-4495-9ec6-c6fdb721cd5f admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:51.614455 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 347/697] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Nov 29 20:08:51 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:51.621073 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe9b2e-bce9-42d7-8947-980ff0a3869d admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:51.637160 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe9b2e-bce9-42d7-8947-980ff0a3869d admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:51.653256 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f77ca-84c4-40e8-80b4-6ade936d48e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:51.654082 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f77ca-84c4-40e8-80b4-6ade936d48e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:51.654378 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f77ca-84c4-40e8-80b4-6ade936d48e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:51.654633 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f77ca-84c4-40e8-80b4-6ade936d48e0 admin admin] PATH_INFO: `/v3/projects/6f4cba10fe824640b2ed37aab02346ac/users/51fc6fd9b37447bba1759a702b86ce6c/roles/4851b1a48d8a4188b335219acbede502` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:51.684514 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f77ca-84c4-40e8-80b4-6ade936d48e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f4cba10fe824640b2ed37aab02346ac, user_id=51fc6fd9b37447bba1759a702b86ce6c, role_id=4851b1a48d8a4188b335219acbede502)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:51.687271 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f77ca-84c4-40e8-80b4-6ade936d48e0 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:51.708534 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 351/698] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Nov 29 20:08:51 2021] PUT /identity/v3/projects/6f4cba10fe824640b2ed37aab02346ac/users/51fc6fd9b37447bba1759a702b86ce6c/roles/4851b1a48d8a4188b335219acbede502 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:08:53.228947 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402251b-eabb-488e-a9ac-c670a8785dac None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:53.229472 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402251b-eabb-488e-a9ac-c670a8785dac None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:53.229472 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402251b-eabb-488e-a9ac-c670a8785dac None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:53.231294 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 348/699] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:53.237473 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011f07c-5373-45cc-80f1-be96e75cc185 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:53.238295 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011f07c-5373-45cc-80f1-be96e75cc185 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:53.238764 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011f07c-5373-45cc-80f1-be96e75cc185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:53.264724 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-1011f07c-5373-45cc-80f1-be96e75cc185 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:53.266288 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-1011f07c-5373-45cc-80f1-be96e75cc185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:53.346755 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 352/700] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:53 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 29 20:08:53.370742 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0402251b-eabb-488e-a9ac-c670a8785dac None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:53.388753 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0402251b-eabb-488e-a9ac-c670a8785dac None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:53.393585 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25e291-fdd5-401f-8a17-e405b92246f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:53.394632 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25e291-fdd5-401f-8a17-e405b92246f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:53.395133 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25e291-fdd5-401f-8a17-e405b92246f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:53.395660 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25e291-fdd5-401f-8a17-e405b92246f8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:53.411851 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e25e291-fdd5-401f-8a17-e405b92246f8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:53.418992 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-1e25e291-fdd5-401f-8a17-e405b92246f8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 29 20:08:53.420407 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 349/701] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Nov 29 20:08:53 2021] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:53.426914 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1011f07c-5373-45cc-80f1-be96e75cc185 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:53.436152 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1011f07c-5373-45cc-80f1-be96e75cc185 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:53.447505 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541b653-f544-4539-8aee-5e563cbc9c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:53.448174 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541b653-f544-4539-8aee-5e563cbc9c53 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:53.448452 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541b653-f544-4539-8aee-5e563cbc9c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:53.448722 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3541b653-f544-4539-8aee-5e563cbc9c53 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:53.449599 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3541b653-f544-4539-8aee-5e563cbc9c53 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:53.449901 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3541b653-f544-4539-8aee-5e563cbc9c53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:53.451512 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3541b653-f544-4539-8aee-5e563cbc9c53 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:53.464146 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 353/702] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:08:53 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:53.470305 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25e291-fdd5-401f-8a17-e405b92246f8 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:53.480523 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25e291-fdd5-401f-8a17-e405b92246f8 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:53.489827 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e67d39-773d-43f8-84db-eb05248f44cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:53.490618 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e67d39-773d-43f8-84db-eb05248f44cf admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:53.490922 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e67d39-773d-43f8-84db-eb05248f44cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:53.491202 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e67d39-773d-43f8-84db-eb05248f44cf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:53.510594 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e67d39-773d-43f8-84db-eb05248f44cf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:53.512486 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e67d39-773d-43f8-84db-eb05248f44cf admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:53.539220 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-95e67d39-773d-43f8-84db-eb05248f44cf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:08:53.540726 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 350/703] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:53.546778 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541b653-f544-4539-8aee-5e563cbc9c53 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:53.569624 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3541b653-f544-4539-8aee-5e563cbc9c53 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:53.584353 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcafb70-92f2-423b-b523-674520a3462c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:53.585039 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcafb70-92f2-423b-b523-674520a3462c admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:53.585310 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcafb70-92f2-423b-b523-674520a3462c admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:53.585574 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcafb70-92f2-423b-b523-674520a3462c admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:53.586319 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcafb70-92f2-423b-b523-674520a3462c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:53.586614 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcafb70-92f2-423b-b523-674520a3462c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:53.588254 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcafb70-92f2-423b-b523-674520a3462c admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:53.613239 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 354/704] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:08:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:53.619082 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e67d39-773d-43f8-84db-eb05248f44cf admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:53.637613 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e67d39-773d-43f8-84db-eb05248f44cf admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:53.646075 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4eea0-8431-4ebc-9672-739f90316083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:53.646907 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4eea0-8431-4ebc-9672-739f90316083 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:53.647192 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4eea0-8431-4ebc-9672-739f90316083 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:53.647464 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4eea0-8431-4ebc-9672-739f90316083 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:53.664030 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4eea0-8431-4ebc-9672-739f90316083 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:53.666074 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4eea0-8431-4ebc-9672-739f90316083 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:53.690381 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-3dc4eea0-8431-4ebc-9672-739f90316083 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 29 20:08:53.691923 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 351/705] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Nov 29 20:08:53 2021] GET /identity/v3/users/nova => generated 82 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:53.697812 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcafb70-92f2-423b-b523-674520a3462c admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:53.711638 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcafb70-92f2-423b-b523-674520a3462c admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:53.723955 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19cd98e-f4d1-4a28-9919-e391a56fdbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:53.724612 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19cd98e-f4d1-4a28-9919-e391a56fdbf7 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:53.724884 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19cd98e-f4d1-4a28-9919-e391a56fdbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:53.725148 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19cd98e-f4d1-4a28-9919-e391a56fdbf7 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:53.725986 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19cd98e-f4d1-4a28-9919-e391a56fdbf7 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:53.726284 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19cd98e-f4d1-4a28-9919-e391a56fdbf7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:53.728119 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19cd98e-f4d1-4a28-9919-e391a56fdbf7 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:53.761200 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 355/706] 10.222.0.15 () {56 vars in 1154 bytes} [Mon Nov 29 20:08:53 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:53.767600 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4eea0-8431-4ebc-9672-739f90316083 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:53.785133 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4eea0-8431-4ebc-9672-739f90316083 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:53.793782 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfc4c2-f701-4c51-8985-9206dea5aa3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:53.794429 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfc4c2-f701-4c51-8985-9206dea5aa3e admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:53.794754 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfc4c2-f701-4c51-8985-9206dea5aa3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:53.795055 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfc4c2-f701-4c51-8985-9206dea5aa3e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:53.818892 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cfc4c2-f701-4c51-8985-9206dea5aa3e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:53.818892 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cfc4c2-f701-4c51-8985-9206dea5aa3e admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:53.838314 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 352/707] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:08:53 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:08:53.844035 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19cd98e-f4d1-4a28-9919-e391a56fdbf7 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:53.862309 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19cd98e-f4d1-4a28-9919-e391a56fdbf7 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:53.876483 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010cecc7-d507-4edc-9797-d7a11aaf4473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:53.877295 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010cecc7-d507-4edc-9797-d7a11aaf4473 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:53.877569 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010cecc7-d507-4edc-9797-d7a11aaf4473 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:53.877834 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010cecc7-d507-4edc-9797-d7a11aaf4473 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:53.891178 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010cecc7-d507-4edc-9797-d7a11aaf4473 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:53.893032 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010cecc7-d507-4edc-9797-d7a11aaf4473 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:53.913415 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-010cecc7-d507-4edc-9797-d7a11aaf4473 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:08:53.914641 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 356/708] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:53.921014 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfc4c2-f701-4c51-8985-9206dea5aa3e admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:53.935960 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfc4c2-f701-4c51-8985-9206dea5aa3e admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:53.945299 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a89e44-4dac-446f-a958-6a161661717d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:53.945965 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a89e44-4dac-446f-a958-6a161661717d admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:53.946245 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a89e44-4dac-446f-a958-6a161661717d admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:53.946520 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a89e44-4dac-446f-a958-6a161661717d admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:53.947296 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a89e44-4dac-446f-a958-6a161661717d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:53.947606 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a89e44-4dac-446f-a958-6a161661717d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:53.949203 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a89e44-4dac-446f-a958-6a161661717d admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:53.973091 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 353/709] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:08:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:53.979122 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010cecc7-d507-4edc-9797-d7a11aaf4473 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:53.991888 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010cecc7-d507-4edc-9797-d7a11aaf4473 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:53.996842 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171ef1d-6613-45ad-8eb8-681efdcaece8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:53.997639 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171ef1d-6613-45ad-8eb8-681efdcaece8 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:53.997924 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171ef1d-6613-45ad-8eb8-681efdcaece8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:53.998200 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d171ef1d-6613-45ad-8eb8-681efdcaece8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:54.002911 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884626c6-9bf7-4c51-a9e6-2476edd04a6d None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:54.003197 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884626c6-9bf7-4c51-a9e6-2476edd04a6d None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:54.003476 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884626c6-9bf7-4c51-a9e6-2476edd04a6d None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:54.005508 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 354/710] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 29 20:08:54.010999 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d171ef1d-6613-45ad-8eb8-681efdcaece8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:54.011672 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ab571-e941-4a68-9538-e9516d5dace1 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:54.011904 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ab571-e941-4a68-9538-e9516d5dace1 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:54.012182 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ab571-e941-4a68-9538-e9516d5dace1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:54.013291 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d171ef1d-6613-45ad-8eb8-681efdcaece8 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:54.027301 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-d171ef1d-6613-45ad-8eb8-681efdcaece8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 29 20:08:54.028874 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 357/711] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:08:53 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:54.034714 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171ef1d-6613-45ad-8eb8-681efdcaece8 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:54.041498 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-853ab571-e941-4a68-9538-e9516d5dace1 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:54.042739 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-853ab571-e941-4a68-9538-e9516d5dace1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:54.050072 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d171ef1d-6613-45ad-8eb8-681efdcaece8 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:54.058683 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f8bcf-2105-4103-adf7-749878402123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:54.059406 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f8bcf-2105-4103-adf7-749878402123 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:54.059686 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f8bcf-2105-4103-adf7-749878402123 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:54.059964 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f8bcf-2105-4103-adf7-749878402123 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:54.060781 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4f8bcf-2105-4103-adf7-749878402123 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:54.061090 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4f8bcf-2105-4103-adf7-749878402123 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:54.063153 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4f8bcf-2105-4103-adf7-749878402123 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:54.066253 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 355/712] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:54 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Nov 29 20:08:54.086808 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90078f97-cf91-483b-9678-b6f6b223a981 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:54.087160 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90078f97-cf91-483b-9678-b6f6b223a981 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:54.087388 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90078f97-cf91-483b-9678-b6f6b223a981 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:54.088889 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 358/713] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Nov 29 20:08:54 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:54.089593 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 356/714] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 29 20:08:54.089814 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f8bcf-2105-4103-adf7-749878402123 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:54.092690 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90078f97-cf91-483b-9678-b6f6b223a981 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:54.099876 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f8bcf-2105-4103-adf7-749878402123 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:54.105537 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53ff79-27ae-4acc-b976-abfc9497b8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:54.105667 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90078f97-cf91-483b-9678-b6f6b223a981 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:54.106477 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53ff79-27ae-4acc-b976-abfc9497b8cd admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:54.106864 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53ff79-27ae-4acc-b976-abfc9497b8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:54.107254 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53ff79-27ae-4acc-b976-abfc9497b8cd admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:54.108010 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b53ff79-27ae-4acc-b976-abfc9497b8cd admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:54.109299 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING py.warnings [None req-2b53ff79-27ae-4acc-b976-abfc9497b8cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 29 20:08:54.109299 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: warnings.warn(msg) Nov 29 20:08:54.109299 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: Nov 29 20:08:54.110229 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b53ff79-27ae-4acc-b976-abfc9497b8cd admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:54.110415 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eadc0a3-26d2-497d-beca-e340746ab57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:54.111150 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadc0a3-26d2-497d-beca-e340746ab57d admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:54.111493 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadc0a3-26d2-497d-beca-e340746ab57d admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:54.111827 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadc0a3-26d2-497d-beca-e340746ab57d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:54.112740 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eadc0a3-26d2-497d-beca-e340746ab57d admin admin] RBAC: Adding query filter params (role.id=33d95c7861b64f1a95af8a333bd626ea, scope.project.id=6f4cba10fe824640b2ed37aab02346ac, user.id=5f76a8c3d04e440b92d12ced18d97941) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:54.113116 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eadc0a3-26d2-497d-beca-e340746ab57d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:54.115050 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eadc0a3-26d2-497d-beca-e340746ab57d admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:54.120687 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 357/715] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:08:54 2021] GET /identity/v3/role_assignments?user.id=5f76a8c3d04e440b92d12ced18d97941&scope.project.id=6f4cba10fe824640b2ed37aab02346ac&role.id=33d95c7861b64f1a95af8a333bd626ea => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:54.122041 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fcf09-527d-4f81-a501-0aba5b5d3e4e None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:54.122321 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fcf09-527d-4f81-a501-0aba5b5d3e4e None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:54.122592 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119fcf09-527d-4f81-a501-0aba5b5d3e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:54.125542 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-2b53ff79-27ae-4acc-b976-abfc9497b8cd admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 29 20:08:54.126911 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 359/716] 10.222.0.15 () {56 vars in 1150 bytes} [Mon Nov 29 20:08:54 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:54.133653 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53ff79-27ae-4acc-b976-abfc9497b8cd admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:54.144192 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53ff79-27ae-4acc-b976-abfc9497b8cd admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:54.147014 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-119fcf09-527d-4f81-a501-0aba5b5d3e4e None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:54.148219 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-119fcf09-527d-4f81-a501-0aba5b5d3e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:54.149455 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb486fdf-9931-4e15-aaae-3abba9997c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:54.150445 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb486fdf-9931-4e15-aaae-3abba9997c25 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:54.150794 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb486fdf-9931-4e15-aaae-3abba9997c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:54.151154 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb486fdf-9931-4e15-aaae-3abba9997c25 admin admin] PATH_INFO: `/v3/services` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:54.151974 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb486fdf-9931-4e15-aaae-3abba9997c25 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:54.152451 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb486fdf-9931-4e15-aaae-3abba9997c25 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:54.153565 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING py.warnings [None req-fb486fdf-9931-4e15-aaae-3abba9997c25 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 29 20:08:54.153565 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: warnings.warn(msg) Nov 29 20:08:54.153565 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: Nov 29 20:08:54.154754 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb486fdf-9931-4e15-aaae-3abba9997c25 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:54.156286 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 358/717] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:54 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:54.160601 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 360/718] 10.222.0.15 () {56 vars in 1145 bytes} [Mon Nov 29 20:08:54 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:54.176428 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fcf09-527d-4f81-a501-0aba5b5d3e4e None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:54.191322 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119fcf09-527d-4f81-a501-0aba5b5d3e4e None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:54.199193 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ffe1c8-3c34-40aa-af3d-5426068b2409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:54.199893 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffe1c8-3c34-40aa-af3d-5426068b2409 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:54.200170 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffe1c8-3c34-40aa-af3d-5426068b2409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:54.200445 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffe1c8-3c34-40aa-af3d-5426068b2409 admin admin] PATH_INFO: `/v3/services` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:54.201198 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ffe1c8-3c34-40aa-af3d-5426068b2409 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:54.201505 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ffe1c8-3c34-40aa-af3d-5426068b2409 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:54.202602 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING py.warnings [None req-90ffe1c8-3c34-40aa-af3d-5426068b2409 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 29 20:08:54.202602 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: warnings.warn(msg) Nov 29 20:08:54.202602 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: Nov 29 20:08:54.203533 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ffe1c8-3c34-40aa-af3d-5426068b2409 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:54.214247 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 359/719] 10.222.0.15 () {56 vars in 1145 bytes} [Mon Nov 29 20:08:54 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:54.234133 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb486fdf-9931-4e15-aaae-3abba9997c25 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:54.248833 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb486fdf-9931-4e15-aaae-3abba9997c25 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:54.256979 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b3e7f-9ffa-42f0-a7a3-df0d7a0a3fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:54.257801 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b3e7f-9ffa-42f0-a7a3-df0d7a0a3fac admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:54.258132 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b3e7f-9ffa-42f0-a7a3-df0d7a0a3fac admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:54.258401 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b3e7f-9ffa-42f0-a7a3-df0d7a0a3fac admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:54.272147 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b3e7f-9ffa-42f0-a7a3-df0d7a0a3fac admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:54.274026 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b3e7f-9ffa-42f0-a7a3-df0d7a0a3fac admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:54.292344 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-139b3e7f-9ffa-42f0-a7a3-df0d7a0a3fac admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:08:54.293938 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 361/720] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:54.300365 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ffe1c8-3c34-40aa-af3d-5426068b2409 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:54.313723 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ffe1c8-3c34-40aa-af3d-5426068b2409 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:54.332597 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f97f4b-6300-4411-ac40-896e6df9b4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:54.333338 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f97f4b-6300-4411-ac40-896e6df9b4e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:54.333611 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f97f4b-6300-4411-ac40-896e6df9b4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:54.333887 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f97f4b-6300-4411-ac40-896e6df9b4e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:54.334707 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f97f4b-6300-4411-ac40-896e6df9b4e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:54.335061 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f97f4b-6300-4411-ac40-896e6df9b4e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:54.336803 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f97f4b-6300-4411-ac40-896e6df9b4e0 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:54.358051 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 360/721] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:08:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:54.364611 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b3e7f-9ffa-42f0-a7a3-df0d7a0a3fac admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:54.381354 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b3e7f-9ffa-42f0-a7a3-df0d7a0a3fac admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:54.391833 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c6455-8f70-4e37-9d0f-f4d4346a810d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:54.392586 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c6455-8f70-4e37-9d0f-f4d4346a810d admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:54.392987 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c6455-8f70-4e37-9d0f-f4d4346a810d admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:54.393258 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c6455-8f70-4e37-9d0f-f4d4346a810d admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:54.394056 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c6455-8f70-4e37-9d0f-f4d4346a810d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:54.396316 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c6455-8f70-4e37-9d0f-f4d4346a810d admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:54.427835 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 362/722] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Nov 29 20:08:54 2021] POST /identity/v3/users => generated 254 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:08:54.524917 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267fade-3f78-4efb-b2e0-3b8a95c56a66 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:54.525221 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267fade-3f78-4efb-b2e0-3b8a95c56a66 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:54.525411 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267fade-3f78-4efb-b2e0-3b8a95c56a66 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:54.527663 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 361/723] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:54.534460 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cea20b-3b3e-4be2-8c39-97c94d49d3c8 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:54.534789 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cea20b-3b3e-4be2-8c39-97c94d49d3c8 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:54.535060 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cea20b-3b3e-4be2-8c39-97c94d49d3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:54.562163 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-74cea20b-3b3e-4be2-8c39-97c94d49d3c8 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:54.564044 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-74cea20b-3b3e-4be2-8c39-97c94d49d3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:54.576498 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 363/724] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:54 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 29 20:08:54.599914 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267fade-3f78-4efb-b2e0-3b8a95c56a66 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:54.615177 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267fade-3f78-4efb-b2e0-3b8a95c56a66 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:54.620426 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d8585-5058-47be-ba25-8dcc05004ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:54.621751 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d8585-5058-47be-ba25-8dcc05004ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:54.622359 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d8585-5058-47be-ba25-8dcc05004ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:54.622905 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d8585-5058-47be-ba25-8dcc05004ed3 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:54.623904 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d8585-5058-47be-ba25-8dcc05004ed3 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:54.625466 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING py.warnings [None req-410d8585-5058-47be-ba25-8dcc05004ed3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 29 20:08:54.625466 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: warnings.warn(msg) Nov 29 20:08:54.625466 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: Nov 29 20:08:54.626865 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d8585-5058-47be-ba25-8dcc05004ed3 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:54.642535 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-410d8585-5058-47be-ba25-8dcc05004ed3 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 29 20:08:54.650435 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 362/725] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:08:54 2021] GET /identity/v3/services/network => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:54.652336 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cea20b-3b3e-4be2-8c39-97c94d49d3c8 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:54.663349 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cea20b-3b3e-4be2-8c39-97c94d49d3c8 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:54.673912 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd028d-330b-47c5-975d-e30995bad471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:54.674628 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd028d-330b-47c5-975d-e30995bad471 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:54.674926 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd028d-330b-47c5-975d-e30995bad471 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:54.675201 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd028d-330b-47c5-975d-e30995bad471 admin admin] PATH_INFO: `/v3/services` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:54.675984 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd028d-330b-47c5-975d-e30995bad471 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:54.676300 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd028d-330b-47c5-975d-e30995bad471 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:54.678031 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd028d-330b-47c5-975d-e30995bad471 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:54.683592 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 364/726] 10.222.0.15 () {56 vars in 1133 bytes} [Mon Nov 29 20:08:54 2021] GET /identity/v3/services?name=network => generated 124 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:54.690276 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d8585-5058-47be-ba25-8dcc05004ed3 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:54.702116 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d8585-5058-47be-ba25-8dcc05004ed3 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:54.707862 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9530b-9d04-4a5b-b2c4-e85850bbdcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:54.709037 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9530b-9d04-4a5b-b2c4-e85850bbdcc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:54.709615 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9530b-9d04-4a5b-b2c4-e85850bbdcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:54.710093 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9530b-9d04-4a5b-b2c4-e85850bbdcc8 admin admin] PATH_INFO: `/v3/services` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:54.711257 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d9530b-9d04-4a5b-b2c4-e85850bbdcc8 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:54.711814 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d9530b-9d04-4a5b-b2c4-e85850bbdcc8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:54.713890 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d9530b-9d04-4a5b-b2c4-e85850bbdcc8 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:54.720571 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 363/727] 10.222.0.15 () {56 vars in 1133 bytes} [Mon Nov 29 20:08:54 2021] GET /identity/v3/services?type=network => generated 124 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:54.747859 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83231e9-5770-4bed-ac9d-aa29f233c33e None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:54.748634 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83231e9-5770-4bed-ac9d-aa29f233c33e None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:54.749150 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83231e9-5770-4bed-ac9d-aa29f233c33e None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:54.751547 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 365/728] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:54 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:54.759876 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2853f71-b4d7-4cb4-bef7-636a11bdfe20 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:54.760541 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2853f71-b4d7-4cb4-bef7-636a11bdfe20 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:54.761102 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2853f71-b4d7-4cb4-bef7-636a11bdfe20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:54.782704 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-c2853f71-b4d7-4cb4-bef7-636a11bdfe20 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:54.784506 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-c2853f71-b4d7-4cb4-bef7-636a11bdfe20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:54.793396 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 364/729] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:54 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:54.832451 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83231e9-5770-4bed-ac9d-aa29f233c33e None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:54.847638 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83231e9-5770-4bed-ac9d-aa29f233c33e None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:54.852749 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de913e6-42b4-4373-8c00-3258a5afce67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:54.854030 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de913e6-42b4-4373-8c00-3258a5afce67 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:54.854594 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de913e6-42b4-4373-8c00-3258a5afce67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:54.855252 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de913e6-42b4-4373-8c00-3258a5afce67 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:54.869744 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de913e6-42b4-4373-8c00-3258a5afce67 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:54.877692 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-2de913e6-42b4-4373-8c00-3258a5afce67 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 29 20:08:54.885709 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 366/730] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Nov 29 20:08:54 2021] GET /identity/v3/roles/service => generated 85 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:54.887722 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2853f71-b4d7-4cb4-bef7-636a11bdfe20 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:54.898522 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2853f71-b4d7-4cb4-bef7-636a11bdfe20 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:54.904362 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a124643-be8d-4dc8-b192-c534a742eb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:54.905443 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a124643-be8d-4dc8-b192-c534a742eb20 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:54.905994 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a124643-be8d-4dc8-b192-c534a742eb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:54.906511 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a124643-be8d-4dc8-b192-c534a742eb20 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:54.907552 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a124643-be8d-4dc8-b192-c534a742eb20 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:54.908144 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a124643-be8d-4dc8-b192-c534a742eb20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:54.910025 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a124643-be8d-4dc8-b192-c534a742eb20 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:54.925670 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 365/731] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Nov 29 20:08:54 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:54.927422 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de913e6-42b4-4373-8c00-3258a5afce67 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:54.938324 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de913e6-42b4-4373-8c00-3258a5afce67 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:54.943535 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d882c93-e1f9-4f4a-ba63-6a0f334646d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:54.944700 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d882c93-e1f9-4f4a-ba63-6a0f334646d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:54.945187 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d882c93-e1f9-4f4a-ba63-6a0f334646d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:54.945697 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d882c93-e1f9-4f4a-ba63-6a0f334646d8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:54.958305 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d882c93-e1f9-4f4a-ba63-6a0f334646d8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:54.960655 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d882c93-e1f9-4f4a-ba63-6a0f334646d8 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:54.980197 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-9d882c93-e1f9-4f4a-ba63-6a0f334646d8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:08:54.981817 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 367/732] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:54.988403 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a124643-be8d-4dc8-b192-c534a742eb20 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:55.000481 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a124643-be8d-4dc8-b192-c534a742eb20 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:55.005234 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df5088-54c3-4f09-9c68-3d392161b0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:55.005915 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df5088-54c3-4f09-9c68-3d392161b0be admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:55.006234 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df5088-54c3-4f09-9c68-3d392161b0be admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:55.006516 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df5088-54c3-4f09-9c68-3d392161b0be admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:55.007361 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df5088-54c3-4f09-9c68-3d392161b0be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:55.007709 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df5088-54c3-4f09-9c68-3d392161b0be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:55.009360 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df5088-54c3-4f09-9c68-3d392161b0be admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:55.024614 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 366/733] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:08:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:55.032395 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d882c93-e1f9-4f4a-ba63-6a0f334646d8 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:55.043666 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d882c93-e1f9-4f4a-ba63-6a0f334646d8 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:55.048371 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5a751-96d2-487e-b1da-402a35252640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:55.049209 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5a751-96d2-487e-b1da-402a35252640 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:55.049490 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5a751-96d2-487e-b1da-402a35252640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:55.049762 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5a751-96d2-487e-b1da-402a35252640 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:55.058089 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5a751-96d2-487e-b1da-402a35252640 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:55.060172 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5a751-96d2-487e-b1da-402a35252640 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:55.074599 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-61c5a751-96d2-487e-b1da-402a35252640 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 29 20:08:55.078491 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 368/734] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Nov 29 20:08:55 2021] GET /identity/v3/users/swift => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:55.082479 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df5088-54c3-4f09-9c68-3d392161b0be admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:55.092810 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df5088-54c3-4f09-9c68-3d392161b0be admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:55.097458 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35163d4-f1e6-4140-9075-0a273cf21726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:55.098177 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35163d4-f1e6-4140-9075-0a273cf21726 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:55.098458 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35163d4-f1e6-4140-9075-0a273cf21726 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:55.098770 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35163d4-f1e6-4140-9075-0a273cf21726 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:55.099753 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35163d4-f1e6-4140-9075-0a273cf21726 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:55.100062 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35163d4-f1e6-4140-9075-0a273cf21726 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:55.102000 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35163d4-f1e6-4140-9075-0a273cf21726 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:55.125781 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 367/735] 10.222.0.15 () {56 vars in 1156 bytes} [Mon Nov 29 20:08:55 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:55.127241 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5a751-96d2-487e-b1da-402a35252640 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:55.138458 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5a751-96d2-487e-b1da-402a35252640 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:55.143156 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f585534-02e0-4824-afb7-eac828520a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:55.143853 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f585534-02e0-4824-afb7-eac828520a41 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:55.144136 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f585534-02e0-4824-afb7-eac828520a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:55.144409 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f585534-02e0-4824-afb7-eac828520a41 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:55.152801 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f585534-02e0-4824-afb7-eac828520a41 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:55.154626 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f585534-02e0-4824-afb7-eac828520a41 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:55.168906 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 369/736] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:08:55 2021] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:08:55.170287 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35163d4-f1e6-4140-9075-0a273cf21726 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:55.180626 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35163d4-f1e6-4140-9075-0a273cf21726 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:55.185344 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bd4813-692e-4702-9c02-b0b055654e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:55.186209 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd4813-692e-4702-9c02-b0b055654e3a admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:55.186537 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd4813-692e-4702-9c02-b0b055654e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:55.186874 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd4813-692e-4702-9c02-b0b055654e3a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:55.198238 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bd4813-692e-4702-9c02-b0b055654e3a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:55.200167 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bd4813-692e-4702-9c02-b0b055654e3a admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:55.218014 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-d0bd4813-692e-4702-9c02-b0b055654e3a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:08:55.222964 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 368/737] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:55.225926 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f585534-02e0-4824-afb7-eac828520a41 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:55.235245 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f585534-02e0-4824-afb7-eac828520a41 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:55.239898 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84d413-c227-40e0-a132-a0dbcb6afdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:55.240562 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84d413-c227-40e0-a132-a0dbcb6afdd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:55.240844 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84d413-c227-40e0-a132-a0dbcb6afdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:55.241120 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84d413-c227-40e0-a132-a0dbcb6afdd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:55.241860 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d84d413-c227-40e0-a132-a0dbcb6afdd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:55.242163 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d84d413-c227-40e0-a132-a0dbcb6afdd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:55.243951 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d84d413-c227-40e0-a132-a0dbcb6afdd7 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:55.260568 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 370/738] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:08:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:55.263563 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bd4813-692e-4702-9c02-b0b055654e3a admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:55.273870 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bd4813-692e-4702-9c02-b0b055654e3a admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:55.278582 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef3264-a147-458a-b2f5-a581206e8e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:55.279457 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef3264-a147-458a-b2f5-a581206e8e68 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:55.279739 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef3264-a147-458a-b2f5-a581206e8e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:55.280012 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef3264-a147-458a-b2f5-a581206e8e68 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:55.287774 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fef3264-a147-458a-b2f5-a581206e8e68 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:55.289843 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fef3264-a147-458a-b2f5-a581206e8e68 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:55.303508 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-3fef3264-a147-458a-b2f5-a581206e8e68 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 29 20:08:55.310045 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 369/739] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:08:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:55.311462 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84d413-c227-40e0-a132-a0dbcb6afdd7 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:55.323187 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84d413-c227-40e0-a132-a0dbcb6afdd7 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:55.327909 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5148db2-a2f2-4fc5-bab8-6d1b5dc9d4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:55.328622 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5148db2-a2f2-4fc5-bab8-6d1b5dc9d4f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:55.328906 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5148db2-a2f2-4fc5-bab8-6d1b5dc9d4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:55.329177 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5148db2-a2f2-4fc5-bab8-6d1b5dc9d4f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:55.330032 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5148db2-a2f2-4fc5-bab8-6d1b5dc9d4f8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:55.330340 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5148db2-a2f2-4fc5-bab8-6d1b5dc9d4f8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:55.332264 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5148db2-a2f2-4fc5-bab8-6d1b5dc9d4f8 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:55.350980 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 371/740] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Nov 29 20:08:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:55.352822 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef3264-a147-458a-b2f5-a581206e8e68 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:55.363815 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef3264-a147-458a-b2f5-a581206e8e68 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:55.368382 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c30d88f-9f06-43b5-a450-7738475f3a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:55.369065 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30d88f-9f06-43b5-a450-7738475f3a51 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:55.369348 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30d88f-9f06-43b5-a450-7738475f3a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:55.369675 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c30d88f-9f06-43b5-a450-7738475f3a51 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:55.370529 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30d88f-9f06-43b5-a450-7738475f3a51 admin admin] RBAC: Adding query filter params (role.id=4851b1a48d8a4188b335219acbede502, scope.project.id=6f4cba10fe824640b2ed37aab02346ac, user.id=51fc6fd9b37447bba1759a702b86ce6c) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:55.370921 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30d88f-9f06-43b5-a450-7738475f3a51 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:55.372846 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c30d88f-9f06-43b5-a450-7738475f3a51 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:55.382988 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 370/741] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:08:55 2021] GET /identity/v3/role_assignments?user.id=51fc6fd9b37447bba1759a702b86ce6c&scope.project.id=6f4cba10fe824640b2ed37aab02346ac&role.id=4851b1a48d8a4188b335219acbede502 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:57.163018 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc1e21-7df6-41b4-944c-c905974b719c None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:57.164001 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc1e21-7df6-41b4-944c-c905974b719c None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:57.164496 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc1e21-7df6-41b4-944c-c905974b719c None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:57.166742 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 372/742] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:57 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:57.173370 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a706b3-8bdb-4495-be13-75547086f104 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:57.174267 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a706b3-8bdb-4495-be13-75547086f104 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:57.174771 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a706b3-8bdb-4495-be13-75547086f104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:57.183524 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c38cad-9b24-4f28-9134-5c5261a78642 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:57.184068 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c38cad-9b24-4f28-9134-5c5261a78642 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:57.184551 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c38cad-9b24-4f28-9134-5c5261a78642 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:57.186513 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 373/743] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 29 20:08:57.192170 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e30618-59bd-4d59-887d-0e2e0c9fbd2b None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:57.192433 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e30618-59bd-4d59-887d-0e2e0c9fbd2b None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:57.192712 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e30618-59bd-4d59-887d-0e2e0c9fbd2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:57.199621 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-00a706b3-8bdb-4495-be13-75547086f104 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:57.201085 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-00a706b3-8bdb-4495-be13-75547086f104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:57.213705 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 371/744] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:57 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Nov 29 20:08:57.219852 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-29e30618-59bd-4d59-887d-0e2e0c9fbd2b None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:57.221047 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-29e30618-59bd-4d59-887d-0e2e0c9fbd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:57.235260 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a706b3-8bdb-4495-be13-75547086f104 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:57.236214 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 374/745] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:57 2021] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Nov 29 20:08:57.245170 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a706b3-8bdb-4495-be13-75547086f104 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:57.249861 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb81c2-c6ae-4100-ab27-b6db7dc944a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:57.250916 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb81c2-c6ae-4100-ab27-b6db7dc944a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:57.251428 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb81c2-c6ae-4100-ab27-b6db7dc944a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:57.251913 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb81c2-c6ae-4100-ab27-b6db7dc944a8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:57.262572 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fb81c2-c6ae-4100-ab27-b6db7dc944a8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:57.269765 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e30618-59bd-4d59-887d-0e2e0c9fbd2b None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:57.270755 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-b7fb81c2-c6ae-4100-ab27-b6db7dc944a8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 29 20:08:57.277422 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 372/746] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Nov 29 20:08:57 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:08:57.278894 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb81c2-c6ae-4100-ab27-b6db7dc944a8 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:57.285063 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e30618-59bd-4d59-887d-0e2e0c9fbd2b None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:57.289421 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb81c2-c6ae-4100-ab27-b6db7dc944a8 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:57.294100 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8f7f6b-0c8c-47ec-a13d-8c626d55316f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:57.295382 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f7f6b-0c8c-47ec-a13d-8c626d55316f admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:57.296454 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f7f6b-0c8c-47ec-a13d-8c626d55316f admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:57.297186 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74b1ef-bd2c-4c80-84ab-7fa9399b98d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:57.298074 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74b1ef-bd2c-4c80-84ab-7fa9399b98d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:57.298546 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8f7f6b-0c8c-47ec-a13d-8c626d55316f admin admin] PATH_INFO: `/v3/services` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:57.299534 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f7f6b-0c8c-47ec-a13d-8c626d55316f admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:57.300023 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74b1ef-bd2c-4c80-84ab-7fa9399b98d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:57.300507 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f74b1ef-bd2c-4c80-84ab-7fa9399b98d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:57.301495 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f74b1ef-bd2c-4c80-84ab-7fa9399b98d9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:57.302752 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING py.warnings [None req-0f8f7f6b-0c8c-47ec-a13d-8c626d55316f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 29 20:08:57.302752 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: warnings.warn(msg) Nov 29 20:08:57.302752 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: Nov 29 20:08:57.303428 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f74b1ef-bd2c-4c80-84ab-7fa9399b98d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:57.305221 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f74b1ef-bd2c-4c80-84ab-7fa9399b98d9 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:57.306296 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8f7f6b-0c8c-47ec-a13d-8c626d55316f admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:57.320994 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 373/747] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:08:57 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:57.327558 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74b1ef-bd2c-4c80-84ab-7fa9399b98d9 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:57.339681 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 375/748] 10.222.0.15 () {60 vars in 1162 bytes} [Mon Nov 29 20:08:57 2021] POST /identity/v3/services => generated 251 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 29 20:08:57.345229 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f74b1ef-bd2c-4c80-84ab-7fa9399b98d9 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:57.370500 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4f6a6-5f9c-4ef9-9e4f-913b149ace2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:57.371695 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4f6a6-5f9c-4ef9-9e4f-913b149ace2b admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:57.372184 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4f6a6-5f9c-4ef9-9e4f-913b149ace2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:57.372682 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4f6a6-5f9c-4ef9-9e4f-913b149ace2b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:57.384547 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4f6a6-5f9c-4ef9-9e4f-913b149ace2b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:57.386902 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4f6a6-5f9c-4ef9-9e4f-913b149ace2b admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:57.407946 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-a0a4f6a6-5f9c-4ef9-9e4f-913b149ace2b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:08:57.414945 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 374/749] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:57.416913 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4f6a6-5f9c-4ef9-9e4f-913b149ace2b admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:57.417290 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb003e-f8d5-4f02-9048-5af467913bb8 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:57.417584 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb003e-f8d5-4f02-9048-5af467913bb8 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:57.417866 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb003e-f8d5-4f02-9048-5af467913bb8 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:57.420065 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 376/750] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:57.426496 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea104097-370a-4d79-be18-d73e7eceb1e6 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:57.426835 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea104097-370a-4d79-be18-d73e7eceb1e6 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:57.427070 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea104097-370a-4d79-be18-d73e7eceb1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:57.429653 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4f6a6-5f9c-4ef9-9e4f-913b149ace2b admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:57.434265 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08118afe-9b22-4ee8-84f8-f35d02809f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:57.434982 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08118afe-9b22-4ee8-84f8-f35d02809f20 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:57.435260 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08118afe-9b22-4ee8-84f8-f35d02809f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:57.435534 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08118afe-9b22-4ee8-84f8-f35d02809f20 admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:57.436347 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08118afe-9b22-4ee8-84f8-f35d02809f20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:57.436654 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08118afe-9b22-4ee8-84f8-f35d02809f20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:57.438421 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08118afe-9b22-4ee8-84f8-f35d02809f20 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:57.447294 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-ea104097-370a-4d79-be18-d73e7eceb1e6 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:57.448913 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-ea104097-370a-4d79-be18-d73e7eceb1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:57.454995 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 375/751] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:08:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:57.457832 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 377/752] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:57 2021] POST /identity/v3/auth/tokens => generated 1018 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:08:57.458001 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08118afe-9b22-4ee8-84f8-f35d02809f20 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:57.468736 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08118afe-9b22-4ee8-84f8-f35d02809f20 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:57.480861 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49e66b-7daf-45e9-b627-41ba93436ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:57.481687 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49e66b-7daf-45e9-b627-41ba93436ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:57.482371 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49e66b-7daf-45e9-b627-41ba93436ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:57.482371 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49e66b-7daf-45e9-b627-41ba93436ae0 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:57.483681 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea104097-370a-4d79-be18-d73e7eceb1e6 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:57.492724 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce49e66b-7daf-45e9-b627-41ba93436ae0 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:57.493871 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea104097-370a-4d79-be18-d73e7eceb1e6 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:57.494793 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce49e66b-7daf-45e9-b627-41ba93436ae0 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:57.499272 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61129e9a-3184-4e57-a955-e931155a67ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:57.500483 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61129e9a-3184-4e57-a955-e931155a67ac admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:57.500983 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61129e9a-3184-4e57-a955-e931155a67ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:57.501481 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61129e9a-3184-4e57-a955-e931155a67ac admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:57.509449 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-ce49e66b-7daf-45e9-b627-41ba93436ae0 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 29 20:08:57.510884 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 376/753] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Nov 29 20:08:57 2021] GET /identity/v3/users/nova => generated 82 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:08:57.514806 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61129e9a-3184-4e57-a955-e931155a67ac admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:57.517590 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49e66b-7daf-45e9-b627-41ba93436ae0 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:57.523545 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-61129e9a-3184-4e57-a955-e931155a67ac admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 29 20:08:57.526470 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 378/754] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Nov 29 20:08:57 2021] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:57.530929 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49e66b-7daf-45e9-b627-41ba93436ae0 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:57.534096 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61129e9a-3184-4e57-a955-e931155a67ac admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:57.534449 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fba39-93bf-4ac8-8c48-9392c656a410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:57.535175 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fba39-93bf-4ac8-8c48-9392c656a410 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:57.535458 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fba39-93bf-4ac8-8c48-9392c656a410 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:57.535734 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892fba39-93bf-4ac8-8c48-9392c656a410 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:57.536802 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892fba39-93bf-4ac8-8c48-9392c656a410 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:57.537113 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892fba39-93bf-4ac8-8c48-9392c656a410 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:57.539033 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892fba39-93bf-4ac8-8c48-9392c656a410 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:57.548025 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61129e9a-3184-4e57-a955-e931155a67ac admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:57.568861 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c94db5-c9ea-46ce-b3f2-1f3801c3358c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:57.569547 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c94db5-c9ea-46ce-b3f2-1f3801c3358c admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:57.569871 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c94db5-c9ea-46ce-b3f2-1f3801c3358c admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:57.570147 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c94db5-c9ea-46ce-b3f2-1f3801c3358c admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:57.570944 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c94db5-c9ea-46ce-b3f2-1f3801c3358c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:57.571299 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c94db5-c9ea-46ce-b3f2-1f3801c3358c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:57.574300 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c94db5-c9ea-46ce-b3f2-1f3801c3358c admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:57.582754 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 377/755] 10.222.0.15 () {56 vars in 1154 bytes} [Mon Nov 29 20:08:57 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:57.593001 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 379/756] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Nov 29 20:08:57 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:08:57.595013 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fba39-93bf-4ac8-8c48-9392c656a410 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:57.603067 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c94db5-c9ea-46ce-b3f2-1f3801c3358c admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:57.611186 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892fba39-93bf-4ac8-8c48-9392c656a410 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:57.620357 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767f719-7a53-4074-8e6d-f36a9b482710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:57.621227 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767f719-7a53-4074-8e6d-f36a9b482710 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:57.621507 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767f719-7a53-4074-8e6d-f36a9b482710 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:57.621778 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767f719-7a53-4074-8e6d-f36a9b482710 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:57.622167 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c94db5-c9ea-46ce-b3f2-1f3801c3358c admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:57.630882 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e340d48-f95c-4ddb-97d5-f5075116808d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:57.632333 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e340d48-f95c-4ddb-97d5-f5075116808d admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:57.632818 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e340d48-f95c-4ddb-97d5-f5075116808d admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:57.633343 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e340d48-f95c-4ddb-97d5-f5075116808d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:57.640366 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767f719-7a53-4074-8e6d-f36a9b482710 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:57.642510 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767f719-7a53-4074-8e6d-f36a9b482710 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:57.651458 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e340d48-f95c-4ddb-97d5-f5075116808d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:57.653307 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e340d48-f95c-4ddb-97d5-f5075116808d admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:57.664765 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-9767f719-7a53-4074-8e6d-f36a9b482710 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:08:57.666017 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 378/757] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:57.667229 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dad52a-9e62-4db1-853b-ab46c2583159 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:57.667537 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dad52a-9e62-4db1-853b-ab46c2583159 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:57.667783 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dad52a-9e62-4db1-853b-ab46c2583159 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:57.669603 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 379/758] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:57.675338 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e10f0-b6da-49f1-9673-e40b282c9985 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:57.675621 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e10f0-b6da-49f1-9673-e40b282c9985 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:57.675895 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e10f0-b6da-49f1-9673-e40b282c9985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:57.677378 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-7e340d48-f95c-4ddb-97d5-f5075116808d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:08:57.679266 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 380/759] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:57.680268 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e340d48-f95c-4ddb-97d5-f5075116808d admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:57.694166 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e340d48-f95c-4ddb-97d5-f5075116808d admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:57.697927 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-4f2e10f0-b6da-49f1-9673-e40b282c9985 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:57.699347 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-4f2e10f0-b6da-49f1-9673-e40b282c9985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:57.699704 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc835884-9706-4e18-a25b-44fb6f315196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:57.700367 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc835884-9706-4e18-a25b-44fb6f315196 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:57.700652 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc835884-9706-4e18-a25b-44fb6f315196 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:57.700924 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc835884-9706-4e18-a25b-44fb6f315196 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:57.701679 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc835884-9706-4e18-a25b-44fb6f315196 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:57.701972 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc835884-9706-4e18-a25b-44fb6f315196 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:57.703662 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc835884-9706-4e18-a25b-44fb6f315196 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:57.708208 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 380/760] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:57 2021] POST /identity/v3/auth/tokens => generated 1018 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:08:57.708938 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e10f0-b6da-49f1-9673-e40b282c9985 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:57.720453 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e10f0-b6da-49f1-9673-e40b282c9985 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:57.727606 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 381/761] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:08:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:57.734840 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc835884-9706-4e18-a25b-44fb6f315196 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:57.737481 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c5065-9b5b-4b08-9ca0-2290644c56ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:57.739982 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c5065-9b5b-4b08-9ca0-2290644c56ef admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:57.740417 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c5065-9b5b-4b08-9ca0-2290644c56ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:57.740860 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c5065-9b5b-4b08-9ca0-2290644c56ef admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:57.742058 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c5065-9b5b-4b08-9ca0-2290644c56ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:57.744810 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c5065-9b5b-4b08-9ca0-2290644c56ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:57.746876 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c5065-9b5b-4b08-9ca0-2290644c56ef admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:57.758294 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc835884-9706-4e18-a25b-44fb6f315196 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:57.762793 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366f401-b6f3-42fa-bec3-7a7f5d7ad720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:57.763979 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366f401-b6f3-42fa-bec3-7a7f5d7ad720 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:57.764263 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366f401-b6f3-42fa-bec3-7a7f5d7ad720 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:57.764559 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a366f401-b6f3-42fa-bec3-7a7f5d7ad720 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:57.765651 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 381/762] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:08:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:57.767082 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c5065-9b5b-4b08-9ca0-2290644c56ef admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:57.772610 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366f401-b6f3-42fa-bec3-7a7f5d7ad720 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:57.774739 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a366f401-b6f3-42fa-bec3-7a7f5d7ad720 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:57.778498 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c5065-9b5b-4b08-9ca0-2290644c56ef admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:57.784195 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4742875-e093-4b45-8a09-8ef5519710a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:57.785105 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4742875-e093-4b45-8a09-8ef5519710a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:57.785585 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4742875-e093-4b45-8a09-8ef5519710a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:57.786044 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4742875-e093-4b45-8a09-8ef5519710a7 admin admin] PATH_INFO: `/v3/services` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:57.786998 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4742875-e093-4b45-8a09-8ef5519710a7 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:57.788187 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING py.warnings [None req-c4742875-e093-4b45-8a09-8ef5519710a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 29 20:08:57.788187 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: warnings.warn(msg) Nov 29 20:08:57.788187 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: Nov 29 20:08:57.789523 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4742875-e093-4b45-8a09-8ef5519710a7 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:57.789884 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-a366f401-b6f3-42fa-bec3-7a7f5d7ad720 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 29 20:08:57.796615 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 382/763] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:08:57 2021] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:57.797614 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366f401-b6f3-42fa-bec3-7a7f5d7ad720 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:57.807709 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 382/764] 10.222.0.15 () {60 vars in 1162 bytes} [Mon Nov 29 20:08:57 2021] POST /identity/v3/services => generated 240 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:08:57.808246 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a366f401-b6f3-42fa-bec3-7a7f5d7ad720 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:57.814877 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4742875-e093-4b45-8a09-8ef5519710a7 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:57.835159 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d3f7e-c295-4f15-9527-7578aceef1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:57.841283 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d3f7e-c295-4f15-9527-7578aceef1c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:57.841476 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d3f7e-c295-4f15-9527-7578aceef1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:57.841681 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d3f7e-c295-4f15-9527-7578aceef1c9 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:57.844438 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4742875-e093-4b45-8a09-8ef5519710a7 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:57.856093 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c4c7a-c5a0-4814-a125-b02695ec6c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:57.857444 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c4c7a-c5a0-4814-a125-b02695ec6c53 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:57.859108 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c4c7a-c5a0-4814-a125-b02695ec6c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:57.860069 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c4c7a-c5a0-4814-a125-b02695ec6c53 admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:57.861779 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c4c7a-c5a0-4814-a125-b02695ec6c53 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:57.862226 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d3f7e-c295-4f15-9527-7578aceef1c9 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:57.863222 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c4c7a-c5a0-4814-a125-b02695ec6c53 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:57.865993 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d3f7e-c295-4f15-9527-7578aceef1c9 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:57.867809 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89c4c7a-c5a0-4814-a125-b02695ec6c53 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:57.895909 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-9c7d3f7e-c295-4f15-9527-7578aceef1c9 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 29 20:08:57.897904 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 383/765] 10.222.0.15 () {56 vars in 1138 bytes} [Mon Nov 29 20:08:57 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:57.898655 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 383/766] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Nov 29 20:08:57 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:57.907954 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d3f7e-c295-4f15-9527-7578aceef1c9 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:57.908149 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c4c7a-c5a0-4814-a125-b02695ec6c53 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:57.918331 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d3f7e-c295-4f15-9527-7578aceef1c9 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:57.923022 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599122b-18ac-45ba-bab9-398bc63b5593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:57.923695 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599122b-18ac-45ba-bab9-398bc63b5593 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:57.923976 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599122b-18ac-45ba-bab9-398bc63b5593 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:57.924249 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2599122b-18ac-45ba-bab9-398bc63b5593 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:57.925106 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2599122b-18ac-45ba-bab9-398bc63b5593 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:57.925411 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2599122b-18ac-45ba-bab9-398bc63b5593 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:57.927376 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2599122b-18ac-45ba-bab9-398bc63b5593 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:57.929441 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89c4c7a-c5a0-4814-a125-b02695ec6c53 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:57.947509 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 384/767] 10.222.0.15 () {56 vars in 1170 bytes} [Mon Nov 29 20:08:57 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:57.947712 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9bfde4-9257-4301-858e-aef6f9cbfc00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:57.948447 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bfde4-9257-4301-858e-aef6f9cbfc00 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:57.948723 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bfde4-9257-4301-858e-aef6f9cbfc00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:57.948999 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bfde4-9257-4301-858e-aef6f9cbfc00 admin admin] PATH_INFO: `/v3/projects/6f4cba10fe824640b2ed37aab02346ac/users/5f76a8c3d04e440b92d12ced18d97941/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:57.953853 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599122b-18ac-45ba-bab9-398bc63b5593 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:57.959848 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9bfde4-9257-4301-858e-aef6f9cbfc00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f4cba10fe824640b2ed37aab02346ac, user_id=5f76a8c3d04e440b92d12ced18d97941, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:57.962577 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9bfde4-9257-4301-858e-aef6f9cbfc00 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:57.964297 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2599122b-18ac-45ba-bab9-398bc63b5593 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:57.969559 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045600e6-565f-4867-bd37-f11a0dbf6fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:57.970245 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045600e6-565f-4867-bd37-f11a0dbf6fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:57.970575 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045600e6-565f-4867-bd37-f11a0dbf6fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:57.970918 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045600e6-565f-4867-bd37-f11a0dbf6fd4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:57.981099 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045600e6-565f-4867-bd37-f11a0dbf6fd4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:57.983164 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045600e6-565f-4867-bd37-f11a0dbf6fd4 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:57.995075 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 385/768] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:08:57 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 29 20:08:57.997400 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 384/769] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Nov 29 20:08:57 2021] PUT /identity/v3/projects/6f4cba10fe824640b2ed37aab02346ac/users/5f76a8c3d04e440b92d12ced18d97941/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:08:58.001929 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045600e6-565f-4867-bd37-f11a0dbf6fd4 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:58.012108 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045600e6-565f-4867-bd37-f11a0dbf6fd4 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:58.093288 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c07a1c-63b3-44cc-8cb9-d55666cb9429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:58.094111 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c07a1c-63b3-44cc-8cb9-d55666cb9429 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:58.094393 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c07a1c-63b3-44cc-8cb9-d55666cb9429 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:58.094668 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c07a1c-63b3-44cc-8cb9-d55666cb9429 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:58.106128 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c07a1c-63b3-44cc-8cb9-d55666cb9429 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:58.108102 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c07a1c-63b3-44cc-8cb9-d55666cb9429 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:58.126696 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-80c07a1c-63b3-44cc-8cb9-d55666cb9429 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:08:58.128456 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 386/770] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 127 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:58.134886 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9bfde4-9257-4301-858e-aef6f9cbfc00 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:58.150737 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9bfde4-9257-4301-858e-aef6f9cbfc00 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:58.158314 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda46e02-ae28-49e0-9252-4dd9b86c1294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:58.159411 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda46e02-ae28-49e0-9252-4dd9b86c1294 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:58.159941 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda46e02-ae28-49e0-9252-4dd9b86c1294 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:58.160428 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda46e02-ae28-49e0-9252-4dd9b86c1294 admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:58.161449 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda46e02-ae28-49e0-9252-4dd9b86c1294 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:58.161954 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda46e02-ae28-49e0-9252-4dd9b86c1294 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:58.163907 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda46e02-ae28-49e0-9252-4dd9b86c1294 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:58.178889 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 385/771] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:08:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:58.185725 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c07a1c-63b3-44cc-8cb9-d55666cb9429 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:58.196916 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c07a1c-63b3-44cc-8cb9-d55666cb9429 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:58.202251 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6c83b-7059-4b76-8a7e-d5b01be38b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:58.204237 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6c83b-7059-4b76-8a7e-d5b01be38b8b admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:58.204990 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6c83b-7059-4b76-8a7e-d5b01be38b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:58.205718 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6c83b-7059-4b76-8a7e-d5b01be38b8b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:58.214877 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f6c83b-7059-4b76-8a7e-d5b01be38b8b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:58.217698 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f6c83b-7059-4b76-8a7e-d5b01be38b8b admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:58.232260 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-a4f6c83b-7059-4b76-8a7e-d5b01be38b8b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 29 20:08:58.234194 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 387/772] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:08:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:58.240766 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda46e02-ae28-49e0-9252-4dd9b86c1294 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:58.253685 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda46e02-ae28-49e0-9252-4dd9b86c1294 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:58.258655 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4a4a02-47b1-4881-b35f-e2964bbd881e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:58.259652 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a4a02-47b1-4881-b35f-e2964bbd881e admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:58.260170 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a4a02-47b1-4881-b35f-e2964bbd881e admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:58.260663 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4a4a02-47b1-4881-b35f-e2964bbd881e admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:58.261772 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a4a02-47b1-4881-b35f-e2964bbd881e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:58.262274 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a4a02-47b1-4881-b35f-e2964bbd881e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:58.264768 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4a4a02-47b1-4881-b35f-e2964bbd881e admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:58.280521 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 386/773] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Nov 29 20:08:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:58.287289 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6c83b-7059-4b76-8a7e-d5b01be38b8b admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:58.299413 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6c83b-7059-4b76-8a7e-d5b01be38b8b admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:58.304407 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5a001-3735-43b7-8e74-a60ec7c34af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:58.305335 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5a001-3735-43b7-8e74-a60ec7c34af9 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:58.305870 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5a001-3735-43b7-8e74-a60ec7c34af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:58.306356 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5a001-3735-43b7-8e74-a60ec7c34af9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:58.307464 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5a001-3735-43b7-8e74-a60ec7c34af9 admin admin] RBAC: Adding query filter params (role.id=4851b1a48d8a4188b335219acbede502, scope.project.id=6f4cba10fe824640b2ed37aab02346ac, user.id=19d72c913c2b4442836a991120eec243) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:58.307972 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5a001-3735-43b7-8e74-a60ec7c34af9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:58.310225 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5a001-3735-43b7-8e74-a60ec7c34af9 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:58.316621 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 388/774] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:08:58 2021] GET /identity/v3/role_assignments?user.id=19d72c913c2b4442836a991120eec243&scope.project.id=6f4cba10fe824640b2ed37aab02346ac&role.id=4851b1a48d8a4188b335219acbede502 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:58.925093 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e8900-21bd-4244-8a92-a42bc7d5534f None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:58.925745 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e8900-21bd-4244-8a92-a42bc7d5534f None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:58.926218 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e8900-21bd-4244-8a92-a42bc7d5534f None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:58.928478 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 387/775] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:08:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:08:58.935016 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48adbe2-3111-48ef-bed7-8fccea227ae2 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:58.935544 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48adbe2-3111-48ef-bed7-8fccea227ae2 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:58.936017 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48adbe2-3111-48ef-bed7-8fccea227ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:58.954183 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-b48adbe2-3111-48ef-bed7-8fccea227ae2 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:08:58.955729 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-b48adbe2-3111-48ef-bed7-8fccea227ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:08:58.963875 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 389/776] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:08:58 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:08:58.988267 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e8900-21bd-4244-8a92-a42bc7d5534f None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:59.001386 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e8900-21bd-4244-8a92-a42bc7d5534f None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:59.006051 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ff11e-2fc5-4a04-a175-cafd20bb8f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:59.007087 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ff11e-2fc5-4a04-a175-cafd20bb8f4f admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:59.007592 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ff11e-2fc5-4a04-a175-cafd20bb8f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:59.008061 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ff11e-2fc5-4a04-a175-cafd20bb8f4f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:59.019514 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ff11e-2fc5-4a04-a175-cafd20bb8f4f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:08:59.026624 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-a95ff11e-2fc5-4a04-a175-cafd20bb8f4f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 29 20:08:59.028413 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 388/777] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Nov 29 20:08:58 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:59.035234 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48adbe2-3111-48ef-bed7-8fccea227ae2 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:59.044793 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48adbe2-3111-48ef-bed7-8fccea227ae2 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:59.049548 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05212c-6559-4f26-8668-5c891856a682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:59.050434 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05212c-6559-4f26-8668-5c891856a682 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:59.050947 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05212c-6559-4f26-8668-5c891856a682 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:59.051525 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05212c-6559-4f26-8668-5c891856a682 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:59.052479 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05212c-6559-4f26-8668-5c891856a682 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:59.052978 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05212c-6559-4f26-8668-5c891856a682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:59.054773 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a05212c-6559-4f26-8668-5c891856a682 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:59.063943 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 390/778] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:08:59 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:59.070183 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ff11e-2fc5-4a04-a175-cafd20bb8f4f admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:59.080569 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ff11e-2fc5-4a04-a175-cafd20bb8f4f admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:59.085352 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04db67e-8132-43b7-b915-23ff36d5ef38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:59.086399 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04db67e-8132-43b7-b915-23ff36d5ef38 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:59.086945 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04db67e-8132-43b7-b915-23ff36d5ef38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:59.087474 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04db67e-8132-43b7-b915-23ff36d5ef38 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:59.099328 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04db67e-8132-43b7-b915-23ff36d5ef38 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:59.101531 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04db67e-8132-43b7-b915-23ff36d5ef38 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:59.118648 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-a04db67e-8132-43b7-b915-23ff36d5ef38 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:08:59.120438 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 389/779] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:59.127034 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05212c-6559-4f26-8668-5c891856a682 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:59.137365 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05212c-6559-4f26-8668-5c891856a682 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:59.142626 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003cb64-f463-40b7-946a-776cabcd4c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:59.143611 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003cb64-f463-40b7-946a-776cabcd4c16 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:59.144093 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003cb64-f463-40b7-946a-776cabcd4c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:59.144581 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003cb64-f463-40b7-946a-776cabcd4c16 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:59.145589 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1003cb64-f463-40b7-946a-776cabcd4c16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:59.146091 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1003cb64-f463-40b7-946a-776cabcd4c16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:59.147962 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1003cb64-f463-40b7-946a-776cabcd4c16 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:59.170040 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 391/780] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:08:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:59.176317 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04db67e-8132-43b7-b915-23ff36d5ef38 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:59.186421 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04db67e-8132-43b7-b915-23ff36d5ef38 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:59.198614 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e7529-2cf7-4786-9c78-558ecf5e5479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:59.199706 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e7529-2cf7-4786-9c78-558ecf5e5479 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:59.200269 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e7529-2cf7-4786-9c78-558ecf5e5479 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:59.200754 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e7529-2cf7-4786-9c78-558ecf5e5479 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:59.209499 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e7529-2cf7-4786-9c78-558ecf5e5479 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:59.211861 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87e7529-2cf7-4786-9c78-558ecf5e5479 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:59.228561 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-d87e7529-2cf7-4786-9c78-558ecf5e5479 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 29 20:08:59.230265 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 390/781] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Nov 29 20:08:59 2021] GET /identity/v3/users/swift => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:59.236622 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003cb64-f463-40b7-946a-776cabcd4c16 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:59.249102 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003cb64-f463-40b7-946a-776cabcd4c16 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:59.253821 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8ec46-4e58-4bfe-add9-ad191da855a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:59.254758 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8ec46-4e58-4bfe-add9-ad191da855a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:59.255316 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8ec46-4e58-4bfe-add9-ad191da855a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:59.255779 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8ec46-4e58-4bfe-add9-ad191da855a0 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:59.256817 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8ec46-4e58-4bfe-add9-ad191da855a0 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:59.257356 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8ec46-4e58-4bfe-add9-ad191da855a0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:59.259415 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8ec46-4e58-4bfe-add9-ad191da855a0 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:59.277359 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 392/782] 10.222.0.15 () {56 vars in 1156 bytes} [Mon Nov 29 20:08:59 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:59.283863 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e7529-2cf7-4786-9c78-558ecf5e5479 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:59.294121 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e7529-2cf7-4786-9c78-558ecf5e5479 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:59.299112 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3ad1b-05dc-4bba-b531-d6b06f2434d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:59.300037 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3ad1b-05dc-4bba-b531-d6b06f2434d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:59.300545 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3ad1b-05dc-4bba-b531-d6b06f2434d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:59.301013 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3ad1b-05dc-4bba-b531-d6b06f2434d5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:59.309557 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa3ad1b-05dc-4bba-b531-d6b06f2434d5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:59.311643 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa3ad1b-05dc-4bba-b531-d6b06f2434d5 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:59.321211 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 391/783] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:08:59 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:08:59.327632 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8ec46-4e58-4bfe-add9-ad191da855a0 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:59.337892 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8ec46-4e58-4bfe-add9-ad191da855a0 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:59.342587 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280a83e-0838-4b60-8f2e-c2cb8354497a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:59.343736 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280a83e-0838-4b60-8f2e-c2cb8354497a admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:59.344243 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280a83e-0838-4b60-8f2e-c2cb8354497a admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:59.344731 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280a83e-0838-4b60-8f2e-c2cb8354497a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:59.355408 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b280a83e-0838-4b60-8f2e-c2cb8354497a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:59.357544 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b280a83e-0838-4b60-8f2e-c2cb8354497a admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:59.374809 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-b280a83e-0838-4b60-8f2e-c2cb8354497a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:08:59.376679 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 393/784] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:08:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:08:59.383149 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3ad1b-05dc-4bba-b531-d6b06f2434d5 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:59.393330 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3ad1b-05dc-4bba-b531-d6b06f2434d5 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:59.398582 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d99fb-07a3-4503-be09-a8747336e1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:59.399682 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d99fb-07a3-4503-be09-a8747336e1a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:59.400160 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d99fb-07a3-4503-be09-a8747336e1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:59.400671 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d99fb-07a3-4503-be09-a8747336e1a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:59.401645 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d99fb-07a3-4503-be09-a8747336e1a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:59.402148 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d99fb-07a3-4503-be09-a8747336e1a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:59.404102 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d99fb-07a3-4503-be09-a8747336e1a0 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:59.417539 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 392/785] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:08:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:59.423920 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280a83e-0838-4b60-8f2e-c2cb8354497a admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:59.434001 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280a83e-0838-4b60-8f2e-c2cb8354497a admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:59.438841 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77063b-dbbb-406e-bdf3-fcbd6ee456b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:59.439910 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77063b-dbbb-406e-bdf3-fcbd6ee456b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:59.440415 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77063b-dbbb-406e-bdf3-fcbd6ee456b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:59.440901 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77063b-dbbb-406e-bdf3-fcbd6ee456b2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:59.448471 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77063b-dbbb-406e-bdf3-fcbd6ee456b2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:59.450763 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77063b-dbbb-406e-bdf3-fcbd6ee456b2 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:59.464649 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-9a77063b-dbbb-406e-bdf3-fcbd6ee456b2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 29 20:08:59.466110 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 394/786] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:08:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:08:59.472634 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d99fb-07a3-4503-be09-a8747336e1a0 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:59.482962 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d99fb-07a3-4503-be09-a8747336e1a0 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:59.488114 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a80748-776a-4ade-bd9c-b105c2d5bafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:59.489108 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a80748-776a-4ade-bd9c-b105c2d5bafe admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:59.489630 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a80748-776a-4ade-bd9c-b105c2d5bafe admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:59.490119 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a80748-776a-4ade-bd9c-b105c2d5bafe admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:59.491275 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a80748-776a-4ade-bd9c-b105c2d5bafe admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:59.491796 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a80748-776a-4ade-bd9c-b105c2d5bafe admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:59.494008 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a80748-776a-4ade-bd9c-b105c2d5bafe admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:59.507245 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 393/787] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Nov 29 20:08:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:08:59.514423 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77063b-dbbb-406e-bdf3-fcbd6ee456b2 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:08:59.525865 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77063b-dbbb-406e-bdf3-fcbd6ee456b2 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:08:59.530824 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247c468-6cb8-44c3-8252-d7088f71d439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:08:59.531816 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247c468-6cb8-44c3-8252-d7088f71d439 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:08:59.532335 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247c468-6cb8-44c3-8252-d7088f71d439 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:08:59.532839 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247c468-6cb8-44c3-8252-d7088f71d439 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:08:59.533924 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a247c468-6cb8-44c3-8252-d7088f71d439 admin admin] RBAC: Adding query filter params (role.id=33d95c7861b64f1a95af8a333bd626ea, scope.project.id=6f4cba10fe824640b2ed37aab02346ac, user.id=51fc6fd9b37447bba1759a702b86ce6c) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:08:59.534425 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a247c468-6cb8-44c3-8252-d7088f71d439 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:08:59.536687 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a247c468-6cb8-44c3-8252-d7088f71d439 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:08:59.547951 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 395/788] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:08:59 2021] GET /identity/v3/role_assignments?user.id=51fc6fd9b37447bba1759a702b86ce6c&scope.project.id=6f4cba10fe824640b2ed37aab02346ac&role.id=33d95c7861b64f1a95af8a333bd626ea => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:00.255539 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f85ac3-3666-4fb2-a4f8-7c35b8ca83ff None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:00.256555 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f85ac3-3666-4fb2-a4f8-7c35b8ca83ff None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:00.262839 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f85ac3-3666-4fb2-a4f8-7c35b8ca83ff None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:00.265788 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 394/789] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:00 2021] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:09:00.272217 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27e5d8-b09f-4db5-9ade-c209ad03050b None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:00.273081 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27e5d8-b09f-4db5-9ade-c209ad03050b None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:00.273548 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f27e5d8-b09f-4db5-9ade-c209ad03050b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:00.292155 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-2f27e5d8-b09f-4db5-9ade-c209ad03050b None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:00.293626 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-2f27e5d8-b09f-4db5-9ade-c209ad03050b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:00.304815 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 396/790] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:00 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:09:00.332973 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f85ac3-3666-4fb2-a4f8-7c35b8ca83ff None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:00.345498 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f85ac3-3666-4fb2-a4f8-7c35b8ca83ff None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:00.351913 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be45b318-7356-486c-9815-08827de01964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:00.352725 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45b318-7356-486c-9815-08827de01964 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:00.353008 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45b318-7356-486c-9815-08827de01964 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:00.353286 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be45b318-7356-486c-9815-08827de01964 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:00.353959 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be45b318-7356-486c-9815-08827de01964 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:00.355602 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be45b318-7356-486c-9815-08827de01964 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:00.368034 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-be45b318-7356-486c-9815-08827de01964 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 29 20:09:00.375088 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 395/791] 10.222.0.15 () {56 vars in 1150 bytes} [Mon Nov 29 20:09:00 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:00.381997 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f27e5d8-b09f-4db5-9ade-c209ad03050b None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:00.392323 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f27e5d8-b09f-4db5-9ade-c209ad03050b None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:00.398728 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12c2a8-b34d-46a6-8931-dbe71e8d98d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:00.399439 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12c2a8-b34d-46a6-8931-dbe71e8d98d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:00.399719 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12c2a8-b34d-46a6-8931-dbe71e8d98d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:00.399995 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12c2a8-b34d-46a6-8931-dbe71e8d98d3 admin admin] PATH_INFO: `/v3/services` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:00.400727 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12c2a8-b34d-46a6-8931-dbe71e8d98d3 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:00.401032 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12c2a8-b34d-46a6-8931-dbe71e8d98d3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:00.402646 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12c2a8-b34d-46a6-8931-dbe71e8d98d3 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:00.411113 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 397/792] 10.222.0.15 () {56 vars in 1145 bytes} [Mon Nov 29 20:09:00 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:00.417314 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be45b318-7356-486c-9815-08827de01964 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:00.427598 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be45b318-7356-486c-9815-08827de01964 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:00.432324 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828584b-e294-4d3c-b695-aaf573bdcd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:00.433197 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828584b-e294-4d3c-b695-aaf573bdcd97 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:00.433692 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828584b-e294-4d3c-b695-aaf573bdcd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:00.434157 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828584b-e294-4d3c-b695-aaf573bdcd97 admin admin] PATH_INFO: `/v3/services` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:00.435106 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828584b-e294-4d3c-b695-aaf573bdcd97 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:00.435605 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828584b-e294-4d3c-b695-aaf573bdcd97 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:00.437449 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828584b-e294-4d3c-b695-aaf573bdcd97 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:00.443072 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 396/793] 10.222.0.15 () {56 vars in 1145 bytes} [Mon Nov 29 20:09:00 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:00.450902 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12c2a8-b34d-46a6-8931-dbe71e8d98d3 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:00.463724 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12c2a8-b34d-46a6-8931-dbe71e8d98d3 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:00.470911 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23779e0d-8968-4073-9202-bbda08237bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:00.471576 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23779e0d-8968-4073-9202-bbda08237bfc admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:00.471857 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23779e0d-8968-4073-9202-bbda08237bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:00.472132 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23779e0d-8968-4073-9202-bbda08237bfc admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:00.472946 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23779e0d-8968-4073-9202-bbda08237bfc admin admin] RBAC: Adding query filter params (interface=public, service_id=b4694c2934fe403d8fdcc820eb84bc12, region_id=RegionOne) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:00.473258 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23779e0d-8968-4073-9202-bbda08237bfc admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:00.474263 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING py.warnings [None req-23779e0d-8968-4073-9202-bbda08237bfc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 29 20:09:00.474263 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: warnings.warn(msg) Nov 29 20:09:00.474263 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: Nov 29 20:09:00.475171 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23779e0d-8968-4073-9202-bbda08237bfc admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:00.489520 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 398/794] 10.222.0.15 () {56 vars in 1272 bytes} [Mon Nov 29 20:09:00 2021] GET /identity/v3/endpoints?service_id=b4694c2934fe403d8fdcc820eb84bc12&interface=public®ion_id=RegionOne => generated 194 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:00.495481 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828584b-e294-4d3c-b695-aaf573bdcd97 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:00.505362 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828584b-e294-4d3c-b695-aaf573bdcd97 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:00.519523 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef972fd2-6475-4217-a855-74d4bbd2d7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:00.520183 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef972fd2-6475-4217-a855-74d4bbd2d7a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:00.520465 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef972fd2-6475-4217-a855-74d4bbd2d7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:00.520736 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef972fd2-6475-4217-a855-74d4bbd2d7a9 admin admin] PATH_INFO: `/v3/services` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:00.521442 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef972fd2-6475-4217-a855-74d4bbd2d7a9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:00.523050 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef972fd2-6475-4217-a855-74d4bbd2d7a9 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:00.529433 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 397/795] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Nov 29 20:09:00 2021] GET /identity/v3/services => generated 772 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:00.806218 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c47569-7429-48f8-b59e-1d718b376859 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:00.806410 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c47569-7429-48f8-b59e-1d718b376859 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:00.806675 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c47569-7429-48f8-b59e-1d718b376859 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:00.808807 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 399/796] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:09:00.815277 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da18570-5cbf-4714-8fec-f5c6e0d7ac53 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:00.815558 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da18570-5cbf-4714-8fec-f5c6e0d7ac53 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:00.815834 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da18570-5cbf-4714-8fec-f5c6e0d7ac53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:00.841347 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-8da18570-5cbf-4714-8fec-f5c6e0d7ac53 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:00.842584 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-8da18570-5cbf-4714-8fec-f5c6e0d7ac53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:00.853302 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 398/797] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:00 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:09:00.877087 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c47569-7429-48f8-b59e-1d718b376859 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:00.894206 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c47569-7429-48f8-b59e-1d718b376859 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:00.899115 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bbc0bb-50f7-4990-9125-2eef2a4e4a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:00.900196 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bbc0bb-50f7-4990-9125-2eef2a4e4a16 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:00.900682 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bbc0bb-50f7-4990-9125-2eef2a4e4a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:00.901187 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bbc0bb-50f7-4990-9125-2eef2a4e4a16 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:00.902143 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bbc0bb-50f7-4990-9125-2eef2a4e4a16 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:00.903997 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bbc0bb-50f7-4990-9125-2eef2a4e4a16 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:00.917533 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-57bbc0bb-50f7-4990-9125-2eef2a4e4a16 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 29 20:09:00.919435 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 400/798] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:09:00 2021] GET /identity/v3/services/network => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:09:00.926508 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da18570-5cbf-4714-8fec-f5c6e0d7ac53 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:00.940044 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da18570-5cbf-4714-8fec-f5c6e0d7ac53 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:00.948138 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde1ed13-ea29-45fb-b698-24487fcb5c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:00.948821 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1ed13-ea29-45fb-b698-24487fcb5c2d admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:00.949109 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1ed13-ea29-45fb-b698-24487fcb5c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:00.949382 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde1ed13-ea29-45fb-b698-24487fcb5c2d admin admin] PATH_INFO: `/v3/services` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:00.950122 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde1ed13-ea29-45fb-b698-24487fcb5c2d admin admin] RBAC: Adding query filter params (name=network) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:00.950427 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde1ed13-ea29-45fb-b698-24487fcb5c2d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:00.952048 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde1ed13-ea29-45fb-b698-24487fcb5c2d admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:00.957392 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 399/799] 10.222.0.15 () {56 vars in 1133 bytes} [Mon Nov 29 20:09:00 2021] GET /identity/v3/services?name=network => generated 124 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:00.963430 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bbc0bb-50f7-4990-9125-2eef2a4e4a16 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:00.973420 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bbc0bb-50f7-4990-9125-2eef2a4e4a16 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:00.987792 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736bbb46-28af-4153-b6e5-0eae2f11a4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:00.988738 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736bbb46-28af-4153-b6e5-0eae2f11a4fe admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:00.989155 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736bbb46-28af-4153-b6e5-0eae2f11a4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:00.989583 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736bbb46-28af-4153-b6e5-0eae2f11a4fe admin admin] PATH_INFO: `/v3/services` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:00.990466 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736bbb46-28af-4153-b6e5-0eae2f11a4fe admin admin] RBAC: Adding query filter params (type=network) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:00.990957 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736bbb46-28af-4153-b6e5-0eae2f11a4fe admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:00.992970 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736bbb46-28af-4153-b6e5-0eae2f11a4fe admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:01.000622 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 401/800] 10.222.0.15 () {56 vars in 1133 bytes} [Mon Nov 29 20:09:00 2021] GET /identity/v3/services?type=network => generated 350 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:01.007287 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde1ed13-ea29-45fb-b698-24487fcb5c2d admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:01.021080 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde1ed13-ea29-45fb-b698-24487fcb5c2d admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:01.028101 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14496b17-d45d-4ba3-8af7-62b296133ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:01.028806 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14496b17-d45d-4ba3-8af7-62b296133ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:01.029088 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14496b17-d45d-4ba3-8af7-62b296133ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:01.029359 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14496b17-d45d-4ba3-8af7-62b296133ef8 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:01.030217 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14496b17-d45d-4ba3-8af7-62b296133ef8 admin admin] RBAC: Adding query filter params (interface=public, service_id=71aae747878349e3aecbad7264663b38, region_id=RegionOne) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:01.030525 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14496b17-d45d-4ba3-8af7-62b296133ef8 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:01.031698 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING py.warnings [None req-14496b17-d45d-4ba3-8af7-62b296133ef8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 29 20:09:01.031698 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: warnings.warn(msg) Nov 29 20:09:01.031698 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: Nov 29 20:09:01.032580 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14496b17-d45d-4ba3-8af7-62b296133ef8 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:01.045427 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 400/801] 10.222.0.15 () {56 vars in 1272 bytes} [Mon Nov 29 20:09:01 2021] GET /identity/v3/endpoints?service_id=71aae747878349e3aecbad7264663b38&interface=public®ion_id=RegionOne => generated 194 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:01.051795 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736bbb46-28af-4153-b6e5-0eae2f11a4fe admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:01.066961 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736bbb46-28af-4153-b6e5-0eae2f11a4fe admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:01.078324 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b6987-ceb3-4010-9ecb-84ddd576833f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:01.079390 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b6987-ceb3-4010-9ecb-84ddd576833f admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:01.079898 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b6987-ceb3-4010-9ecb-84ddd576833f admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:01.080357 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b6987-ceb3-4010-9ecb-84ddd576833f admin admin] PATH_INFO: `/v3/services` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:01.081259 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b6987-ceb3-4010-9ecb-84ddd576833f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:01.083079 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b6987-ceb3-4010-9ecb-84ddd576833f admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:01.089405 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 402/802] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Nov 29 20:09:01 2021] GET /identity/v3/services => generated 772 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:01.104158 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7d543-c13f-4dcb-87b4-63aa645dd043 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:01.104482 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7d543-c13f-4dcb-87b4-63aa645dd043 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:01.104709 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7d543-c13f-4dcb-87b4-63aa645dd043 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:01.106762 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 401/803] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:09:01.113326 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475baf4-a70f-4568-9711-eecec175e2c3 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:01.113655 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475baf4-a70f-4568-9711-eecec175e2c3 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:01.113866 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475baf4-a70f-4568-9711-eecec175e2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:01.143958 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-a475baf4-a70f-4568-9711-eecec175e2c3 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:01.145185 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-a475baf4-a70f-4568-9711-eecec175e2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:01.158411 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 403/804] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:01 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:09:01.194661 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7d543-c13f-4dcb-87b4-63aa645dd043 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:01.213191 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7d543-c13f-4dcb-87b4-63aa645dd043 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:01.221558 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad32ad3c-ab56-4140-94fe-b652f8710e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:01.222467 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32ad3c-ab56-4140-94fe-b652f8710e5e admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:01.222745 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32ad3c-ab56-4140-94fe-b652f8710e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:01.223037 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32ad3c-ab56-4140-94fe-b652f8710e5e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:01.244077 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad32ad3c-ab56-4140-94fe-b652f8710e5e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:09:01.251080 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-ad32ad3c-ab56-4140-94fe-b652f8710e5e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 29 20:09:01.252526 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 402/805] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Nov 29 20:09:01 2021] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:01.258758 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475baf4-a70f-4568-9711-eecec175e2c3 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:01.272390 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475baf4-a70f-4568-9711-eecec175e2c3 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:01.280586 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f478a-5d9c-49eb-870f-b5538933aaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:01.281356 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f478a-5d9c-49eb-870f-b5538933aaa5 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:01.281636 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f478a-5d9c-49eb-870f-b5538933aaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:01.281906 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273f478a-5d9c-49eb-870f-b5538933aaa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:01.282681 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f478a-5d9c-49eb-870f-b5538933aaa5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:01.283018 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f478a-5d9c-49eb-870f-b5538933aaa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:01.284638 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273f478a-5d9c-49eb-870f-b5538933aaa5 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:01.299213 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 404/806] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:09:01 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:01.305388 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad32ad3c-ab56-4140-94fe-b652f8710e5e admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:01.320224 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad32ad3c-ab56-4140-94fe-b652f8710e5e admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:01.328595 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc313b4e-4be2-4c46-bf6c-08a872ce4876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:01.330564 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc313b4e-4be2-4c46-bf6c-08a872ce4876 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:01.330564 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc313b4e-4be2-4c46-bf6c-08a872ce4876 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:01.330564 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc313b4e-4be2-4c46-bf6c-08a872ce4876 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:01.342567 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc313b4e-4be2-4c46-bf6c-08a872ce4876 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:01.344978 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc313b4e-4be2-4c46-bf6c-08a872ce4876 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:01.362535 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-cc313b4e-4be2-4c46-bf6c-08a872ce4876 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:09:01.364322 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 403/807] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:09:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:01.370058 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f478a-5d9c-49eb-870f-b5538933aaa5 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:01.384318 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273f478a-5d9c-49eb-870f-b5538933aaa5 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:01.390001 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84222e-8117-4937-81f7-9642ac9ac290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:01.390704 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84222e-8117-4937-81f7-9642ac9ac290 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:01.391019 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84222e-8117-4937-81f7-9642ac9ac290 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:01.391296 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84222e-8117-4937-81f7-9642ac9ac290 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:01.392049 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84222e-8117-4937-81f7-9642ac9ac290 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:01.392357 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84222e-8117-4937-81f7-9642ac9ac290 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:01.393946 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84222e-8117-4937-81f7-9642ac9ac290 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:01.409572 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 405/808] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:09:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:01.415103 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc313b4e-4be2-4c46-bf6c-08a872ce4876 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:01.422245 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b5d94-c4be-4226-b1db-3e0042a456a9 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:01.422534 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b5d94-c4be-4226-b1db-3e0042a456a9 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:01.422889 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b5d94-c4be-4226-b1db-3e0042a456a9 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:01.424663 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 406/809] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 29 20:09:01.426141 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc313b4e-4be2-4c46-bf6c-08a872ce4876 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:01.430945 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576916c-edaa-45d8-9781-a909aebdef9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:01.432042 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576916c-edaa-45d8-9781-a909aebdef9d admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:01.432146 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ee1e2-a900-4c6e-aaaf-8f5735e31922 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:01.432351 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ee1e2-a900-4c6e-aaaf-8f5735e31922 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:01.432632 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ee1e2-a900-4c6e-aaaf-8f5735e31922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:01.433027 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576916c-edaa-45d8-9781-a909aebdef9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:01.433493 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576916c-edaa-45d8-9781-a909aebdef9d admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:01.442782 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b576916c-edaa-45d8-9781-a909aebdef9d admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:01.445511 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b576916c-edaa-45d8-9781-a909aebdef9d admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:01.450372 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-756ee1e2-a900-4c6e-aaaf-8f5735e31922 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:01.451641 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-756ee1e2-a900-4c6e-aaaf-8f5735e31922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:01.461209 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-b576916c-edaa-45d8-9781-a909aebdef9d admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 29 20:09:01.462875 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 404/811] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Nov 29 20:09:01 2021] GET /identity/v3/users/nova => generated 82 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:01.462978 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 407/811] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:01 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:09:01.470989 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ee1e2-a900-4c6e-aaaf-8f5735e31922 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:01.479994 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ee1e2-a900-4c6e-aaaf-8f5735e31922 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:01.484778 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a8f76-dfa3-4ca6-89aa-617add565c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:01.485504 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a8f76-dfa3-4ca6-89aa-617add565c08 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:01.485841 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a8f76-dfa3-4ca6-89aa-617add565c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:01.486117 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a8f76-dfa3-4ca6-89aa-617add565c08 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:01.487086 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a8f76-dfa3-4ca6-89aa-617add565c08 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:01.487449 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a8f76-dfa3-4ca6-89aa-617add565c08 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:01.489502 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576916c-edaa-45d8-9781-a909aebdef9d admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:01.492362 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a8f76-dfa3-4ca6-89aa-617add565c08 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:01.509167 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576916c-edaa-45d8-9781-a909aebdef9d admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:01.523959 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b0e88-f35f-405c-a541-6d6b9b7c23d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:01.524832 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b0e88-f35f-405c-a541-6d6b9b7c23d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:01.525107 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b0e88-f35f-405c-a541-6d6b9b7c23d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:01.525377 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b0e88-f35f-405c-a541-6d6b9b7c23d3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:01.533221 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 408/812] 10.222.0.15 () {56 vars in 1154 bytes} [Mon Nov 29 20:09:01 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:09:01.535717 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a8f76-dfa3-4ca6-89aa-617add565c08 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:01.545548 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791b0e88-f35f-405c-a541-6d6b9b7c23d3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:09:01.548883 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a8f76-dfa3-4ca6-89aa-617add565c08 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:01.553108 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-791b0e88-f35f-405c-a541-6d6b9b7c23d3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 29 20:09:01.554672 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 405/813] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Nov 29 20:09:01 2021] GET /identity/v3/roles/service => generated 85 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:09:01.560721 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b0e88-f35f-405c-a541-6d6b9b7c23d3 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:01.561185 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f88eb-afe7-4908-9e3b-6c4f6537c3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:01.562262 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f88eb-afe7-4908-9e3b-6c4f6537c3ef admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:01.562545 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f88eb-afe7-4908-9e3b-6c4f6537c3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:01.562819 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f88eb-afe7-4908-9e3b-6c4f6537c3ef admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:01.580692 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b0e88-f35f-405c-a541-6d6b9b7c23d3 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:01.582102 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5f88eb-afe7-4908-9e3b-6c4f6537c3ef admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:01.583895 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5f88eb-afe7-4908-9e3b-6c4f6537c3ef admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:01.592920 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e502169-fd16-48a5-b3fe-0d403962081a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:01.593646 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e502169-fd16-48a5-b3fe-0d403962081a admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:01.593974 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e502169-fd16-48a5-b3fe-0d403962081a admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:01.594290 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e502169-fd16-48a5-b3fe-0d403962081a admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:01.595077 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e502169-fd16-48a5-b3fe-0d403962081a admin admin] RBAC: Adding query filter params (name=service) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:01.595377 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e502169-fd16-48a5-b3fe-0d403962081a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:01.601611 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e502169-fd16-48a5-b3fe-0d403962081a admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:01.604547 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 409/814] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:09:01 2021] GET /identity/v3/auth/tokens => generated 1117 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 29 20:09:01.610712 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f88eb-afe7-4908-9e3b-6c4f6537c3ef admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:01.610951 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 406/815] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Nov 29 20:09:01 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:01.623836 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f88eb-afe7-4908-9e3b-6c4f6537c3ef admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:01.630876 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e502169-fd16-48a5-b3fe-0d403962081a admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:01.636971 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adaa834-b453-4410-8bae-72471b9d2951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:01.637766 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adaa834-b453-4410-8bae-72471b9d2951 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:01.638042 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adaa834-b453-4410-8bae-72471b9d2951 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:01.638307 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adaa834-b453-4410-8bae-72471b9d2951 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:01.641625 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e502169-fd16-48a5-b3fe-0d403962081a admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:01.653136 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc5212-f84d-43d7-a9c6-786bf0d98a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:01.653929 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc5212-f84d-43d7-a9c6-786bf0d98a72 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:01.654201 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc5212-f84d-43d7-a9c6-786bf0d98a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:01.654462 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc5212-f84d-43d7-a9c6-786bf0d98a72 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:01.657081 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adaa834-b453-4410-8bae-72471b9d2951 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:01.658948 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adaa834-b453-4410-8bae-72471b9d2951 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:01.676939 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc5212-f84d-43d7-a9c6-786bf0d98a72 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:01.678773 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc5212-f84d-43d7-a9c6-786bf0d98a72 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:01.694241 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-2adaa834-b453-4410-8bae-72471b9d2951 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:09:01.695641 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 410/816] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:09:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:01.701607 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adaa834-b453-4410-8bae-72471b9d2951 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:01.711312 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-1ddc5212-f84d-43d7-a9c6-786bf0d98a72 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:09:01.712528 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 407/817] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:09:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:09:01.718548 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc5212-f84d-43d7-a9c6-786bf0d98a72 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:01.721329 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adaa834-b453-4410-8bae-72471b9d2951 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:01.726244 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a49e0-e04d-4475-8b89-d71eb2a07d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:01.727219 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a49e0-e04d-4475-8b89-d71eb2a07d2b admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:01.727694 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a49e0-e04d-4475-8b89-d71eb2a07d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:01.728157 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a49e0-e04d-4475-8b89-d71eb2a07d2b admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:01.729079 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a49e0-e04d-4475-8b89-d71eb2a07d2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:01.729644 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a49e0-e04d-4475-8b89-d71eb2a07d2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:01.731146 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc5212-f84d-43d7-a9c6-786bf0d98a72 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:01.731726 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a49e0-e04d-4475-8b89-d71eb2a07d2b admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:01.747293 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c93eff-1f9c-4d09-8f12-fa4b17caf515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:01.747857 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 411/818] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:09:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:09:01.753148 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c93eff-1f9c-4d09-8f12-fa4b17caf515 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:01.754534 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a49e0-e04d-4475-8b89-d71eb2a07d2b admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:01.755142 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c93eff-1f9c-4d09-8f12-fa4b17caf515 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:01.756013 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c93eff-1f9c-4d09-8f12-fa4b17caf515 admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:01.758497 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c93eff-1f9c-4d09-8f12-fa4b17caf515 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:01.759046 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c93eff-1f9c-4d09-8f12-fa4b17caf515 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:01.762455 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c93eff-1f9c-4d09-8f12-fa4b17caf515 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:01.772225 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a49e0-e04d-4475-8b89-d71eb2a07d2b admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:01.783046 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 408/819] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:09:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:01.789393 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff4a41-7333-4ab6-a6bb-6d74c6f8ad6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:01.790559 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff4a41-7333-4ab6-a6bb-6d74c6f8ad6d admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:01.791053 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff4a41-7333-4ab6-a6bb-6d74c6f8ad6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:01.791991 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff4a41-7333-4ab6-a6bb-6d74c6f8ad6d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:01.793152 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c93eff-1f9c-4d09-8f12-fa4b17caf515 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:01.802769 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff4a41-7333-4ab6-a6bb-6d74c6f8ad6d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:01.805048 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff4a41-7333-4ab6-a6bb-6d74c6f8ad6d admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:01.817806 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c93eff-1f9c-4d09-8f12-fa4b17caf515 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:01.819862 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-33ff4a41-7333-4ab6-a6bb-6d74c6f8ad6d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 29 20:09:01.821610 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 412/820] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:09:01 2021] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:01.828126 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff4a41-7333-4ab6-a6bb-6d74c6f8ad6d admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:01.839265 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff4a41-7333-4ab6-a6bb-6d74c6f8ad6d admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:01.841888 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb378d5-a7cb-4a90-8e13-3ea0c80e2132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:01.844021 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb378d5-a7cb-4a90-8e13-3ea0c80e2132 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:01.845263 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb378d5-a7cb-4a90-8e13-3ea0c80e2132 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:01.845757 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb378d5-a7cb-4a90-8e13-3ea0c80e2132 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:01.847762 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adfd526-dd0d-48c1-93ac-55e3ce01f29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:01.849260 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfd526-dd0d-48c1-93ac-55e3ce01f29a admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:01.850400 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfd526-dd0d-48c1-93ac-55e3ce01f29a admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:01.850898 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adfd526-dd0d-48c1-93ac-55e3ce01f29a admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:01.852929 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adfd526-dd0d-48c1-93ac-55e3ce01f29a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:01.853690 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adfd526-dd0d-48c1-93ac-55e3ce01f29a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:01.856818 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adfd526-dd0d-48c1-93ac-55e3ce01f29a admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:01.863805 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb378d5-a7cb-4a90-8e13-3ea0c80e2132 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:01.867261 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb378d5-a7cb-4a90-8e13-3ea0c80e2132 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:01.881352 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 413/821] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Nov 29 20:09:01 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:09:01.891462 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adfd526-dd0d-48c1-93ac-55e3ce01f29a admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:01.903368 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-cbb378d5-a7cb-4a90-8e13-3ea0c80e2132 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 29 20:09:01.906784 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 409/822] 10.222.0.15 () {56 vars in 1138 bytes} [Mon Nov 29 20:09:01 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 115 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:01.907546 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adfd526-dd0d-48c1-93ac-55e3ce01f29a admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:01.911452 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb378d5-a7cb-4a90-8e13-3ea0c80e2132 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:01.918447 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1e03b-7a53-43d0-988f-226ff116a96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:01.919347 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1e03b-7a53-43d0-988f-226ff116a96c admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:01.920776 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1e03b-7a53-43d0-988f-226ff116a96c admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:01.921307 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1e03b-7a53-43d0-988f-226ff116a96c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:01.923293 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e1e03b-7a53-43d0-988f-226ff116a96c admin admin] RBAC: Adding query filter params (role.id=33d95c7861b64f1a95af8a333bd626ea, scope.project.id=6f4cba10fe824640b2ed37aab02346ac, user.id=5f76a8c3d04e440b92d12ced18d97941) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:01.923808 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e1e03b-7a53-43d0-988f-226ff116a96c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:01.927726 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e1e03b-7a53-43d0-988f-226ff116a96c admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:01.928811 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb378d5-a7cb-4a90-8e13-3ea0c80e2132 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:01.939275 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a973fb2-b0d6-4a04-a0e3-47fe9b55d128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:01.941414 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a973fb2-b0d6-4a04-a0e3-47fe9b55d128 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:01.941950 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a973fb2-b0d6-4a04-a0e3-47fe9b55d128 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:01.942413 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 414/823] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:09:01 2021] GET /identity/v3/role_assignments?user.id=5f76a8c3d04e440b92d12ced18d97941&scope.project.id=6f4cba10fe824640b2ed37aab02346ac&role.id=33d95c7861b64f1a95af8a333bd626ea => generated 608 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:01.942920 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a973fb2-b0d6-4a04-a0e3-47fe9b55d128 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:01.944152 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a973fb2-b0d6-4a04-a0e3-47fe9b55d128 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:01.944668 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a973fb2-b0d6-4a04-a0e3-47fe9b55d128 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:01.946831 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a973fb2-b0d6-4a04-a0e3-47fe9b55d128 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:01.966075 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 410/824] 10.222.0.15 () {56 vars in 1170 bytes} [Mon Nov 29 20:09:01 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:01.972420 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1e03b-7a53-43d0-988f-226ff116a96c admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:01.985560 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1e03b-7a53-43d0-988f-226ff116a96c admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:01.991560 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826666f-1edc-454b-bca3-0636c08f042c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:01.992676 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826666f-1edc-454b-bca3-0636c08f042c admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:01.993196 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826666f-1edc-454b-bca3-0636c08f042c admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:01.993661 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826666f-1edc-454b-bca3-0636c08f042c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:02.009488 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e826666f-1edc-454b-bca3-0636c08f042c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:02.011761 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e826666f-1edc-454b-bca3-0636c08f042c admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:02.029877 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-e826666f-1edc-454b-bca3-0636c08f042c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:09:02.031542 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 415/825] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:09:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:02.040040 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a973fb2-b0d6-4a04-a0e3-47fe9b55d128 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:02.051150 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a973fb2-b0d6-4a04-a0e3-47fe9b55d128 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:02.058147 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d45648-ee68-442c-8ddc-e62795b05d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:02.059180 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d45648-ee68-442c-8ddc-e62795b05d00 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:02.059654 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d45648-ee68-442c-8ddc-e62795b05d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:02.060154 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d45648-ee68-442c-8ddc-e62795b05d00 admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:02.061106 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d45648-ee68-442c-8ddc-e62795b05d00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:02.061657 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d45648-ee68-442c-8ddc-e62795b05d00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:02.063628 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d45648-ee68-442c-8ddc-e62795b05d00 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:02.082628 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 411/826] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:09:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:02.088521 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826666f-1edc-454b-bca3-0636c08f042c admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:02.109043 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826666f-1edc-454b-bca3-0636c08f042c admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:02.118014 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec2daa4-4973-4390-b5c0-37d0257b036f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:02.119230 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2daa4-4973-4390-b5c0-37d0257b036f admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:02.119777 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2daa4-4973-4390-b5c0-37d0257b036f admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:02.120242 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec2daa4-4973-4390-b5c0-37d0257b036f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:02.136398 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec2daa4-4973-4390-b5c0-37d0257b036f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:02.139135 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec2daa4-4973-4390-b5c0-37d0257b036f admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:02.162742 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-aec2daa4-4973-4390-b5c0-37d0257b036f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 29 20:09:02.164360 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 416/827] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:09:02 2021] GET /identity/v3/projects/service => generated 88 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:02.170973 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d45648-ee68-442c-8ddc-e62795b05d00 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:02.184887 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d45648-ee68-442c-8ddc-e62795b05d00 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:02.200809 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a3426-717a-49bc-a853-95e2a60033fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:02.201495 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a3426-717a-49bc-a853-95e2a60033fe admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:02.201770 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a3426-717a-49bc-a853-95e2a60033fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:02.202039 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a3426-717a-49bc-a853-95e2a60033fe admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:02.202898 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a3426-717a-49bc-a853-95e2a60033fe admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:02.203207 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a3426-717a-49bc-a853-95e2a60033fe admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:02.205055 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a3426-717a-49bc-a853-95e2a60033fe admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:02.225423 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 412/828] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Nov 29 20:09:02 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:02.232200 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec2daa4-4973-4390-b5c0-37d0257b036f admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:02.248303 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec2daa4-4973-4390-b5c0-37d0257b036f admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:02.269668 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff397f-c8cc-4c10-bddd-4649c8789ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:02.270962 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff397f-c8cc-4c10-bddd-4649c8789ea5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:02.271437 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff397f-c8cc-4c10-bddd-4649c8789ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:02.271898 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff397f-c8cc-4c10-bddd-4649c8789ea5 admin admin] PATH_INFO: `/v3/projects/6f4cba10fe824640b2ed37aab02346ac/users/19d72c913c2b4442836a991120eec243/roles/4851b1a48d8a4188b335219acbede502` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:02.300784 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff397f-c8cc-4c10-bddd-4649c8789ea5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f4cba10fe824640b2ed37aab02346ac, user_id=19d72c913c2b4442836a991120eec243, role_id=4851b1a48d8a4188b335219acbede502)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:02.304341 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff397f-c8cc-4c10-bddd-4649c8789ea5 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:02.326739 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 417/829] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Nov 29 20:09:02 2021] PUT /identity/v3/projects/6f4cba10fe824640b2ed37aab02346ac/users/19d72c913c2b4442836a991120eec243/roles/4851b1a48d8a4188b335219acbede502 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:09:02.639022 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3584bd-48d5-4aff-b6ba-de5be526df2a None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:02.639541 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3584bd-48d5-4aff-b6ba-de5be526df2a None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:02.639735 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3584bd-48d5-4aff-b6ba-de5be526df2a None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:02.641783 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 413/830] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:09:02.648079 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6025c-d01c-44bd-936e-bfa35ba47717 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:02.648615 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6025c-d01c-44bd-936e-bfa35ba47717 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:02.649085 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6025c-d01c-44bd-936e-bfa35ba47717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:02.669621 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-feb6025c-d01c-44bd-936e-bfa35ba47717 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:02.671172 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-feb6025c-d01c-44bd-936e-bfa35ba47717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:02.737492 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 418/831] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:02 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:09:02.771319 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3584bd-48d5-4aff-b6ba-de5be526df2a None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:02.789578 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3584bd-48d5-4aff-b6ba-de5be526df2a None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:02.796757 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295efa5e-a8ec-42a6-8cd8-39d56963fc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:02.797630 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295efa5e-a8ec-42a6-8cd8-39d56963fc0b admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:02.797916 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295efa5e-a8ec-42a6-8cd8-39d56963fc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:02.798194 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295efa5e-a8ec-42a6-8cd8-39d56963fc0b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:02.816996 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295efa5e-a8ec-42a6-8cd8-39d56963fc0b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:09:02.824037 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-295efa5e-a8ec-42a6-8cd8-39d56963fc0b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 29 20:09:02.829196 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 414/832] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Nov 29 20:09:02 2021] GET /identity/v3/roles/admin => generated 83 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:02.832074 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6025c-d01c-44bd-936e-bfa35ba47717 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:02.849274 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6025c-d01c-44bd-936e-bfa35ba47717 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:02.859255 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac55c90-7312-40ee-ac90-521d0e8efa70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:02.860219 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac55c90-7312-40ee-ac90-521d0e8efa70 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:02.860694 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac55c90-7312-40ee-ac90-521d0e8efa70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:02.861177 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac55c90-7312-40ee-ac90-521d0e8efa70 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:02.862131 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac55c90-7312-40ee-ac90-521d0e8efa70 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:02.862653 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac55c90-7312-40ee-ac90-521d0e8efa70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:02.864470 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac55c90-7312-40ee-ac90-521d0e8efa70 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:02.878588 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 419/833] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:09:02 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:02.884335 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295efa5e-a8ec-42a6-8cd8-39d56963fc0b admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:02.905149 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295efa5e-a8ec-42a6-8cd8-39d56963fc0b admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:02.912367 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1179e7-a68d-4fed-a8b3-e391aa06b884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:02.913164 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1179e7-a68d-4fed-a8b3-e391aa06b884 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:02.913445 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1179e7-a68d-4fed-a8b3-e391aa06b884 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:02.913719 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1179e7-a68d-4fed-a8b3-e391aa06b884 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:02.930426 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1179e7-a68d-4fed-a8b3-e391aa06b884 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:02.932309 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1179e7-a68d-4fed-a8b3-e391aa06b884 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:02.948348 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-2d1179e7-a68d-4fed-a8b3-e391aa06b884 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:09:02.949837 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 415/834] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:09:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:02.955780 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac55c90-7312-40ee-ac90-521d0e8efa70 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:02.971655 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac55c90-7312-40ee-ac90-521d0e8efa70 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:02.978887 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4cbc02-1ba5-46b3-bef5-20d877adf216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:02.979782 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cbc02-1ba5-46b3-bef5-20d877adf216 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:02.980259 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cbc02-1ba5-46b3-bef5-20d877adf216 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:02.980725 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cbc02-1ba5-46b3-bef5-20d877adf216 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:02.981647 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4cbc02-1ba5-46b3-bef5-20d877adf216 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:02.982158 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4cbc02-1ba5-46b3-bef5-20d877adf216 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:02.983957 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4cbc02-1ba5-46b3-bef5-20d877adf216 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:03.001263 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 420/835] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:09:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:03.007221 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1179e7-a68d-4fed-a8b3-e391aa06b884 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:03.019935 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1179e7-a68d-4fed-a8b3-e391aa06b884 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:03.027018 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443b4ee2-c678-4ddd-9002-5de6ff8cd1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:03.027806 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b4ee2-c678-4ddd-9002-5de6ff8cd1fa admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:03.028128 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b4ee2-c678-4ddd-9002-5de6ff8cd1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:03.028398 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443b4ee2-c678-4ddd-9002-5de6ff8cd1fa admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:03.040252 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443b4ee2-c678-4ddd-9002-5de6ff8cd1fa admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:03.042391 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443b4ee2-c678-4ddd-9002-5de6ff8cd1fa admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:03.062426 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-443b4ee2-c678-4ddd-9002-5de6ff8cd1fa admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 29 20:09:03.063924 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 416/836] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Nov 29 20:09:03 2021] GET /identity/v3/users/swift => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:03.069722 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4cbc02-1ba5-46b3-bef5-20d877adf216 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:03.087653 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4cbc02-1ba5-46b3-bef5-20d877adf216 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:03.094936 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57828f99-fd7d-4b84-a17c-bd3841f4a60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:03.095817 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57828f99-fd7d-4b84-a17c-bd3841f4a60d admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:03.096296 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57828f99-fd7d-4b84-a17c-bd3841f4a60d admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:03.096782 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57828f99-fd7d-4b84-a17c-bd3841f4a60d admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:03.097828 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57828f99-fd7d-4b84-a17c-bd3841f4a60d admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:03.098324 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57828f99-fd7d-4b84-a17c-bd3841f4a60d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:03.100374 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57828f99-fd7d-4b84-a17c-bd3841f4a60d admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:03.127026 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 421/837] 10.222.0.15 () {56 vars in 1156 bytes} [Mon Nov 29 20:09:03 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:03.133112 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443b4ee2-c678-4ddd-9002-5de6ff8cd1fa admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:03.151784 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443b4ee2-c678-4ddd-9002-5de6ff8cd1fa admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:03.159061 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93adfc-1b51-4175-912a-cc79df4083dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:03.159795 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93adfc-1b51-4175-912a-cc79df4083dc admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:03.160075 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93adfc-1b51-4175-912a-cc79df4083dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:03.160349 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93adfc-1b51-4175-912a-cc79df4083dc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:03.179112 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee93adfc-1b51-4175-912a-cc79df4083dc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:03.180953 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee93adfc-1b51-4175-912a-cc79df4083dc admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:03.200237 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-ee93adfc-1b51-4175-912a-cc79df4083dc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:09:03.201464 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 417/838] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:09:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:03.207712 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57828f99-fd7d-4b84-a17c-bd3841f4a60d admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:03.222871 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57828f99-fd7d-4b84-a17c-bd3841f4a60d admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:03.231498 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4809a-c8a9-48a8-a55f-84af2340ffcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:03.232169 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4809a-c8a9-48a8-a55f-84af2340ffcf admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:03.232447 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4809a-c8a9-48a8-a55f-84af2340ffcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:03.232715 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4809a-c8a9-48a8-a55f-84af2340ffcf admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:03.233452 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4809a-c8a9-48a8-a55f-84af2340ffcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:03.233750 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4809a-c8a9-48a8-a55f-84af2340ffcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:03.235425 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4809a-c8a9-48a8-a55f-84af2340ffcf admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:03.255966 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 422/839] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:09:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:03.261995 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93adfc-1b51-4175-912a-cc79df4083dc admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:03.277134 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93adfc-1b51-4175-912a-cc79df4083dc admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:03.286239 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fb8311-8782-4cd2-ae97-4abfd5196228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:03.287105 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb8311-8782-4cd2-ae97-4abfd5196228 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:03.287387 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb8311-8782-4cd2-ae97-4abfd5196228 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:03.287658 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb8311-8782-4cd2-ae97-4abfd5196228 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:03.295250 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb8311-8782-4cd2-ae97-4abfd5196228 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:03.304253 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fb8311-8782-4cd2-ae97-4abfd5196228 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:03.318727 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-13fb8311-8782-4cd2-ae97-4abfd5196228 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 29 20:09:03.320253 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 418/840] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:09:03 2021] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:03.326599 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4809a-c8a9-48a8-a55f-84af2340ffcf admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:03.340225 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4809a-c8a9-48a8-a55f-84af2340ffcf admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:03.351543 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f762ae-b53a-4c7a-aba7-93d583594913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:03.352204 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f762ae-b53a-4c7a-aba7-93d583594913 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:03.352477 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f762ae-b53a-4c7a-aba7-93d583594913 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:03.352747 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f762ae-b53a-4c7a-aba7-93d583594913 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:03.353544 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f762ae-b53a-4c7a-aba7-93d583594913 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:03.353845 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f762ae-b53a-4c7a-aba7-93d583594913 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:03.355823 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f762ae-b53a-4c7a-aba7-93d583594913 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:03.365063 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ece11-f81d-4105-93e8-13943820905c None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:03.365732 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ece11-f81d-4105-93e8-13943820905c None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:03.366315 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ece11-f81d-4105-93e8-13943820905c None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:03.368566 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 419/841] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 29 20:09:03.374301 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 423/842] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Nov 29 20:09:03 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:03.374770 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf99cb-7ddf-4ff0-9fd5-481197c27b32 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:03.375306 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf99cb-7ddf-4ff0-9fd5-481197c27b32 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:03.375758 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf99cb-7ddf-4ff0-9fd5-481197c27b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:03.380461 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f762ae-b53a-4c7a-aba7-93d583594913 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:03.394396 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f762ae-b53a-4c7a-aba7-93d583594913 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:03.398933 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-6dbf99cb-7ddf-4ff0-9fd5-481197c27b32 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:03.400499 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-6dbf99cb-7ddf-4ff0-9fd5-481197c27b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:03.403074 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4467599-13cd-4158-8e1d-d16c77c31e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:03.403968 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4467599-13cd-4158-8e1d-d16c77c31e7c admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:03.404243 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4467599-13cd-4158-8e1d-d16c77c31e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:03.404525 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4467599-13cd-4158-8e1d-d16c77c31e7c admin admin] PATH_INFO: `/v3/projects/6f4cba10fe824640b2ed37aab02346ac/users/51fc6fd9b37447bba1759a702b86ce6c/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:03.407154 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4467599-13cd-4158-8e1d-d16c77c31e7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f4cba10fe824640b2ed37aab02346ac, user_id=51fc6fd9b37447bba1759a702b86ce6c, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:03.414961 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4467599-13cd-4158-8e1d-d16c77c31e7c admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:03.419362 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 420/843] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:03 2021] POST /identity/v3/auth/tokens => generated 1117 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:09:03.430537 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 424/844] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Nov 29 20:09:03 2021] PUT /identity/v3/projects/6f4cba10fe824640b2ed37aab02346ac/users/51fc6fd9b37447bba1759a702b86ce6c/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:09:03.456973 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf99cb-7ddf-4ff0-9fd5-481197c27b32 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:03.469022 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf99cb-7ddf-4ff0-9fd5-481197c27b32 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:03.550694 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3dda55-6c72-42ed-bbde-58ab32e7be80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:03.551605 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3dda55-6c72-42ed-bbde-58ab32e7be80 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:03.551880 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3dda55-6c72-42ed-bbde-58ab32e7be80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:03.552149 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3dda55-6c72-42ed-bbde-58ab32e7be80 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:03.552831 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3dda55-6c72-42ed-bbde-58ab32e7be80 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:03.554471 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3dda55-6c72-42ed-bbde-58ab32e7be80 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:03.570646 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-9c3dda55-6c72-42ed-bbde-58ab32e7be80 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Nov 29 20:09:03.572191 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 421/845] 10.222.0.15 () {56 vars in 1150 bytes} [Mon Nov 29 20:09:03 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 116 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:03.578662 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4467599-13cd-4158-8e1d-d16c77c31e7c admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:03.596528 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4467599-13cd-4158-8e1d-d16c77c31e7c admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:03.605708 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf3df6-8ba2-42da-b4ac-615eb311a507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:03.606443 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf3df6-8ba2-42da-b4ac-615eb311a507 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:03.606722 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf3df6-8ba2-42da-b4ac-615eb311a507 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:03.607058 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf3df6-8ba2-42da-b4ac-615eb311a507 admin admin] PATH_INFO: `/v3/services` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:03.607842 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf3df6-8ba2-42da-b4ac-615eb311a507 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:03.608144 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf3df6-8ba2-42da-b4ac-615eb311a507 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:03.609940 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf3df6-8ba2-42da-b4ac-615eb311a507 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:03.615809 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 425/846] 10.222.0.15 () {56 vars in 1145 bytes} [Mon Nov 29 20:09:03 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:03.622095 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3dda55-6c72-42ed-bbde-58ab32e7be80 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:03.636384 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3dda55-6c72-42ed-bbde-58ab32e7be80 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:03.647363 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376a613-be95-4c40-9c5c-14c31b69b1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:03.648135 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376a613-be95-4c40-9c5c-14c31b69b1c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:03.648368 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376a613-be95-4c40-9c5c-14c31b69b1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:03.648642 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376a613-be95-4c40-9c5c-14c31b69b1c5 admin admin] PATH_INFO: `/v3/services` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:03.649380 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376a613-be95-4c40-9c5c-14c31b69b1c5 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:03.649682 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376a613-be95-4c40-9c5c-14c31b69b1c5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:03.651354 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376a613-be95-4c40-9c5c-14c31b69b1c5 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:03.657113 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 422/847] 10.222.0.15 () {56 vars in 1145 bytes} [Mon Nov 29 20:09:03 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:03.663592 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf3df6-8ba2-42da-b4ac-615eb311a507 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:03.676282 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf3df6-8ba2-42da-b4ac-615eb311a507 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:03.687298 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0b0fc-4348-4c56-9ace-1981baf7cffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:03.687975 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0b0fc-4348-4c56-9ace-1981baf7cffd admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:03.688253 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0b0fc-4348-4c56-9ace-1981baf7cffd admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:03.688523 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0b0fc-4348-4c56-9ace-1981baf7cffd admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:03.689288 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0b0fc-4348-4c56-9ace-1981baf7cffd admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:03.690307 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING py.warnings [None req-e8d0b0fc-4348-4c56-9ace-1981baf7cffd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 29 20:09:03.690307 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: warnings.warn(msg) Nov 29 20:09:03.690307 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: Nov 29 20:09:03.691223 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0b0fc-4348-4c56-9ace-1981baf7cffd admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:03.720369 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 426/848] 10.222.0.15 () {60 vars in 1165 bytes} [Mon Nov 29 20:09:03 2021] POST /identity/v3/endpoints => generated 346 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 29 20:09:03.859967 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadec2d-dd14-44b5-82a9-eca6a34390f8 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:03.860304 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadec2d-dd14-44b5-82a9-eca6a34390f8 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:03.860509 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadec2d-dd14-44b5-82a9-eca6a34390f8 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:03.862709 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 423/849] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:09:03.869057 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da340c7-c2f6-4be1-a379-65991dc98485 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:03.869375 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da340c7-c2f6-4be1-a379-65991dc98485 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:03.869608 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da340c7-c2f6-4be1-a379-65991dc98485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:03.900667 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-6da340c7-c2f6-4be1-a379-65991dc98485 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:03.901910 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-6da340c7-c2f6-4be1-a379-65991dc98485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:03.933991 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 427/850] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:03 2021] POST /identity/v3/auth/tokens => generated 1303 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:09:03.978120 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadec2d-dd14-44b5-82a9-eca6a34390f8 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:03.995497 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadec2d-dd14-44b5-82a9-eca6a34390f8 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:04.001027 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399eb497-e69b-4fdb-b819-72d551e60613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:04.001829 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399eb497-e69b-4fdb-b819-72d551e60613 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:04.002106 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399eb497-e69b-4fdb-b819-72d551e60613 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:04.002378 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399eb497-e69b-4fdb-b819-72d551e60613 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:04.003113 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399eb497-e69b-4fdb-b819-72d551e60613 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:04.004686 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399eb497-e69b-4fdb-b819-72d551e60613 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:04.018792 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-399eb497-e69b-4fdb-b819-72d551e60613 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Nov 29 20:09:04.020386 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 424/851] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:09:03 2021] GET /identity/v3/services/network => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:04.026721 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da340c7-c2f6-4be1-a379-65991dc98485 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:04.038069 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da340c7-c2f6-4be1-a379-65991dc98485 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:04.042677 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01669cad-1c13-4be5-ba50-f8be5166b81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:04.043394 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01669cad-1c13-4be5-ba50-f8be5166b81c admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:04.043683 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01669cad-1c13-4be5-ba50-f8be5166b81c admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:04.043962 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01669cad-1c13-4be5-ba50-f8be5166b81c admin admin] PATH_INFO: `/v3/services` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:04.044688 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01669cad-1c13-4be5-ba50-f8be5166b81c admin admin] RBAC: Adding query filter params (name=network) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:04.044995 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01669cad-1c13-4be5-ba50-f8be5166b81c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:04.046651 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01669cad-1c13-4be5-ba50-f8be5166b81c admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:04.058272 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 428/852] 10.222.0.15 () {56 vars in 1133 bytes} [Mon Nov 29 20:09:04 2021] GET /identity/v3/services?name=network => generated 124 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:04.059659 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399eb497-e69b-4fdb-b819-72d551e60613 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:04.069965 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399eb497-e69b-4fdb-b819-72d551e60613 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:04.078707 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b105e94-e325-4bb8-8587-50694880c43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:04.079409 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b105e94-e325-4bb8-8587-50694880c43b admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:04.079733 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b105e94-e325-4bb8-8587-50694880c43b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:04.080010 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b105e94-e325-4bb8-8587-50694880c43b admin admin] PATH_INFO: `/v3/services` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:04.080801 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b105e94-e325-4bb8-8587-50694880c43b admin admin] RBAC: Adding query filter params (type=network) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:04.081106 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b105e94-e325-4bb8-8587-50694880c43b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:04.082762 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b105e94-e325-4bb8-8587-50694880c43b admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:04.089797 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 425/853] 10.222.0.15 () {56 vars in 1133 bytes} [Mon Nov 29 20:09:04 2021] GET /identity/v3/services?type=network => generated 350 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:04.095994 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01669cad-1c13-4be5-ba50-f8be5166b81c admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:04.108237 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01669cad-1c13-4be5-ba50-f8be5166b81c admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:04.116494 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81cb972-4dbc-4991-a889-48b13eac8e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:04.117211 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cb972-4dbc-4991-a889-48b13eac8e1d admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:04.117555 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cb972-4dbc-4991-a889-48b13eac8e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:04.117837 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81cb972-4dbc-4991-a889-48b13eac8e1d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:04.118667 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81cb972-4dbc-4991-a889-48b13eac8e1d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:04.120366 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81cb972-4dbc-4991-a889-48b13eac8e1d admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:04.145456 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 429/854] 10.222.0.15 () {60 vars in 1165 bytes} [Mon Nov 29 20:09:04 2021] POST /identity/v3/endpoints => generated 327 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:09:05.053405 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a360a5-78ea-443a-99c2-a490ef671b6a None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:05.054105 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a360a5-78ea-443a-99c2-a490ef671b6a None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:05.054105 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a360a5-78ea-443a-99c2-a490ef671b6a None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:05.056009 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 426/855] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:09:05.062022 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d61cbd-6410-4ce2-a424-9cdc7746faec None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:05.062652 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d61cbd-6410-4ce2-a424-9cdc7746faec None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:05.062652 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d61cbd-6410-4ce2-a424-9cdc7746faec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:05.080453 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-b3d61cbd-6410-4ce2-a424-9cdc7746faec None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:05.081564 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-b3d61cbd-6410-4ce2-a424-9cdc7746faec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:05.098513 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 430/856] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:05 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:09:05.122351 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a360a5-78ea-443a-99c2-a490ef671b6a None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:05.134980 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a360a5-78ea-443a-99c2-a490ef671b6a None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:05.139494 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284065e3-7483-4764-8e43-43691d436f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:05.140279 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284065e3-7483-4764-8e43-43691d436f4f admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:05.140586 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284065e3-7483-4764-8e43-43691d436f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:05.140859 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284065e3-7483-4764-8e43-43691d436f4f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:05.151989 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284065e3-7483-4764-8e43-43691d436f4f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:09:05.158758 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-284065e3-7483-4764-8e43-43691d436f4f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 29 20:09:05.160277 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 427/857] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Nov 29 20:09:05 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:05.166482 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d61cbd-6410-4ce2-a424-9cdc7746faec None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:05.175627 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d61cbd-6410-4ce2-a424-9cdc7746faec None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:05.180143 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c6c61-5585-4aa9-a52b-96618e8d5680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:05.180804 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c6c61-5585-4aa9-a52b-96618e8d5680 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:05.181140 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c6c61-5585-4aa9-a52b-96618e8d5680 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:05.181409 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c6c61-5585-4aa9-a52b-96618e8d5680 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:05.182217 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c6c61-5585-4aa9-a52b-96618e8d5680 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:05.182520 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c6c61-5585-4aa9-a52b-96618e8d5680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:05.184126 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c6c61-5585-4aa9-a52b-96618e8d5680 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:05.192823 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 431/858] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Nov 29 20:09:05 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:05.198668 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284065e3-7483-4764-8e43-43691d436f4f admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:05.208698 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284065e3-7483-4764-8e43-43691d436f4f admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:05.212776 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8b5fc-acb0-40e2-9705-5ee2a4b0e8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:05.213556 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8b5fc-acb0-40e2-9705-5ee2a4b0e8d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:05.213832 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8b5fc-acb0-40e2-9705-5ee2a4b0e8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:05.214102 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8b5fc-acb0-40e2-9705-5ee2a4b0e8d4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:05.225134 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c8b5fc-acb0-40e2-9705-5ee2a4b0e8d4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:05.227054 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c8b5fc-acb0-40e2-9705-5ee2a4b0e8d4 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:05.239194 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79c7ac-e1e5-4fc0-ad2e-2dae5e6123d6 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:05.239194 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79c7ac-e1e5-4fc0-ad2e-2dae5e6123d6 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:05.239194 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79c7ac-e1e5-4fc0-ad2e-2dae5e6123d6 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:05.239194 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 432/859] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 29 20:09:05.243682 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-f1c8b5fc-acb0-40e2-9705-5ee2a4b0e8d4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:09:05.247456 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 428/860] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:09:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:05.247646 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74965bc0-df8a-4428-99aa-4cd879af716e None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:05.247646 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74965bc0-df8a-4428-99aa-4cd879af716e None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:05.247646 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74965bc0-df8a-4428-99aa-4cd879af716e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:05.250939 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8b5fc-acb0-40e2-9705-5ee2a4b0e8d4 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:05.262036 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c8b5fc-acb0-40e2-9705-5ee2a4b0e8d4 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:05.266334 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-74965bc0-df8a-4428-99aa-4cd879af716e None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:05.266779 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c99f5b-777f-4705-a934-4b24d1ce03c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:05.267447 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c99f5b-777f-4705-a934-4b24d1ce03c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:05.267722 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c99f5b-777f-4705-a934-4b24d1ce03c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:05.267988 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c99f5b-777f-4705-a934-4b24d1ce03c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:05.268614 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-74965bc0-df8a-4428-99aa-4cd879af716e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:05.268720 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c99f5b-777f-4705-a934-4b24d1ce03c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:05.268993 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c99f5b-777f-4705-a934-4b24d1ce03c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:05.270567 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c99f5b-777f-4705-a934-4b24d1ce03c8 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:05.277749 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 433/861] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:05 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:09:05.283058 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 429/862] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:09:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:05.288813 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74965bc0-df8a-4428-99aa-4cd879af716e None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:05.298681 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74965bc0-df8a-4428-99aa-4cd879af716e None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:05.303923 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e94fec-647a-47c2-934e-af7b03471dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:05.305079 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e94fec-647a-47c2-934e-af7b03471dbc admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:05.305577 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e94fec-647a-47c2-934e-af7b03471dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:05.306083 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e94fec-647a-47c2-934e-af7b03471dbc admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:05.306206 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c99f5b-777f-4705-a934-4b24d1ce03c8 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:05.314392 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e94fec-647a-47c2-934e-af7b03471dbc admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:05.316752 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e94fec-647a-47c2-934e-af7b03471dbc admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:05.316859 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c99f5b-777f-4705-a934-4b24d1ce03c8 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:05.322046 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a5fcf-74d9-467a-8279-bf310ff6e45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:05.322842 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a5fcf-74d9-467a-8279-bf310ff6e45e admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:05.323145 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a5fcf-74d9-467a-8279-bf310ff6e45e admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:05.323412 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a5fcf-74d9-467a-8279-bf310ff6e45e admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:05.324069 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a5fcf-74d9-467a-8279-bf310ff6e45e admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:05.325981 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a5fcf-74d9-467a-8279-bf310ff6e45e admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:05.333839 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-75e94fec-647a-47c2-934e-af7b03471dbc admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 29 20:09:05.335576 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 434/863] 10.222.0.15 () {56 vars in 1138 bytes} [Mon Nov 29 20:09:05 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:09:05.337188 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-826a5fcf-74d9-467a-8279-bf310ff6e45e admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 29 20:09:05.338417 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 430/864] 10.222.0.15 () {56 vars in 1153 bytes} [Mon Nov 29 20:09:05 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:05.344401 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e94fec-647a-47c2-934e-af7b03471dbc admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:05.345268 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a5fcf-74d9-467a-8279-bf310ff6e45e admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:05.358351 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a5fcf-74d9-467a-8279-bf310ff6e45e admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:05.359168 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e94fec-647a-47c2-934e-af7b03471dbc admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:05.363634 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e1a35-3ae4-4666-a2c2-1f11290e39ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:05.364286 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e1a35-3ae4-4666-a2c2-1f11290e39ef admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:05.364559 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e1a35-3ae4-4666-a2c2-1f11290e39ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:05.364823 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9e1a35-3ae4-4666-a2c2-1f11290e39ef admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:05.365227 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d54ce-c1b5-437b-8f42-f0aea74675b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:05.365652 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9e1a35-3ae4-4666-a2c2-1f11290e39ef admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:05.365956 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9e1a35-3ae4-4666-a2c2-1f11290e39ef admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:05.366553 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d54ce-c1b5-437b-8f42-f0aea74675b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:05.367062 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d54ce-c1b5-437b-8f42-f0aea74675b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:05.367574 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d54ce-c1b5-437b-8f42-f0aea74675b9 admin admin] PATH_INFO: `/v3/services` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:05.367814 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9e1a35-3ae4-4666-a2c2-1f11290e39ef admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:05.368760 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d54ce-c1b5-437b-8f42-f0aea74675b9 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:05.369279 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d54ce-c1b5-437b-8f42-f0aea74675b9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:05.371133 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d54ce-c1b5-437b-8f42-f0aea74675b9 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:05.382489 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 431/865] 10.222.0.15 () {56 vars in 1147 bytes} [Mon Nov 29 20:09:05 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:05.383828 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d54ce-c1b5-437b-8f42-f0aea74675b9 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:05.385429 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 435/866] 10.222.0.15 () {56 vars in 1170 bytes} [Mon Nov 29 20:09:05 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:09:05.391514 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e1a35-3ae4-4666-a2c2-1f11290e39ef admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:05.396192 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d54ce-c1b5-437b-8f42-f0aea74675b9 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:05.400831 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9f916-b430-43b3-afea-4ca88c8fb06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:05.400954 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9e1a35-3ae4-4666-a2c2-1f11290e39ef admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:05.401993 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9f916-b430-43b3-afea-4ca88c8fb06d admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:05.402558 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9f916-b430-43b3-afea-4ca88c8fb06d admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:05.403114 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9f916-b430-43b3-afea-4ca88c8fb06d admin admin] PATH_INFO: `/v3/services` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:05.404293 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e9f916-b430-43b3-afea-4ca88c8fb06d admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:05.404877 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e9f916-b430-43b3-afea-4ca88c8fb06d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:05.405618 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a60fd-9a27-40d7-b929-22ee7aec3b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:05.406312 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a60fd-9a27-40d7-b929-22ee7aec3b28 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:05.406587 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a60fd-9a27-40d7-b929-22ee7aec3b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:05.406969 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a60fd-9a27-40d7-b929-22ee7aec3b28 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:05.407755 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e9f916-b430-43b3-afea-4ca88c8fb06d admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:05.418907 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 432/867] 10.222.0.15 () {56 vars in 1147 bytes} [Mon Nov 29 20:09:05 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:05.419096 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a60fd-9a27-40d7-b929-22ee7aec3b28 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:05.419096 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36a60fd-9a27-40d7-b929-22ee7aec3b28 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:05.427627 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 436/868] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:09:05 2021] GET /identity/v3/auth/tokens => generated 1452 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:09:05.433996 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9f916-b430-43b3-afea-4ca88c8fb06d admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:05.444261 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9f916-b430-43b3-afea-4ca88c8fb06d admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:05.449007 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1985604-4e63-4b4f-bb64-86017f221f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:05.449859 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1985604-4e63-4b4f-bb64-86017f221f0a admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:05.450134 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1985604-4e63-4b4f-bb64-86017f221f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:05.450399 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1985604-4e63-4b4f-bb64-86017f221f0a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:05.462375 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1985604-4e63-4b4f-bb64-86017f221f0a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:05.464322 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1985604-4e63-4b4f-bb64-86017f221f0a admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:05.481500 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-a1985604-4e63-4b4f-bb64-86017f221f0a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:09:05.488528 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 433/869] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:09:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:05.490993 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a60fd-9a27-40d7-b929-22ee7aec3b28 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:05.500330 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36a60fd-9a27-40d7-b929-22ee7aec3b28 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:05.505061 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac30cbc-ac9e-482c-9330-76d897cffa9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:05.505729 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac30cbc-ac9e-482c-9330-76d897cffa9c admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:05.506003 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac30cbc-ac9e-482c-9330-76d897cffa9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:05.506269 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac30cbc-ac9e-482c-9330-76d897cffa9c admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:05.507033 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac30cbc-ac9e-482c-9330-76d897cffa9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:05.507330 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac30cbc-ac9e-482c-9330-76d897cffa9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:05.509039 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac30cbc-ac9e-482c-9330-76d897cffa9c admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:05.524160 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 437/870] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:09:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:05.530644 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1985604-4e63-4b4f-bb64-86017f221f0a admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:05.540689 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1985604-4e63-4b4f-bb64-86017f221f0a admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:05.545333 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102d505-13ca-4905-8090-f137f04c11a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:05.546170 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102d505-13ca-4905-8090-f137f04c11a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:05.546448 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102d505-13ca-4905-8090-f137f04c11a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:05.546771 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102d505-13ca-4905-8090-f137f04c11a2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:05.554486 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0102d505-13ca-4905-8090-f137f04c11a2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:05.556488 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0102d505-13ca-4905-8090-f137f04c11a2 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:05.571221 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-0102d505-13ca-4905-8090-f137f04c11a2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 29 20:09:05.572806 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 434/871] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:09:05 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:05.579144 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac30cbc-ac9e-482c-9330-76d897cffa9c admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:05.589479 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac30cbc-ac9e-482c-9330-76d897cffa9c admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:05.594964 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ac253-3cd0-4b4b-8fa2-f58da6629677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:05.595648 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ac253-3cd0-4b4b-8fa2-f58da6629677 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:05.595969 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ac253-3cd0-4b4b-8fa2-f58da6629677 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:05.596239 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ac253-3cd0-4b4b-8fa2-f58da6629677 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:05.597100 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ac253-3cd0-4b4b-8fa2-f58da6629677 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:05.597405 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ac253-3cd0-4b4b-8fa2-f58da6629677 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:05.599401 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ac253-3cd0-4b4b-8fa2-f58da6629677 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:05.613369 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 438/872] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Nov 29 20:09:05 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:05.619770 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102d505-13ca-4905-8090-f137f04c11a2 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:05.630058 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102d505-13ca-4905-8090-f137f04c11a2 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:05.634793 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898ab45-f41e-47cc-bc4e-42c0f0ccd2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:05.635527 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898ab45-f41e-47cc-bc4e-42c0f0ccd2af admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:05.635803 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898ab45-f41e-47cc-bc4e-42c0f0ccd2af admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:05.636073 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898ab45-f41e-47cc-bc4e-42c0f0ccd2af admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:05.636974 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898ab45-f41e-47cc-bc4e-42c0f0ccd2af admin admin] RBAC: Adding query filter params (role.id=4851b1a48d8a4188b335219acbede502, scope.project.id=6f4cba10fe824640b2ed37aab02346ac, user.id=19d72c913c2b4442836a991120eec243) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:05.637279 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898ab45-f41e-47cc-bc4e-42c0f0ccd2af admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:05.639575 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898ab45-f41e-47cc-bc4e-42c0f0ccd2af admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:05.646690 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 435/873] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:09:05 2021] GET /identity/v3/role_assignments?user.id=19d72c913c2b4442836a991120eec243&scope.project.id=6f4cba10fe824640b2ed37aab02346ac&role.id=4851b1a48d8a4188b335219acbede502 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:06.236367 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acf97c-8bf7-4ec4-b530-eea9caf94534 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:06.237075 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acf97c-8bf7-4ec4-b530-eea9caf94534 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:06.237075 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acf97c-8bf7-4ec4-b530-eea9caf94534 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:06.239022 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 439/874] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:09:06.245022 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a8e3e-dae3-43a1-a860-0dd89884f682 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:06.245514 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a8e3e-dae3-43a1-a860-0dd89884f682 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:06.245665 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a8e3e-dae3-43a1-a860-0dd89884f682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:06.263451 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-d72a8e3e-dae3-43a1-a860-0dd89884f682 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:06.264957 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-d72a8e3e-dae3-43a1-a860-0dd89884f682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:06.274946 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 436/875] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:06 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:09:06.297856 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80acf97c-8bf7-4ec4-b530-eea9caf94534 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:06.310086 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80acf97c-8bf7-4ec4-b530-eea9caf94534 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:06.314561 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43416fed-65ea-4964-b5c0-8fba8a39a960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:06.315379 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43416fed-65ea-4964-b5c0-8fba8a39a960 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:06.315661 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43416fed-65ea-4964-b5c0-8fba8a39a960 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:06.315929 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43416fed-65ea-4964-b5c0-8fba8a39a960 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:06.326264 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43416fed-65ea-4964-b5c0-8fba8a39a960 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:09:06.333185 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-43416fed-65ea-4964-b5c0-8fba8a39a960 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 29 20:09:06.338953 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 440/876] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Nov 29 20:09:06 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:06.341144 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a8e3e-dae3-43a1-a860-0dd89884f682 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:06.350137 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a8e3e-dae3-43a1-a860-0dd89884f682 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:06.354596 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a4c016-f52f-4ba0-af7f-43667ca0459b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:06.355289 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4c016-f52f-4ba0-af7f-43667ca0459b admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:06.355571 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4c016-f52f-4ba0-af7f-43667ca0459b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:06.355848 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a4c016-f52f-4ba0-af7f-43667ca0459b admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:06.356612 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a4c016-f52f-4ba0-af7f-43667ca0459b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:06.356917 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a4c016-f52f-4ba0-af7f-43667ca0459b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:06.358527 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a4c016-f52f-4ba0-af7f-43667ca0459b admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:06.366701 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b751e-33de-4a6e-8056-a1a5e62019df None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:06.367025 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b751e-33de-4a6e-8056-a1a5e62019df None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:06.367297 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b751e-33de-4a6e-8056-a1a5e62019df None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:06.369281 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 441/878] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 29 20:09:06.370334 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 437/878] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:09:06 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:06.373529 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b751e-33de-4a6e-8056-a1a5e62019df None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:06.376648 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42c95e-cdd0-437a-84c5-8679e441a625 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:06.376932 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42c95e-cdd0-437a-84c5-8679e441a625 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:06.377208 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42c95e-cdd0-437a-84c5-8679e441a625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:06.387838 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b751e-33de-4a6e-8056-a1a5e62019df None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:06.393608 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d11af9-16f5-4fb0-916f-278cf2a07d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:06.394663 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d11af9-16f5-4fb0-916f-278cf2a07d0a admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:06.394791 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-5c42c95e-cdd0-437a-84c5-8679e441a625 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:06.395295 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d11af9-16f5-4fb0-916f-278cf2a07d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:06.395743 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d11af9-16f5-4fb0-916f-278cf2a07d0a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:06.395969 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-5c42c95e-cdd0-437a-84c5-8679e441a625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:06.403779 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 438/879] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:06 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:09:06.408046 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d11af9-16f5-4fb0-916f-278cf2a07d0a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:06.410066 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d11af9-16f5-4fb0-916f-278cf2a07d0a admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:06.426445 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-c9d11af9-16f5-4fb0-916f-278cf2a07d0a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:09:06.426675 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42c95e-cdd0-437a-84c5-8679e441a625 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:06.433227 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 442/880] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:09:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:06.435042 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d11af9-16f5-4fb0-916f-278cf2a07d0a admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:06.438812 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42c95e-cdd0-437a-84c5-8679e441a625 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:06.443624 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b05e3b-2ba9-414e-bb99-735dd171068f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:06.444657 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b05e3b-2ba9-414e-bb99-735dd171068f admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:06.445103 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d11af9-16f5-4fb0-916f-278cf2a07d0a admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:06.445383 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b05e3b-2ba9-414e-bb99-735dd171068f admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:06.445849 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b05e3b-2ba9-414e-bb99-735dd171068f admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:06.446720 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b05e3b-2ba9-414e-bb99-735dd171068f admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:06.448543 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b05e3b-2ba9-414e-bb99-735dd171068f admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:06.449786 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482a3fc-893c-4f11-ad8e-bb1a22936401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:06.450484 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482a3fc-893c-4f11-ad8e-bb1a22936401 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:06.450807 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482a3fc-893c-4f11-ad8e-bb1a22936401 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:06.451126 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482a3fc-893c-4f11-ad8e-bb1a22936401 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:06.451911 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1482a3fc-893c-4f11-ad8e-bb1a22936401 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:06.452212 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1482a3fc-893c-4f11-ad8e-bb1a22936401 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:06.453906 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1482a3fc-893c-4f11-ad8e-bb1a22936401 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:06.461656 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-78b05e3b-2ba9-414e-bb99-735dd171068f admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 29 20:09:06.466881 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 439/881] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Nov 29 20:09:06 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:09:06.469884 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b05e3b-2ba9-414e-bb99-735dd171068f admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:06.471848 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 443/882] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:09:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:06.473051 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482a3fc-893c-4f11-ad8e-bb1a22936401 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:06.480869 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b05e3b-2ba9-414e-bb99-735dd171068f admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:06.483706 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482a3fc-893c-4f11-ad8e-bb1a22936401 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:06.486293 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089e3fc-3d6f-4e53-90c8-ff98199d0fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:06.487460 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089e3fc-3d6f-4e53-90c8-ff98199d0fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:06.487953 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089e3fc-3d6f-4e53-90c8-ff98199d0fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:06.488415 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e1b90-4b1a-4ed0-accc-a680e0f63b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:06.488668 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089e3fc-3d6f-4e53-90c8-ff98199d0fd7 admin admin] PATH_INFO: `/v3/services` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:06.489222 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e1b90-4b1a-4ed0-accc-a680e0f63b54 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:06.489489 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e1b90-4b1a-4ed0-accc-a680e0f63b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:06.489763 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e1b90-4b1a-4ed0-accc-a680e0f63b54 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:06.490236 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d089e3fc-3d6f-4e53-90c8-ff98199d0fd7 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:06.490770 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d089e3fc-3d6f-4e53-90c8-ff98199d0fd7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:06.492650 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d089e3fc-3d6f-4e53-90c8-ff98199d0fd7 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:06.502869 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e1b90-4b1a-4ed0-accc-a680e0f63b54 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:06.502869 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e1b90-4b1a-4ed0-accc-a680e0f63b54 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:06.503256 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 440/883] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Nov 29 20:09:06 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:09:06.504263 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089e3fc-3d6f-4e53-90c8-ff98199d0fd7 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:06.514635 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089e3fc-3d6f-4e53-90c8-ff98199d0fd7 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:06.516897 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-f52e1b90-4b1a-4ed0-accc-a680e0f63b54 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Nov 29 20:09:06.522928 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 444/884] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Nov 29 20:09:06 2021] GET /identity/v3/users/swift => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:09:06.524819 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ffc54-4bb0-48dc-9670-0d7564288a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:06.525223 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e1b90-4b1a-4ed0-accc-a680e0f63b54 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:06.526116 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ffc54-4bb0-48dc-9670-0d7564288a93 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:06.526567 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ffc54-4bb0-48dc-9670-0d7564288a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:06.527124 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ffc54-4bb0-48dc-9670-0d7564288a93 admin admin] PATH_INFO: `/v3/services` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:06.528026 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ffc54-4bb0-48dc-9670-0d7564288a93 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:06.528528 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ffc54-4bb0-48dc-9670-0d7564288a93 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:06.530330 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46ffc54-4bb0-48dc-9670-0d7564288a93 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:06.535543 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 441/885] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Nov 29 20:09:06 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:06.539764 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e1b90-4b1a-4ed0-accc-a680e0f63b54 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:06.545137 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdca797-a679-4c0c-9f8b-6459bcc89391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:06.546249 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdca797-a679-4c0c-9f8b-6459bcc89391 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:06.546780 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdca797-a679-4c0c-9f8b-6459bcc89391 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:06.547350 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdca797-a679-4c0c-9f8b-6459bcc89391 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:06.548515 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdca797-a679-4c0c-9f8b-6459bcc89391 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:06.549034 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdca797-a679-4c0c-9f8b-6459bcc89391 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:06.551325 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdca797-a679-4c0c-9f8b-6459bcc89391 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:06.573786 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 445/886] 10.222.0.15 () {56 vars in 1156 bytes} [Mon Nov 29 20:09:06 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:09:06.579789 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ffc54-4bb0-48dc-9670-0d7564288a93 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:06.590113 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ffc54-4bb0-48dc-9670-0d7564288a93 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:06.595286 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5eb32-7f5f-4104-aa8e-34f52da560fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:06.596332 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5eb32-7f5f-4104-aa8e-34f52da560fe admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:06.596811 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5eb32-7f5f-4104-aa8e-34f52da560fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:06.597283 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5eb32-7f5f-4104-aa8e-34f52da560fe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:06.606923 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5eb32-7f5f-4104-aa8e-34f52da560fe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:06.609278 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5eb32-7f5f-4104-aa8e-34f52da560fe admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:06.620384 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 442/887] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:09:06 2021] GET /identity/v3/auth/tokens => generated 1452 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:09:06.629826 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdca797-a679-4c0c-9f8b-6459bcc89391 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:06.645157 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdca797-a679-4c0c-9f8b-6459bcc89391 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:06.652211 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde0827-52ad-46c6-bb12-cbd1a225711f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:06.653476 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde0827-52ad-46c6-bb12-cbd1a225711f admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:06.653880 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde0827-52ad-46c6-bb12-cbd1a225711f admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:06.654158 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde0827-52ad-46c6-bb12-cbd1a225711f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:06.668187 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde0827-52ad-46c6-bb12-cbd1a225711f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:06.670723 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde0827-52ad-46c6-bb12-cbd1a225711f admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:06.694354 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-2bde0827-52ad-46c6-bb12-cbd1a225711f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:09:06.696224 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 446/888] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:09:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:06.705091 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5eb32-7f5f-4104-aa8e-34f52da560fe admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:06.714796 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5eb32-7f5f-4104-aa8e-34f52da560fe admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:06.719717 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce99156-12c7-4219-b1eb-93888e3a7ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:06.720401 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce99156-12c7-4219-b1eb-93888e3a7ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:06.720683 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce99156-12c7-4219-b1eb-93888e3a7ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:06.720957 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce99156-12c7-4219-b1eb-93888e3a7ff8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:06.721716 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce99156-12c7-4219-b1eb-93888e3a7ff8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:06.722023 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce99156-12c7-4219-b1eb-93888e3a7ff8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:06.723678 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce99156-12c7-4219-b1eb-93888e3a7ff8 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:06.742212 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 443/889] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:09:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:06.743656 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde0827-52ad-46c6-bb12-cbd1a225711f admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:06.754060 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde0827-52ad-46c6-bb12-cbd1a225711f admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:06.758799 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e9baa-d541-47a2-841c-2df76999493c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:06.759707 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e9baa-d541-47a2-841c-2df76999493c admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:06.759989 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e9baa-d541-47a2-841c-2df76999493c admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:06.760265 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e9baa-d541-47a2-841c-2df76999493c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:06.768672 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e9baa-d541-47a2-841c-2df76999493c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:06.770961 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5e9baa-d541-47a2-841c-2df76999493c admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:06.784366 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-bf5e9baa-d541-47a2-841c-2df76999493c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 29 20:09:06.786172 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 447/890] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:09:06 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:06.793235 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce99156-12c7-4219-b1eb-93888e3a7ff8 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:06.804341 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce99156-12c7-4219-b1eb-93888e3a7ff8 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:06.816528 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8fbc4b-fa5f-45bf-bcda-a276202d2cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:06.817564 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fbc4b-fa5f-45bf-bcda-a276202d2cfe admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:06.818045 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fbc4b-fa5f-45bf-bcda-a276202d2cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:06.818510 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fbc4b-fa5f-45bf-bcda-a276202d2cfe admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:06.819591 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8fbc4b-fa5f-45bf-bcda-a276202d2cfe admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:06.820095 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8fbc4b-fa5f-45bf-bcda-a276202d2cfe admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:06.822146 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8fbc4b-fa5f-45bf-bcda-a276202d2cfe admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:06.840771 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 444/891] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Nov 29 20:09:06 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:06.847516 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e9baa-d541-47a2-841c-2df76999493c admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:06.858274 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e9baa-d541-47a2-841c-2df76999493c admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:06.863142 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf38cc-aa15-460c-bd76-6dbb70930fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:06.863998 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf38cc-aa15-460c-bd76-6dbb70930fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:06.864473 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf38cc-aa15-460c-bd76-6dbb70930fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:06.864960 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf38cc-aa15-460c-bd76-6dbb70930fe3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:06.865983 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf38cc-aa15-460c-bd76-6dbb70930fe3 admin admin] RBAC: Adding query filter params (role.id=33d95c7861b64f1a95af8a333bd626ea, scope.project.id=6f4cba10fe824640b2ed37aab02346ac, user.id=51fc6fd9b37447bba1759a702b86ce6c) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:06.866495 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf38cc-aa15-460c-bd76-6dbb70930fe3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:06.868560 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf38cc-aa15-460c-bd76-6dbb70930fe3 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:06.875223 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 448/892] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:09:06 2021] GET /identity/v3/role_assignments?user.id=51fc6fd9b37447bba1759a702b86ce6c&scope.project.id=6f4cba10fe824640b2ed37aab02346ac&role.id=33d95c7861b64f1a95af8a333bd626ea => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:07.816004 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5200c-b2bf-4b3b-a6bf-e242c81f1659 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:07.816966 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5200c-b2bf-4b3b-a6bf-e242c81f1659 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:07.817431 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5200c-b2bf-4b3b-a6bf-e242c81f1659 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:07.819706 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 445/893] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:07 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:09:07.827337 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b3681-8bf8-46c6-ab00-78079be5bb4a None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:07.827337 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b3681-8bf8-46c6-ab00-78079be5bb4a None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:07.827337 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b3681-8bf8-46c6-ab00-78079be5bb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:07.845025 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-8d5b3681-8bf8-46c6-ab00-78079be5bb4a None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:07.846259 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-8d5b3681-8bf8-46c6-ab00-78079be5bb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:07.854198 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 449/894] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:07 2021] POST /identity/v3/auth/tokens => generated 1452 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:09:07.877362 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5200c-b2bf-4b3b-a6bf-e242c81f1659 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:07.889709 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5200c-b2bf-4b3b-a6bf-e242c81f1659 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:07.893969 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1487b59-472c-4a41-aab6-13d742e8272a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:07.894610 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1487b59-472c-4a41-aab6-13d742e8272a admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:07.894909 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1487b59-472c-4a41-aab6-13d742e8272a admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:07.895183 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1487b59-472c-4a41-aab6-13d742e8272a admin admin] PATH_INFO: `/v3/services` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:07.895920 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1487b59-472c-4a41-aab6-13d742e8272a admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:07.897507 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1487b59-472c-4a41-aab6-13d742e8272a admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:07.912926 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 446/895] 10.222.0.15 () {60 vars in 1162 bytes} [Mon Nov 29 20:09:07 2021] POST /identity/v3/services => generated 269 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:09:08.112647 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9bcf22-031c-45b5-819a-5c3427638c18 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:08.112841 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9bcf22-031c-45b5-819a-5c3427638c18 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:08.113151 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9bcf22-031c-45b5-819a-5c3427638c18 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:08.115402 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 450/896] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:08 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:09:08.121815 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e2481-ac28-465e-b2f0-12642af98afa None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:08.122097 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e2481-ac28-465e-b2f0-12642af98afa None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:08.122380 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e2481-ac28-465e-b2f0-12642af98afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:08.140636 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-5e6e2481-ac28-465e-b2f0-12642af98afa None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:08.141846 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-5e6e2481-ac28-465e-b2f0-12642af98afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:08.157953 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 447/897] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:08 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:09:08.182452 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9bcf22-031c-45b5-819a-5c3427638c18 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:08.194954 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9bcf22-031c-45b5-819a-5c3427638c18 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:08.199310 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ca000-0a3c-43a8-a214-7af3081de982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:08.200114 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ca000-0a3c-43a8-a214-7af3081de982 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:08.200394 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ca000-0a3c-43a8-a214-7af3081de982 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:08.200665 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ca000-0a3c-43a8-a214-7af3081de982 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:08.211031 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ca000-0a3c-43a8-a214-7af3081de982 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:09:08.218308 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-f78ca000-0a3c-43a8-a214-7af3081de982 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 29 20:09:08.219897 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 451/898] 10.222.0.15 () {56 vars in 1141 bytes} [Mon Nov 29 20:09:08 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:08.226193 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e2481-ac28-465e-b2f0-12642af98afa None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:08.235356 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e2481-ac28-465e-b2f0-12642af98afa None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:08.239953 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4e023-bfd1-4674-9ea9-bfd1cd507a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:08.240619 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4e023-bfd1-4674-9ea9-bfd1cd507a8f admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:08.240900 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4e023-bfd1-4674-9ea9-bfd1cd507a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:08.241170 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4e023-bfd1-4674-9ea9-bfd1cd507a8f admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:08.241935 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4e023-bfd1-4674-9ea9-bfd1cd507a8f admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:08.242240 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4e023-bfd1-4674-9ea9-bfd1cd507a8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:08.243893 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4e023-bfd1-4674-9ea9-bfd1cd507a8f admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:08.252382 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 448/899] 10.222.0.15 () {56 vars in 1136 bytes} [Mon Nov 29 20:09:08 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:08.258265 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ca000-0a3c-43a8-a214-7af3081de982 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:08.268358 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ca000-0a3c-43a8-a214-7af3081de982 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:08.272870 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7d1e4-777f-4fba-a2ef-b07a0f7840cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:08.273664 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7d1e4-777f-4fba-a2ef-b07a0f7840cf admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:08.273945 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7d1e4-777f-4fba-a2ef-b07a0f7840cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:08.274218 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7d1e4-777f-4fba-a2ef-b07a0f7840cf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:08.285226 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7d1e4-777f-4fba-a2ef-b07a0f7840cf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:08.287106 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7d1e4-777f-4fba-a2ef-b07a0f7840cf admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:08.304035 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-eba7d1e4-777f-4fba-a2ef-b07a0f7840cf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:09:08.311465 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4e023-bfd1-4674-9ea9-bfd1cd507a8f admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:08.311920 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 452/900] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:09:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:08.321277 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4e023-bfd1-4674-9ea9-bfd1cd507a8f admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:08.325793 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd289c-e409-40cf-b362-26a61db62a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:08.326443 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd289c-e409-40cf-b362-26a61db62a61 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:08.326724 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd289c-e409-40cf-b362-26a61db62a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:08.327024 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd289c-e409-40cf-b362-26a61db62a61 admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:08.327768 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd289c-e409-40cf-b362-26a61db62a61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:08.328104 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd289c-e409-40cf-b362-26a61db62a61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:08.329703 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd289c-e409-40cf-b362-26a61db62a61 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:08.342203 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 449/901] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:09:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:08.348503 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7d1e4-777f-4fba-a2ef-b07a0f7840cf admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:08.358542 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7d1e4-777f-4fba-a2ef-b07a0f7840cf admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:08.363447 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e57ae3-f384-488b-9ee4-2bcfa7526f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:08.364308 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e57ae3-f384-488b-9ee4-2bcfa7526f0a admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:08.364593 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e57ae3-f384-488b-9ee4-2bcfa7526f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:08.364867 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e57ae3-f384-488b-9ee4-2bcfa7526f0a admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:08.373201 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e57ae3-f384-488b-9ee4-2bcfa7526f0a admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:08.375658 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e57ae3-f384-488b-9ee4-2bcfa7526f0a admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:08.390934 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-d5e57ae3-f384-488b-9ee4-2bcfa7526f0a admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 29 20:09:08.392644 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 453/902] 10.222.0.15 () {56 vars in 1138 bytes} [Mon Nov 29 20:09:08 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:08.401586 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd289c-e409-40cf-b362-26a61db62a61 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:08.411778 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd289c-e409-40cf-b362-26a61db62a61 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:08.416338 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8a50d-2f74-42a2-b48d-d536ca2b0ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:08.417045 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8a50d-2f74-42a2-b48d-d536ca2b0ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:08.417374 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8a50d-2f74-42a2-b48d-d536ca2b0ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:08.417650 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8a50d-2f74-42a2-b48d-d536ca2b0ff9 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:08.418556 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe8a50d-2f74-42a2-b48d-d536ca2b0ff9 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:08.418878 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe8a50d-2f74-42a2-b48d-d536ca2b0ff9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:08.420929 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe8a50d-2f74-42a2-b48d-d536ca2b0ff9 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:08.440912 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 450/903] 10.222.0.15 () {56 vars in 1170 bytes} [Mon Nov 29 20:09:08 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:08.446876 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e57ae3-f384-488b-9ee4-2bcfa7526f0a admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:08.457086 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e57ae3-f384-488b-9ee4-2bcfa7526f0a admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:08.461819 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ebc959-84b9-4e42-981d-06d9232ea88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:08.462556 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ebc959-84b9-4e42-981d-06d9232ea88a admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:08.462862 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ebc959-84b9-4e42-981d-06d9232ea88a admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:08.463144 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ebc959-84b9-4e42-981d-06d9232ea88a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:08.471393 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ebc959-84b9-4e42-981d-06d9232ea88a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:08.473258 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ebc959-84b9-4e42-981d-06d9232ea88a admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:08.483576 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 454/904] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:09:08 2021] GET /identity/v3/auth/tokens => generated 1562 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:09:08.490121 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8a50d-2f74-42a2-b48d-d536ca2b0ff9 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:08.500475 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8a50d-2f74-42a2-b48d-d536ca2b0ff9 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:08.505064 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964031d-8989-4e4b-bbaf-29ae4e30015f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:08.505879 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964031d-8989-4e4b-bbaf-29ae4e30015f admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:08.506170 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964031d-8989-4e4b-bbaf-29ae4e30015f admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:08.506489 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964031d-8989-4e4b-bbaf-29ae4e30015f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:08.520655 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8964031d-8989-4e4b-bbaf-29ae4e30015f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:08.522642 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8964031d-8989-4e4b-bbaf-29ae4e30015f admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:08.539677 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-8964031d-8989-4e4b-bbaf-29ae4e30015f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:09:08.540866 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 451/905] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:09:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:08.547009 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ebc959-84b9-4e42-981d-06d9232ea88a admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:08.555827 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ebc959-84b9-4e42-981d-06d9232ea88a admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:08.560473 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a273d-db26-46c8-b4dd-09e7e707f077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:08.560973 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a273d-db26-46c8-b4dd-09e7e707f077 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:08.561256 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a273d-db26-46c8-b4dd-09e7e707f077 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:08.561553 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a273d-db26-46c8-b4dd-09e7e707f077 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:08.562264 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a273d-db26-46c8-b4dd-09e7e707f077 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:08.562606 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a273d-db26-46c8-b4dd-09e7e707f077 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:08.564226 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0a273d-db26-46c8-b4dd-09e7e707f077 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:08.576244 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 455/906] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:09:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:08.582137 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964031d-8989-4e4b-bbaf-29ae4e30015f admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:08.591876 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964031d-8989-4e4b-bbaf-29ae4e30015f admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:08.596578 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598e5db-3950-46a1-a033-09b0cda5f0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:08.597361 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598e5db-3950-46a1-a033-09b0cda5f0aa admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:08.597638 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598e5db-3950-46a1-a033-09b0cda5f0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:08.597911 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598e5db-3950-46a1-a033-09b0cda5f0aa admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:08.604861 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598e5db-3950-46a1-a033-09b0cda5f0aa admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:08.606817 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f598e5db-3950-46a1-a033-09b0cda5f0aa admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:08.619723 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-f598e5db-3950-46a1-a033-09b0cda5f0aa admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 29 20:09:08.621128 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 452/907] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:09:08 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:09:08.627307 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a273d-db26-46c8-b4dd-09e7e707f077 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:08.637071 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a273d-db26-46c8-b4dd-09e7e707f077 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:08.642079 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2af6fa-0614-48be-9ec2-49cedf616311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:08.642739 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2af6fa-0614-48be-9ec2-49cedf616311 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:08.643103 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2af6fa-0614-48be-9ec2-49cedf616311 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:08.643379 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2af6fa-0614-48be-9ec2-49cedf616311 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:08.644226 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2af6fa-0614-48be-9ec2-49cedf616311 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:08.644532 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2af6fa-0614-48be-9ec2-49cedf616311 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:08.646461 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2af6fa-0614-48be-9ec2-49cedf616311 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:08.660142 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 456/908] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Nov 29 20:09:08 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:08.666767 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598e5db-3950-46a1-a033-09b0cda5f0aa admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:08.678041 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f598e5db-3950-46a1-a033-09b0cda5f0aa admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:08.683157 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0e45c-9209-4beb-8d66-3b2e1a8a3bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:08.683823 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0e45c-9209-4beb-8d66-3b2e1a8a3bca admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:08.684136 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0e45c-9209-4beb-8d66-3b2e1a8a3bca admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:08.684416 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0e45c-9209-4beb-8d66-3b2e1a8a3bca admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:08.685275 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0e45c-9209-4beb-8d66-3b2e1a8a3bca admin admin] RBAC: Adding query filter params (role.id=0171a2b804da44c999835c4ec63cf931, scope.project.id=6f4cba10fe824640b2ed37aab02346ac, user.id=19d72c913c2b4442836a991120eec243) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:08.685670 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0e45c-9209-4beb-8d66-3b2e1a8a3bca admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:08.687719 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0e45c-9209-4beb-8d66-3b2e1a8a3bca admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:08.694368 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 453/909] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:09:08 2021] GET /identity/v3/role_assignments?user.id=19d72c913c2b4442836a991120eec243&scope.project.id=6f4cba10fe824640b2ed37aab02346ac&role.id=0171a2b804da44c999835c4ec63cf931 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:09:09.069727 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb83bf-2b6b-4572-bb01-f78a812039c1 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:09.070460 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb83bf-2b6b-4572-bb01-f78a812039c1 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:09.070460 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb83bf-2b6b-4572-bb01-f78a812039c1 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:09.072335 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 457/910] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:09:09.078445 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb30252-8955-416a-9eeb-28cf816df21f None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:09.078982 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb30252-8955-416a-9eeb-28cf816df21f None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:09.079150 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb30252-8955-416a-9eeb-28cf816df21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:09.096715 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-ebb30252-8955-416a-9eeb-28cf816df21f None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:09.098010 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-ebb30252-8955-416a-9eeb-28cf816df21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:09.110969 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 454/911] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:09 2021] POST /identity/v3/auth/tokens => generated 1562 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:09:09.129949 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb83bf-2b6b-4572-bb01-f78a812039c1 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:09.142729 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb83bf-2b6b-4572-bb01-f78a812039c1 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:09.147253 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615c709d-46a5-470d-9c14-e4b615a62ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:09.147918 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c709d-46a5-470d-9c14-e4b615a62ce4 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:09.148201 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c709d-46a5-470d-9c14-e4b615a62ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:09.148476 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615c709d-46a5-470d-9c14-e4b615a62ce4 admin admin] PATH_INFO: `/v3/services` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:09.149228 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c709d-46a5-470d-9c14-e4b615a62ce4 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:09.150822 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615c709d-46a5-470d-9c14-e4b615a62ce4 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:09.175089 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 458/912] 10.222.0.15 () {60 vars in 1162 bytes} [Mon Nov 29 20:09:09 2021] POST /identity/v3/services => generated 251 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:09:09.340800 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01d87c-3867-42e6-ab12-097382b9b946 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:09.341098 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01d87c-3867-42e6-ab12-097382b9b946 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:09.341285 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01d87c-3867-42e6-ab12-097382b9b946 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:09.343222 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 455/913] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:09:09.349762 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368968dd-47ab-4e49-8d5b-72d362e1b9f8 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:09.350048 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368968dd-47ab-4e49-8d5b-72d362e1b9f8 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:09.350304 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368968dd-47ab-4e49-8d5b-72d362e1b9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:09.369676 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-368968dd-47ab-4e49-8d5b-72d362e1b9f8 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:09.370933 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-368968dd-47ab-4e49-8d5b-72d362e1b9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:09.392527 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 459/914] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:09 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:09:09.413041 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf01d87c-3867-42e6-ab12-097382b9b946 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:09.426249 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf01d87c-3867-42e6-ab12-097382b9b946 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:09.431028 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef298cd-48e0-48a5-b2cf-1b3e2b3d1052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:09.431871 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef298cd-48e0-48a5-b2cf-1b3e2b3d1052 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:09.432154 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef298cd-48e0-48a5-b2cf-1b3e2b3d1052 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:09.432433 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef298cd-48e0-48a5-b2cf-1b3e2b3d1052 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:09.433098 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef298cd-48e0-48a5-b2cf-1b3e2b3d1052 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:09.434688 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef298cd-48e0-48a5-b2cf-1b3e2b3d1052 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:09.446179 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-3ef298cd-48e0-48a5-b2cf-1b3e2b3d1052 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 29 20:09:09.447821 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 456/915] 10.222.0.15 () {56 vars in 1147 bytes} [Mon Nov 29 20:09:09 2021] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:09.458419 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368968dd-47ab-4e49-8d5b-72d362e1b9f8 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:09.463592 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368968dd-47ab-4e49-8d5b-72d362e1b9f8 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:09.468412 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0562af-ab29-4ea3-ab50-db99092e414d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:09.469324 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0562af-ab29-4ea3-ab50-db99092e414d admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:09.469835 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0562af-ab29-4ea3-ab50-db99092e414d admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:09.470303 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0562af-ab29-4ea3-ab50-db99092e414d admin admin] PATH_INFO: `/v3/services` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:09.471328 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0562af-ab29-4ea3-ab50-db99092e414d admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:09.471852 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0562af-ab29-4ea3-ab50-db99092e414d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:09.473634 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0562af-ab29-4ea3-ab50-db99092e414d admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:09.479102 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 460/916] 10.222.0.15 () {56 vars in 1143 bytes} [Mon Nov 29 20:09:09 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:09.485467 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef298cd-48e0-48a5-b2cf-1b3e2b3d1052 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:09.495547 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef298cd-48e0-48a5-b2cf-1b3e2b3d1052 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:09.500334 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bbb768-7b9d-4208-bbb4-1f967ed136aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:09.501240 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbb768-7b9d-4208-bbb4-1f967ed136aa admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:09.501713 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbb768-7b9d-4208-bbb4-1f967ed136aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:09.502176 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbb768-7b9d-4208-bbb4-1f967ed136aa admin admin] PATH_INFO: `/v3/services` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:09.503117 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bbb768-7b9d-4208-bbb4-1f967ed136aa admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:09.503656 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bbb768-7b9d-4208-bbb4-1f967ed136aa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:09.505451 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bbb768-7b9d-4208-bbb4-1f967ed136aa admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:09.510693 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 457/917] 10.222.0.15 () {56 vars in 1143 bytes} [Mon Nov 29 20:09:09 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:10.380648 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11152341-89b1-49b4-b48f-378e95629b34 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:10.381209 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11152341-89b1-49b4-b48f-378e95629b34 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:10.381209 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11152341-89b1-49b4-b48f-378e95629b34 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:10.383190 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 461/918] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:09:10.389540 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a02585-83d2-4b1d-8b51-835a615cb78a None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:10.389964 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a02585-83d2-4b1d-8b51-835a615cb78a None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:10.390131 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a02585-83d2-4b1d-8b51-835a615cb78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:10.408540 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-97a02585-83d2-4b1d-8b51-835a615cb78a None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:10.409720 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-97a02585-83d2-4b1d-8b51-835a615cb78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:10.417524 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 458/919] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:10 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:09:10.440990 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11152341-89b1-49b4-b48f-378e95629b34 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:10.453212 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11152341-89b1-49b4-b48f-378e95629b34 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:10.457528 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743dcc92-8c4a-4ca9-94fa-5c943b94bd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:10.458338 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743dcc92-8c4a-4ca9-94fa-5c943b94bd06 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:10.458610 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743dcc92-8c4a-4ca9-94fa-5c943b94bd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:10.458882 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743dcc92-8c4a-4ca9-94fa-5c943b94bd06 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:10.459550 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743dcc92-8c4a-4ca9-94fa-5c943b94bd06 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:10.461125 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743dcc92-8c4a-4ca9-94fa-5c943b94bd06 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:10.472383 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-743dcc92-8c4a-4ca9-94fa-5c943b94bd06 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 29 20:09:10.473825 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 462/920] 10.222.0.15 () {56 vars in 1153 bytes} [Mon Nov 29 20:09:10 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:10.480402 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a02585-83d2-4b1d-8b51-835a615cb78a None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:10.489396 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a02585-83d2-4b1d-8b51-835a615cb78a None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:10.493868 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3534f216-77ec-42b0-9c0a-f41493eaedc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:10.494528 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534f216-77ec-42b0-9c0a-f41493eaedc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:10.494800 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534f216-77ec-42b0-9c0a-f41493eaedc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:10.495096 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534f216-77ec-42b0-9c0a-f41493eaedc8 admin admin] PATH_INFO: `/v3/services` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:10.495816 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3534f216-77ec-42b0-9c0a-f41493eaedc8 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:10.496116 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3534f216-77ec-42b0-9c0a-f41493eaedc8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:10.499023 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3534f216-77ec-42b0-9c0a-f41493eaedc8 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:10.504234 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 459/921] 10.222.0.15 () {56 vars in 1147 bytes} [Mon Nov 29 20:09:10 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:10.510284 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743dcc92-8c4a-4ca9-94fa-5c943b94bd06 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:10.521098 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743dcc92-8c4a-4ca9-94fa-5c943b94bd06 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:10.525744 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a896743-a7f7-48f4-be93-c0d0ff4aac0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:10.526510 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a896743-a7f7-48f4-be93-c0d0ff4aac0b admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:10.526789 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a896743-a7f7-48f4-be93-c0d0ff4aac0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:10.527086 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a896743-a7f7-48f4-be93-c0d0ff4aac0b admin admin] PATH_INFO: `/v3/services` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:10.527801 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a896743-a7f7-48f4-be93-c0d0ff4aac0b admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:10.528097 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a896743-a7f7-48f4-be93-c0d0ff4aac0b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:10.529681 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a896743-a7f7-48f4-be93-c0d0ff4aac0b admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:10.534727 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 463/922] 10.222.0.15 () {56 vars in 1147 bytes} [Mon Nov 29 20:09:10 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:10.541004 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3534f216-77ec-42b0-9c0a-f41493eaedc8 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:10.550620 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3534f216-77ec-42b0-9c0a-f41493eaedc8 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:10.555073 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df43b7f-f102-4f27-9d16-84b02c6c9d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:10.555717 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df43b7f-f102-4f27-9d16-84b02c6c9d65 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:10.555989 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df43b7f-f102-4f27-9d16-84b02c6c9d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:10.556258 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df43b7f-f102-4f27-9d16-84b02c6c9d65 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:10.557063 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df43b7f-f102-4f27-9d16-84b02c6c9d65 admin admin] RBAC: Adding query filter params (interface=public, service_id=f88106ef10914191ad8fd1afbb61fbe3, region_id=RegionOne) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:10.557367 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df43b7f-f102-4f27-9d16-84b02c6c9d65 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:10.558961 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df43b7f-f102-4f27-9d16-84b02c6c9d65 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:10.564703 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 460/923] 10.222.0.15 () {56 vars in 1272 bytes} [Mon Nov 29 20:09:10 2021] GET /identity/v3/endpoints?service_id=f88106ef10914191ad8fd1afbb61fbe3&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:10.570605 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a896743-a7f7-48f4-be93-c0d0ff4aac0b admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:10.580313 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a896743-a7f7-48f4-be93-c0d0ff4aac0b admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:10.584750 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813220cb-eb46-42e4-bdbc-934bbf10494b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:10.585404 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813220cb-eb46-42e4-bdbc-934bbf10494b admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:10.585677 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813220cb-eb46-42e4-bdbc-934bbf10494b admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:10.585945 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813220cb-eb46-42e4-bdbc-934bbf10494b admin admin] PATH_INFO: `/v3/services` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:10.586626 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813220cb-eb46-42e4-bdbc-934bbf10494b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:10.588234 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813220cb-eb46-42e4-bdbc-934bbf10494b admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:10.594265 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 464/924] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Nov 29 20:09:10 2021] GET /identity/v3/services => generated 1268 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:09:11.088612 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c1fdd-741f-4411-a25f-faabb4a49e14 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:11.088811 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c1fdd-741f-4411-a25f-faabb4a49e14 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:11.089083 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c1fdd-741f-4411-a25f-faabb4a49e14 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:11.091207 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 461/925] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:09:11.097157 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a255ff-5b9e-4833-909f-dbf2dfc7b19f None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:11.097452 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a255ff-5b9e-4833-909f-dbf2dfc7b19f None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:11.097732 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a255ff-5b9e-4833-909f-dbf2dfc7b19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:11.115544 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-97a255ff-5b9e-4833-909f-dbf2dfc7b19f None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:11.116738 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-97a255ff-5b9e-4833-909f-dbf2dfc7b19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:11.130961 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 465/926] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:11 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:09:11.148659 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c1fdd-741f-4411-a25f-faabb4a49e14 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:11.161500 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c1fdd-741f-4411-a25f-faabb4a49e14 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:11.166152 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c8ca0-013b-4a70-b003-949db301bc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:11.167024 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c8ca0-013b-4a70-b003-949db301bc28 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:11.167304 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c8ca0-013b-4a70-b003-949db301bc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:11.167574 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c8ca0-013b-4a70-b003-949db301bc28 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:11.179656 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c8ca0-013b-4a70-b003-949db301bc28 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:09:11.187056 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-989c8ca0-013b-4a70-b003-949db301bc28 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 29 20:09:11.190960 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 462/927] 10.222.0.15 () {56 vars in 1141 bytes} [Mon Nov 29 20:09:11 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:11.195049 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a255ff-5b9e-4833-909f-dbf2dfc7b19f None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:11.204306 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a255ff-5b9e-4833-909f-dbf2dfc7b19f None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:11.208908 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d604f48-1f53-401d-a54f-0e3ac5fbf3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:11.209570 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d604f48-1f53-401d-a54f-0e3ac5fbf3b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:11.209850 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d604f48-1f53-401d-a54f-0e3ac5fbf3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:11.210125 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d604f48-1f53-401d-a54f-0e3ac5fbf3b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:11.210929 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d604f48-1f53-401d-a54f-0e3ac5fbf3b7 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:11.211236 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d604f48-1f53-401d-a54f-0e3ac5fbf3b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:11.212850 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d604f48-1f53-401d-a54f-0e3ac5fbf3b7 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:11.226557 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 466/928] 10.222.0.15 () {56 vars in 1136 bytes} [Mon Nov 29 20:09:11 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:11.227887 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c8ca0-013b-4a70-b003-949db301bc28 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:11.241510 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c8ca0-013b-4a70-b003-949db301bc28 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:11.246066 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606c0d6-ff1d-4eae-99cb-3e98451971b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:11.246837 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606c0d6-ff1d-4eae-99cb-3e98451971b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:11.247147 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606c0d6-ff1d-4eae-99cb-3e98451971b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:11.247416 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606c0d6-ff1d-4eae-99cb-3e98451971b5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:11.259453 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606c0d6-ff1d-4eae-99cb-3e98451971b5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:11.261351 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606c0d6-ff1d-4eae-99cb-3e98451971b5 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:11.278988 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-f606c0d6-ff1d-4eae-99cb-3e98451971b5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:09:11.280494 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 463/929] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:09:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:11.286565 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d604f48-1f53-401d-a54f-0e3ac5fbf3b7 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:11.296778 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d604f48-1f53-401d-a54f-0e3ac5fbf3b7 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:11.301674 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595cdd25-56b1-42cb-8772-2ddfd9fa2fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:11.302551 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595cdd25-56b1-42cb-8772-2ddfd9fa2fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:11.303072 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595cdd25-56b1-42cb-8772-2ddfd9fa2fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:11.303559 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595cdd25-56b1-42cb-8772-2ddfd9fa2fc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:11.304485 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595cdd25-56b1-42cb-8772-2ddfd9fa2fc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:11.305001 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595cdd25-56b1-42cb-8772-2ddfd9fa2fc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:11.306802 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595cdd25-56b1-42cb-8772-2ddfd9fa2fc2 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:11.324566 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 467/930] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:09:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:11.326171 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606c0d6-ff1d-4eae-99cb-3e98451971b5 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:11.336279 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606c0d6-ff1d-4eae-99cb-3e98451971b5 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:11.341298 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0919f12-5f0a-4311-a1b5-0f16420c5ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:11.342345 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0919f12-5f0a-4311-a1b5-0f16420c5ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:11.342837 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0919f12-5f0a-4311-a1b5-0f16420c5ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:11.343333 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0919f12-5f0a-4311-a1b5-0f16420c5ba5 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:11.351456 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0919f12-5f0a-4311-a1b5-0f16420c5ba5 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:11.353720 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0919f12-5f0a-4311-a1b5-0f16420c5ba5 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:11.368205 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-e0919f12-5f0a-4311-a1b5-0f16420c5ba5 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 29 20:09:11.374762 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 464/931] 10.222.0.15 () {56 vars in 1138 bytes} [Mon Nov 29 20:09:11 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:11.376345 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595cdd25-56b1-42cb-8772-2ddfd9fa2fc2 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:11.386376 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595cdd25-56b1-42cb-8772-2ddfd9fa2fc2 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:11.392115 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1383e0-25c6-4ff9-969b-e40446790c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:11.393057 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1383e0-25c6-4ff9-969b-e40446790c58 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:11.393536 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1383e0-25c6-4ff9-969b-e40446790c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:11.394013 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1383e0-25c6-4ff9-969b-e40446790c58 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:11.395095 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1383e0-25c6-4ff9-969b-e40446790c58 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:11.395616 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1383e0-25c6-4ff9-969b-e40446790c58 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:11.397682 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1383e0-25c6-4ff9-969b-e40446790c58 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:11.420774 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 468/932] 10.222.0.15 () {56 vars in 1170 bytes} [Mon Nov 29 20:09:11 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:11.422488 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0919f12-5f0a-4311-a1b5-0f16420c5ba5 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:11.432933 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0919f12-5f0a-4311-a1b5-0f16420c5ba5 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:11.437885 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff9293-919d-466b-a4b3-2263cc1e78da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:11.439014 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff9293-919d-466b-a4b3-2263cc1e78da admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:11.439497 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff9293-919d-466b-a4b3-2263cc1e78da admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:11.439966 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff9293-919d-466b-a4b3-2263cc1e78da admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:11.451229 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff9293-919d-466b-a4b3-2263cc1e78da admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:11.453487 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff9293-919d-466b-a4b3-2263cc1e78da admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:11.477984 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-d3ff9293-919d-466b-a4b3-2263cc1e78da admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:09:11.486964 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 465/933] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:09:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:11.490156 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1383e0-25c6-4ff9-969b-e40446790c58 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:11.504446 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1383e0-25c6-4ff9-969b-e40446790c58 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:11.511465 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce315c-3176-44cf-af9d-a633a8d45802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:11.512511 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce315c-3176-44cf-af9d-a633a8d45802 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:11.512996 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce315c-3176-44cf-af9d-a633a8d45802 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:11.513466 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce315c-3176-44cf-af9d-a633a8d45802 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:11.514708 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cce315c-3176-44cf-af9d-a633a8d45802 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:11.515284 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cce315c-3176-44cf-af9d-a633a8d45802 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:11.517343 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cce315c-3176-44cf-af9d-a633a8d45802 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:11.531523 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 469/934] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:09:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:11.537769 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff9293-919d-466b-a4b3-2263cc1e78da admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:11.547876 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff9293-919d-466b-a4b3-2263cc1e78da admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:11.552639 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cc22b-2866-4ce4-9007-b90519c40e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:11.553693 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cc22b-2866-4ce4-9007-b90519c40e5c admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:11.554143 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cc22b-2866-4ce4-9007-b90519c40e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:11.554642 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58cc22b-2866-4ce4-9007-b90519c40e5c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:11.562302 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58cc22b-2866-4ce4-9007-b90519c40e5c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:11.564647 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58cc22b-2866-4ce4-9007-b90519c40e5c admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:11.572288 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc8333-2bce-4384-876f-f124689557d2 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:11.572577 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc8333-2bce-4384-876f-f124689557d2 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:11.572857 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc8333-2bce-4384-876f-f124689557d2 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:11.574942 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 470/935] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:09:11.579612 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-e58cc22b-2866-4ce4-9007-b90519c40e5c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 29 20:09:11.580415 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae22973-9fea-458f-995e-075cb4ddc7f6 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:11.580703 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae22973-9fea-458f-995e-075cb4ddc7f6 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:11.580980 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae22973-9fea-458f-995e-075cb4ddc7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:11.581782 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 466/936] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:09:11 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:11.587895 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cc22b-2866-4ce4-9007-b90519c40e5c admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:11.598293 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58cc22b-2866-4ce4-9007-b90519c40e5c admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:11.602980 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082aff7a-4210-433b-8c19-6233568b09b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:11.603770 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082aff7a-4210-433b-8c19-6233568b09b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:11.604190 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082aff7a-4210-433b-8c19-6233568b09b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:11.604625 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082aff7a-4210-433b-8c19-6233568b09b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:11.605431 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-bae22973-9fea-458f-995e-075cb4ddc7f6 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:11.605727 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082aff7a-4210-433b-8c19-6233568b09b5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:11.606166 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082aff7a-4210-433b-8c19-6233568b09b5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:11.607022 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-bae22973-9fea-458f-995e-075cb4ddc7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:11.608321 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082aff7a-4210-433b-8c19-6233568b09b5 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:11.621175 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 467/938] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Nov 29 20:09:11 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:09:11.626891 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 471/938] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:11 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:09:11.627964 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082aff7a-4210-433b-8c19-6233568b09b5 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:11.637815 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082aff7a-4210-433b-8c19-6233568b09b5 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:11.640907 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae22973-9fea-458f-995e-075cb4ddc7f6 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:11.643490 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ac00e-5b3a-48be-9f7f-d59ddc856dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:11.644602 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ac00e-5b3a-48be-9f7f-d59ddc856dc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:11.645110 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ac00e-5b3a-48be-9f7f-d59ddc856dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:11.645575 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ac00e-5b3a-48be-9f7f-d59ddc856dc4 admin admin] PATH_INFO: `/v3/projects/6f4cba10fe824640b2ed37aab02346ac/users/19d72c913c2b4442836a991120eec243/roles/0171a2b804da44c999835c4ec63cf931` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:11.648020 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182ac00e-5b3a-48be-9f7f-d59ddc856dc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f4cba10fe824640b2ed37aab02346ac, user_id=19d72c913c2b4442836a991120eec243, role_id=0171a2b804da44c999835c4ec63cf931)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:11.650888 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae22973-9fea-458f-995e-075cb4ddc7f6 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:11.651084 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182ac00e-5b3a-48be-9f7f-d59ddc856dc4 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:11.655722 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56537cfe-c01d-4068-ab1d-bcaedd757017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:11.656596 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56537cfe-c01d-4068-ab1d-bcaedd757017 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:11.657010 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56537cfe-c01d-4068-ab1d-bcaedd757017 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:11.657204 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56537cfe-c01d-4068-ab1d-bcaedd757017 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:11.657809 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56537cfe-c01d-4068-ab1d-bcaedd757017 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:11.659487 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56537cfe-c01d-4068-ab1d-bcaedd757017 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:11.668308 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 468/939] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Nov 29 20:09:11 2021] PUT /identity/v3/projects/6f4cba10fe824640b2ed37aab02346ac/users/19d72c913c2b4442836a991120eec243/roles/0171a2b804da44c999835c4ec63cf931 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:09:11.674954 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-56537cfe-c01d-4068-ab1d-bcaedd757017 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 29 20:09:11.674954 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 472/940] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Nov 29 20:09:11 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:09:11.679259 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ac00e-5b3a-48be-9f7f-d59ddc856dc4 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:11.749273 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ac00e-5b3a-48be-9f7f-d59ddc856dc4 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:11.754245 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86303263-4b4a-4e12-a8ad-c1e0127aed66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:11.755026 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86303263-4b4a-4e12-a8ad-c1e0127aed66 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:11.755312 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86303263-4b4a-4e12-a8ad-c1e0127aed66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:11.755640 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86303263-4b4a-4e12-a8ad-c1e0127aed66 admin admin] PATH_INFO: `/v3/services` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:11.756503 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86303263-4b4a-4e12-a8ad-c1e0127aed66 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:11.756815 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86303263-4b4a-4e12-a8ad-c1e0127aed66 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:11.758605 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86303263-4b4a-4e12-a8ad-c1e0127aed66 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:11.765215 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 469/941] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Nov 29 20:09:11 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:11.771940 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56537cfe-c01d-4068-ab1d-bcaedd757017 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:11.782805 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56537cfe-c01d-4068-ab1d-bcaedd757017 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:11.790169 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd559e-a3df-4456-b56f-a348a32cb08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:11.790950 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd559e-a3df-4456-b56f-a348a32cb08f admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:11.791393 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd559e-a3df-4456-b56f-a348a32cb08f admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:11.791725 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dd559e-a3df-4456-b56f-a348a32cb08f admin admin] PATH_INFO: `/v3/services` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:11.792578 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd559e-a3df-4456-b56f-a348a32cb08f admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:11.792888 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd559e-a3df-4456-b56f-a348a32cb08f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:11.794745 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dd559e-a3df-4456-b56f-a348a32cb08f admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:11.801169 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 473/942] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Nov 29 20:09:11 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:11.807629 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86303263-4b4a-4e12-a8ad-c1e0127aed66 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:11.818393 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86303263-4b4a-4e12-a8ad-c1e0127aed66 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:11.823291 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc15cd-1d48-484c-a18f-a154c4ed1e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:11.824015 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc15cd-1d48-484c-a18f-a154c4ed1e07 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:11.824300 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc15cd-1d48-484c-a18f-a154c4ed1e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:11.824576 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc15cd-1d48-484c-a18f-a154c4ed1e07 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:11.825451 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc15cd-1d48-484c-a18f-a154c4ed1e07 admin admin] RBAC: Adding query filter params (interface=public, service_id=47633d093f0e4441a1e43c56d2592ab3, region_id=RegionOne) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:11.825767 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc15cd-1d48-484c-a18f-a154c4ed1e07 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:11.827533 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc15cd-1d48-484c-a18f-a154c4ed1e07 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:11.834797 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 470/943] 10.222.0.15 () {56 vars in 1272 bytes} [Mon Nov 29 20:09:11 2021] GET /identity/v3/endpoints?service_id=47633d093f0e4441a1e43c56d2592ab3&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:11.841259 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd559e-a3df-4456-b56f-a348a32cb08f admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:11.852237 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dd559e-a3df-4456-b56f-a348a32cb08f admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:11.857118 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48661755-f2c5-4a7a-9ff9-08c7c9b2dd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:11.857850 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48661755-f2c5-4a7a-9ff9-08c7c9b2dd42 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:11.858220 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48661755-f2c5-4a7a-9ff9-08c7c9b2dd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:11.858507 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48661755-f2c5-4a7a-9ff9-08c7c9b2dd42 admin admin] PATH_INFO: `/v3/services` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:11.859243 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48661755-f2c5-4a7a-9ff9-08c7c9b2dd42 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:11.861052 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48661755-f2c5-4a7a-9ff9-08c7c9b2dd42 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:11.868361 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 474/944] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Nov 29 20:09:11 2021] GET /identity/v3/services => generated 1268 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:09:11.934596 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7032b-87a3-4037-bdd0-3f46ef46d303 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:11.934968 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7032b-87a3-4037-bdd0-3f46ef46d303 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:11.935190 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7032b-87a3-4037-bdd0-3f46ef46d303 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:11.937439 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 471/945] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:09:11.944194 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c0d76-960b-4dbc-b7ed-390aa5f6ce5b None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:11.944498 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c0d76-960b-4dbc-b7ed-390aa5f6ce5b None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:11.944749 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c0d76-960b-4dbc-b7ed-390aa5f6ce5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:11.964689 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-f91c0d76-960b-4dbc-b7ed-390aa5f6ce5b None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:11.965982 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-f91c0d76-960b-4dbc-b7ed-390aa5f6ce5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:11.977058 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 475/946] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:11 2021] POST /identity/v3/auth/tokens => generated 1663 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:09:11.999458 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a7032b-87a3-4037-bdd0-3f46ef46d303 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:12.013055 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a7032b-87a3-4037-bdd0-3f46ef46d303 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:12.018174 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3931280a-fb8a-4622-8ad0-ce65c29506fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:12.018956 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931280a-fb8a-4622-8ad0-ce65c29506fd admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:12.019289 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931280a-fb8a-4622-8ad0-ce65c29506fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:12.019566 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931280a-fb8a-4622-8ad0-ce65c29506fd admin admin] PATH_INFO: `/v3/services` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:12.020326 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3931280a-fb8a-4622-8ad0-ce65c29506fd admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:12.022039 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3931280a-fb8a-4622-8ad0-ce65c29506fd admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:12.043043 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 472/947] 10.222.0.15 () {60 vars in 1162 bytes} [Mon Nov 29 20:09:11 2021] POST /identity/v3/services => generated 241 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:09:12.997495 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db134b1f-48c6-4c8d-aec6-661fb0ea6851 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:12.998185 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db134b1f-48c6-4c8d-aec6-661fb0ea6851 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:12.998185 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db134b1f-48c6-4c8d-aec6-661fb0ea6851 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:13.000125 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 476/948] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:09:13.005946 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a57b5-dee3-4378-ac0e-8a772954755c None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:13.006410 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a57b5-dee3-4378-ac0e-8a772954755c None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:13.006555 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a57b5-dee3-4378-ac0e-8a772954755c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:13.024911 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-4b7a57b5-dee3-4378-ac0e-8a772954755c None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:13.026183 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-4b7a57b5-dee3-4378-ac0e-8a772954755c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:13.043314 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 473/949] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:13 2021] POST /identity/v3/auth/tokens => generated 1765 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:09:13.066682 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db134b1f-48c6-4c8d-aec6-661fb0ea6851 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:13.078984 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db134b1f-48c6-4c8d-aec6-661fb0ea6851 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:13.083380 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c1a80-6c82-45b4-b724-199f20194db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:13.084115 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c1a80-6c82-45b4-b724-199f20194db5 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:13.084387 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c1a80-6c82-45b4-b724-199f20194db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:13.084650 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c1a80-6c82-45b4-b724-199f20194db5 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:13.085314 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965c1a80-6c82-45b4-b724-199f20194db5 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:13.086920 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965c1a80-6c82-45b4-b724-199f20194db5 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:13.098257 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-965c1a80-6c82-45b4-b724-199f20194db5 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Nov 29 20:09:13.099700 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 477/950] 10.222.0.15 () {56 vars in 1153 bytes} [Mon Nov 29 20:09:13 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:13.106105 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a57b5-dee3-4378-ac0e-8a772954755c None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:13.115232 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7a57b5-dee3-4378-ac0e-8a772954755c None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:13.119713 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2911aa07-6b1a-4143-ab26-b52c6b7e8463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:13.120373 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911aa07-6b1a-4143-ab26-b52c6b7e8463 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:13.120645 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911aa07-6b1a-4143-ab26-b52c6b7e8463 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:13.120913 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911aa07-6b1a-4143-ab26-b52c6b7e8463 admin admin] PATH_INFO: `/v3/services` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:13.121632 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2911aa07-6b1a-4143-ab26-b52c6b7e8463 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:13.121930 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2911aa07-6b1a-4143-ab26-b52c6b7e8463 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:13.123593 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2911aa07-6b1a-4143-ab26-b52c6b7e8463 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:13.128928 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 474/951] 10.222.0.15 () {56 vars in 1147 bytes} [Mon Nov 29 20:09:13 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:13.134957 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c1a80-6c82-45b4-b724-199f20194db5 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:13.150901 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c1a80-6c82-45b4-b724-199f20194db5 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:13.154097 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a83bdd5-baa0-47ce-aec7-cf42875edf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:13.154915 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83bdd5-baa0-47ce-aec7-cf42875edf99 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:13.155298 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83bdd5-baa0-47ce-aec7-cf42875edf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:13.155668 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a83bdd5-baa0-47ce-aec7-cf42875edf99 admin admin] PATH_INFO: `/v3/services` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:13.156527 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a83bdd5-baa0-47ce-aec7-cf42875edf99 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:13.156895 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a83bdd5-baa0-47ce-aec7-cf42875edf99 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:13.158598 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a83bdd5-baa0-47ce-aec7-cf42875edf99 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:13.164159 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 478/952] 10.222.0.15 () {56 vars in 1147 bytes} [Mon Nov 29 20:09:13 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:13.170002 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2911aa07-6b1a-4143-ab26-b52c6b7e8463 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:13.179728 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2911aa07-6b1a-4143-ab26-b52c6b7e8463 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:13.184119 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137effb6-f5f9-46c1-a5e2-a6fa260e41f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:13.184769 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137effb6-f5f9-46c1-a5e2-a6fa260e41f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:13.185040 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137effb6-f5f9-46c1-a5e2-a6fa260e41f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:13.185306 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137effb6-f5f9-46c1-a5e2-a6fa260e41f1 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:13.186184 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137effb6-f5f9-46c1-a5e2-a6fa260e41f1 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:13.187227 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING py.warnings [None req-137effb6-f5f9-46c1-a5e2-a6fa260e41f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 29 20:09:13.187227 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: warnings.warn(msg) Nov 29 20:09:13.187227 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: Nov 29 20:09:13.188129 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137effb6-f5f9-46c1-a5e2-a6fa260e41f1 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:13.209958 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 475/953] 10.222.0.15 () {60 vars in 1165 bytes} [Mon Nov 29 20:09:13 2021] POST /identity/v3/endpoints => generated 347 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:09:14.113027 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479d625-22f1-44ce-9765-af18d146e8d2 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:14.113546 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479d625-22f1-44ce-9765-af18d146e8d2 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:14.113546 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479d625-22f1-44ce-9765-af18d146e8d2 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:14.115543 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 479/954] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:09:14.121941 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61b56c-ab73-4194-81fb-4c9e3f4c2399 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:14.122408 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61b56c-ab73-4194-81fb-4c9e3f4c2399 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:14.122507 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c61b56c-ab73-4194-81fb-4c9e3f4c2399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:14.141833 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-4c61b56c-ab73-4194-81fb-4c9e3f4c2399 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:14.143070 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-4c61b56c-ab73-4194-81fb-4c9e3f4c2399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:14.160582 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 476/955] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:14 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:09:14.185361 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6479d625-22f1-44ce-9765-af18d146e8d2 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:14.205202 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6479d625-22f1-44ce-9765-af18d146e8d2 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:14.210798 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a701f-bc30-49bf-beb4-a7971d548e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:14.212021 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a701f-bc30-49bf-beb4-a7971d548e27 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:14.212434 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a701f-bc30-49bf-beb4-a7971d548e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:14.212838 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a701f-bc30-49bf-beb4-a7971d548e27 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:14.226777 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a701f-bc30-49bf-beb4-a7971d548e27 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:09:14.234596 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f60089-98e9-4c3d-a058-27bb9d7a8dd8 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:14.235006 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-0c1a701f-bc30-49bf-beb4-a7971d548e27 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 29 20:09:14.235111 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f60089-98e9-4c3d-a058-27bb9d7a8dd8 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:14.235337 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f60089-98e9-4c3d-a058-27bb9d7a8dd8 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:14.236537 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 480/956] 10.222.0.15 () {56 vars in 1141 bytes} [Mon Nov 29 20:09:14 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:09:14.237121 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 477/957] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 29 20:09:14.242767 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaaa9ea-ce36-4068-a06d-60d56ce0747c None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:14.243080 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaaa9ea-ce36-4068-a06d-60d56ce0747c None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:14.243356 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaaa9ea-ce36-4068-a06d-60d56ce0747c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:14.243925 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f60089-98e9-4c3d-a058-27bb9d7a8dd8 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:14.256672 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f60089-98e9-4c3d-a058-27bb9d7a8dd8 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:14.261161 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-ddaaa9ea-ce36-4068-a06d-60d56ce0747c None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:14.261569 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08ed30-a6e3-4549-a3af-00c5ed4c8733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:14.262348 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-ddaaa9ea-ce36-4068-a06d-60d56ce0747c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:14.262710 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08ed30-a6e3-4549-a3af-00c5ed4c8733 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:14.263302 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08ed30-a6e3-4549-a3af-00c5ed4c8733 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:14.263833 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf08ed30-a6e3-4549-a3af-00c5ed4c8733 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:14.265382 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf08ed30-a6e3-4549-a3af-00c5ed4c8733 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:14.266009 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf08ed30-a6e3-4549-a3af-00c5ed4c8733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:14.268093 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf08ed30-a6e3-4549-a3af-00c5ed4c8733 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:14.270790 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 481/958] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:14 2021] POST /identity/v3/auth/tokens => generated 1952 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:09:14.277356 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 478/959] 10.222.0.15 () {56 vars in 1136 bytes} [Mon Nov 29 20:09:14 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:14.283756 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaaa9ea-ce36-4068-a06d-60d56ce0747c None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:14.293447 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaaa9ea-ce36-4068-a06d-60d56ce0747c None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:14.295062 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08ed30-a6e3-4549-a3af-00c5ed4c8733 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:14.298815 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea226a2-928b-4e61-8b6c-3a439ee96e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:14.299845 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea226a2-928b-4e61-8b6c-3a439ee96e54 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:14.300315 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea226a2-928b-4e61-8b6c-3a439ee96e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:14.300756 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea226a2-928b-4e61-8b6c-3a439ee96e54 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:14.304937 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf08ed30-a6e3-4549-a3af-00c5ed4c8733 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:14.309681 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844c4f8-7281-4196-970c-6db6e6d41c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:14.310558 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844c4f8-7281-4196-970c-6db6e6d41c27 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:14.310907 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844c4f8-7281-4196-970c-6db6e6d41c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:14.311380 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844c4f8-7281-4196-970c-6db6e6d41c27 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:14.312125 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3844c4f8-7281-4196-970c-6db6e6d41c27 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:14.313323 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea226a2-928b-4e61-8b6c-3a439ee96e54 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:14.314069 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3844c4f8-7281-4196-970c-6db6e6d41c27 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:14.315729 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea226a2-928b-4e61-8b6c-3a439ee96e54 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:14.325706 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-3844c4f8-7281-4196-970c-6db6e6d41c27 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Nov 29 20:09:14.332777 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 479/960] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Nov 29 20:09:14 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:09:14.333678 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844c4f8-7281-4196-970c-6db6e6d41c27 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:14.333951 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-1ea226a2-928b-4e61-8b6c-3a439ee96e54 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:09:14.335693 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 482/961] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:09:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:14.341865 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea226a2-928b-4e61-8b6c-3a439ee96e54 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:14.343544 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844c4f8-7281-4196-970c-6db6e6d41c27 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:14.348351 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9529e-f1ee-47e6-99e6-48bb1f7a7dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:14.349486 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9529e-f1ee-47e6-99e6-48bb1f7a7dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:14.349486 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9529e-f1ee-47e6-99e6-48bb1f7a7dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:14.349670 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9529e-f1ee-47e6-99e6-48bb1f7a7dc5 admin admin] PATH_INFO: `/v3/services` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:14.350573 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e9529e-f1ee-47e6-99e6-48bb1f7a7dc5 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:14.351024 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e9529e-f1ee-47e6-99e6-48bb1f7a7dc5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:14.352735 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e9529e-f1ee-47e6-99e6-48bb1f7a7dc5 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:14.358670 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 480/962] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Nov 29 20:09:14 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:09:14.360455 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea226a2-928b-4e61-8b6c-3a439ee96e54 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:14.364279 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9529e-f1ee-47e6-99e6-48bb1f7a7dc5 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:14.366705 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eec06e-be17-4dd5-96e6-5c13893d383a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:14.367626 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eec06e-be17-4dd5-96e6-5c13893d383a admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:14.368132 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eec06e-be17-4dd5-96e6-5c13893d383a admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:14.368610 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eec06e-be17-4dd5-96e6-5c13893d383a admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:14.369590 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eec06e-be17-4dd5-96e6-5c13893d383a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:14.370098 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eec06e-be17-4dd5-96e6-5c13893d383a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:14.371833 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eec06e-be17-4dd5-96e6-5c13893d383a admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:14.373731 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9529e-f1ee-47e6-99e6-48bb1f7a7dc5 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:14.378728 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685a32d-0d75-40c6-88f0-882f1e68bd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:14.379632 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685a32d-0d75-40c6-88f0-882f1e68bd98 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:14.380086 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685a32d-0d75-40c6-88f0-882f1e68bd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:14.380570 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685a32d-0d75-40c6-88f0-882f1e68bd98 admin admin] PATH_INFO: `/v3/services` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:14.381477 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685a32d-0d75-40c6-88f0-882f1e68bd98 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:14.381984 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685a32d-0d75-40c6-88f0-882f1e68bd98 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:14.383770 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685a32d-0d75-40c6-88f0-882f1e68bd98 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:14.390534 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 483/963] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:09:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:09:14.392244 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eec06e-be17-4dd5-96e6-5c13893d383a admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:14.393297 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 481/964] 10.222.0.15 () {56 vars in 1135 bytes} [Mon Nov 29 20:09:14 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:09:14.399830 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685a32d-0d75-40c6-88f0-882f1e68bd98 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:14.404059 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eec06e-be17-4dd5-96e6-5c13893d383a admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:14.408807 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345271c-28dc-4c03-b1e1-e37b13870f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:14.409682 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345271c-28dc-4c03-b1e1-e37b13870f12 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:14.409963 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345271c-28dc-4c03-b1e1-e37b13870f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:14.410279 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345271c-28dc-4c03-b1e1-e37b13870f12 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:14.412151 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685a32d-0d75-40c6-88f0-882f1e68bd98 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:14.417173 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80debbdd-71fb-41c4-940e-3288469896b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:14.418100 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80debbdd-71fb-41c4-940e-3288469896b2 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:14.418626 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80debbdd-71fb-41c4-940e-3288469896b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:14.419031 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d345271c-28dc-4c03-b1e1-e37b13870f12 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:14.419350 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80debbdd-71fb-41c4-940e-3288469896b2 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:14.420297 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80debbdd-71fb-41c4-940e-3288469896b2 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:14.421164 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d345271c-28dc-4c03-b1e1-e37b13870f12 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:14.422562 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80debbdd-71fb-41c4-940e-3288469896b2 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:14.435407 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-d345271c-28dc-4c03-b1e1-e37b13870f12 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Nov 29 20:09:14.436738 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 484/965] 10.222.0.15 () {56 vars in 1138 bytes} [Mon Nov 29 20:09:14 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:09:14.442935 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345271c-28dc-4c03-b1e1-e37b13870f12 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:14.447740 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 482/966] 10.222.0.15 () {60 vars in 1165 bytes} [Mon Nov 29 20:09:14 2021] POST /identity/v3/endpoints => generated 346 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 29 20:09:14.453327 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345271c-28dc-4c03-b1e1-e37b13870f12 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:14.468416 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5afe52-fc21-45c1-8be4-59b0410f9247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:14.469124 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5afe52-fc21-45c1-8be4-59b0410f9247 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:14.469403 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5afe52-fc21-45c1-8be4-59b0410f9247 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:14.469688 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5afe52-fc21-45c1-8be4-59b0410f9247 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:14.470531 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5afe52-fc21-45c1-8be4-59b0410f9247 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:14.470835 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5afe52-fc21-45c1-8be4-59b0410f9247 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:14.472904 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5afe52-fc21-45c1-8be4-59b0410f9247 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:14.477635 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b16a22b-b13b-4279-96af-a0813cfa1993 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:14.477920 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b16a22b-b13b-4279-96af-a0813cfa1993 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:14.478194 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b16a22b-b13b-4279-96af-a0813cfa1993 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:14.485142 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 483/967] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:14 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 29 20:09:14.487229 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd55bfb-012f-4ebd-9ca5-445ea6f229f6 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:14.487517 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd55bfb-012f-4ebd-9ca5-445ea6f229f6 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:14.487792 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd55bfb-012f-4ebd-9ca5-445ea6f229f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:14.493338 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 485/968] 10.222.0.15 () {56 vars in 1170 bytes} [Mon Nov 29 20:09:14 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:09:14.499816 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5afe52-fc21-45c1-8be4-59b0410f9247 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:14.510158 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5afe52-fc21-45c1-8be4-59b0410f9247 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:14.513407 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-5cd55bfb-012f-4ebd-9ca5-445ea6f229f6 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:14.515742 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c6828e-c3e6-4a57-868c-809325a95b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:14.515922 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-5cd55bfb-012f-4ebd-9ca5-445ea6f229f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:14.516533 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6828e-c3e6-4a57-868c-809325a95b19 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:14.516813 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6828e-c3e6-4a57-868c-809325a95b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:14.517087 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6828e-c3e6-4a57-868c-809325a95b19 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:14.527306 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c6828e-c3e6-4a57-868c-809325a95b19 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:14.529421 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c6828e-c3e6-4a57-868c-809325a95b19 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:14.534190 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 484/969] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:14 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:09:14.540344 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 486/970] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:09:14 2021] GET /identity/v3/auth/tokens => generated 2138 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 29 20:09:14.546591 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd55bfb-012f-4ebd-9ca5-445ea6f229f6 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:14.554882 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c6828e-c3e6-4a57-868c-809325a95b19 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:14.556768 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd55bfb-012f-4ebd-9ca5-445ea6f229f6 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:14.561935 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f9d10-7e04-440b-8691-67760f8232cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:14.562344 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f9d10-7e04-440b-8691-67760f8232cf admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:14.562656 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f9d10-7e04-440b-8691-67760f8232cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:14.562959 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f9d10-7e04-440b-8691-67760f8232cf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:14.566516 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c6828e-c3e6-4a57-868c-809325a95b19 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:14.572615 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940f53e-a217-4c3f-814e-e367d57e74f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:14.574070 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940f53e-a217-4c3f-814e-e367d57e74f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:14.574619 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1f9d10-7e04-440b-8691-67760f8232cf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:14.575183 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940f53e-a217-4c3f-814e-e367d57e74f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:14.575616 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c940f53e-a217-4c3f-814e-e367d57e74f2 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:14.576082 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1f9d10-7e04-440b-8691-67760f8232cf admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:14.576595 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c940f53e-a217-4c3f-814e-e367d57e74f2 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:14.579283 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c940f53e-a217-4c3f-814e-e367d57e74f2 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:14.592733 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-c940f53e-a217-4c3f-814e-e367d57e74f2 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 29 20:09:14.594045 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-ad1f9d10-7e04-440b-8691-67760f8232cf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:09:14.594918 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 487/971] 10.222.0.15 () {56 vars in 1147 bytes} [Mon Nov 29 20:09:14 2021] GET /identity/v3/services/object-store => generated 93 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:14.595523 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 485/972] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:09:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:14.601218 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940f53e-a217-4c3f-814e-e367d57e74f2 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:14.603160 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f9d10-7e04-440b-8691-67760f8232cf admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:14.613235 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c940f53e-a217-4c3f-814e-e367d57e74f2 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:14.614042 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f9d10-7e04-440b-8691-67760f8232cf admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:14.618729 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507660e6-82fd-4841-bf13-1dc431f341d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:14.619474 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58178758-9ecc-4133-9c3f-a8755d12fe8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:14.619893 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507660e6-82fd-4841-bf13-1dc431f341d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:14.620355 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58178758-9ecc-4133-9c3f-a8755d12fe8e admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:14.620603 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507660e6-82fd-4841-bf13-1dc431f341d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:14.620816 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58178758-9ecc-4133-9c3f-a8755d12fe8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:14.621200 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58178758-9ecc-4133-9c3f-a8755d12fe8e admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:14.621405 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507660e6-82fd-4841-bf13-1dc431f341d7 admin admin] PATH_INFO: `/v3/services` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:14.622187 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58178758-9ecc-4133-9c3f-a8755d12fe8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:14.622451 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507660e6-82fd-4841-bf13-1dc431f341d7 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:14.622694 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58178758-9ecc-4133-9c3f-a8755d12fe8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:14.623101 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507660e6-82fd-4841-bf13-1dc431f341d7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:14.624581 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58178758-9ecc-4133-9c3f-a8755d12fe8e admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:14.625136 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507660e6-82fd-4841-bf13-1dc431f341d7 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:14.631800 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 488/973] 10.222.0.15 () {56 vars in 1143 bytes} [Mon Nov 29 20:09:14 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:09:14.638897 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507660e6-82fd-4841-bf13-1dc431f341d7 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:14.645157 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 486/974] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:09:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:09:14.648906 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507660e6-82fd-4841-bf13-1dc431f341d7 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:14.651923 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58178758-9ecc-4133-9c3f-a8755d12fe8e admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:14.661999 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfdbde2-53cf-4f4c-9650-1ed173287e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:14.662675 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfdbde2-53cf-4f4c-9650-1ed173287e1a admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:14.662989 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfdbde2-53cf-4f4c-9650-1ed173287e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:14.663260 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfdbde2-53cf-4f4c-9650-1ed173287e1a admin admin] PATH_INFO: `/v3/services` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:14.663982 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfdbde2-53cf-4f4c-9650-1ed173287e1a admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:14.664295 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfdbde2-53cf-4f4c-9650-1ed173287e1a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:14.665927 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfdbde2-53cf-4f4c-9650-1ed173287e1a admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:14.668026 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58178758-9ecc-4133-9c3f-a8755d12fe8e admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:14.673925 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca79466-af20-41af-8d65-1f065c00e549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:14.675113 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca79466-af20-41af-8d65-1f065c00e549 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:14.675595 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca79466-af20-41af-8d65-1f065c00e549 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:14.676042 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca79466-af20-41af-8d65-1f065c00e549 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:14.677437 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 489/975] 10.222.0.15 () {56 vars in 1143 bytes} [Mon Nov 29 20:09:14 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:09:14.678541 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfdbde2-53cf-4f4c-9650-1ed173287e1a admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:14.685675 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca79466-af20-41af-8d65-1f065c00e549 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:14.688444 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca79466-af20-41af-8d65-1f065c00e549 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:14.688740 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfdbde2-53cf-4f4c-9650-1ed173287e1a admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:14.694733 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0067b60-a582-494b-b594-e3577a3fd8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:14.695616 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0067b60-a582-494b-b594-e3577a3fd8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:14.696004 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0067b60-a582-494b-b594-e3577a3fd8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:14.696347 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0067b60-a582-494b-b594-e3577a3fd8d9 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:14.697287 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0067b60-a582-494b-b594-e3577a3fd8d9 admin admin] RBAC: Adding query filter params (interface=public, service_id=f4e52ae7753a4289980096750b82a56e, region_id=RegionOne) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:14.697661 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0067b60-a582-494b-b594-e3577a3fd8d9 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:14.699443 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0067b60-a582-494b-b594-e3577a3fd8d9 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:14.706322 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 490/976] 10.222.0.15 () {56 vars in 1272 bytes} [Mon Nov 29 20:09:14 2021] GET /identity/v3/endpoints?service_id=f4e52ae7753a4289980096750b82a56e&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:09:14.707408 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-aca79466-af20-41af-8d65-1f065c00e549 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 29 20:09:14.708756 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 487/977] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:09:14 2021] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:09:14.713067 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0067b60-a582-494b-b594-e3577a3fd8d9 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:14.714667 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca79466-af20-41af-8d65-1f065c00e549 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:14.725295 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0067b60-a582-494b-b594-e3577a3fd8d9 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:14.729089 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca79466-af20-41af-8d65-1f065c00e549 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:14.735078 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e850d6-c609-431a-8c99-f4d9dc112b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:14.735448 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a42063a-9faa-4868-b2d1-da6405437d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:14.735742 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e850d6-c609-431a-8c99-f4d9dc112b45 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:14.736022 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e850d6-c609-431a-8c99-f4d9dc112b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:14.736126 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42063a-9faa-4868-b2d1-da6405437d7c admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:14.736346 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e850d6-c609-431a-8c99-f4d9dc112b45 admin admin] PATH_INFO: `/v3/services` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:14.736439 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42063a-9faa-4868-b2d1-da6405437d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:14.736625 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a42063a-9faa-4868-b2d1-da6405437d7c admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:14.737036 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e850d6-c609-431a-8c99-f4d9dc112b45 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:14.737425 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a42063a-9faa-4868-b2d1-da6405437d7c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:14.737736 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a42063a-9faa-4868-b2d1-da6405437d7c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:14.738656 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e850d6-c609-431a-8c99-f4d9dc112b45 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:14.739757 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a42063a-9faa-4868-b2d1-da6405437d7c admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:14.749806 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 491/978] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Nov 29 20:09:14 2021] GET /identity/v3/services => generated 1497 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 29 20:09:14.755960 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 488/979] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Nov 29 20:09:14 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:09:14.763072 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e850d6-c609-431a-8c99-f4d9dc112b45 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:14.774101 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e850d6-c609-431a-8c99-f4d9dc112b45 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:14.778755 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458a7bb-fba0-4b46-a511-2529bd16ca45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:14.779513 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458a7bb-fba0-4b46-a511-2529bd16ca45 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:14.779792 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458a7bb-fba0-4b46-a511-2529bd16ca45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:14.780060 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458a7bb-fba0-4b46-a511-2529bd16ca45 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:14.780912 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4458a7bb-fba0-4b46-a511-2529bd16ca45 admin admin] RBAC: Adding query filter params (role.id=0171a2b804da44c999835c4ec63cf931, scope.project.id=6f4cba10fe824640b2ed37aab02346ac, user.id=19d72c913c2b4442836a991120eec243) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:14.781219 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4458a7bb-fba0-4b46-a511-2529bd16ca45 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:14.783197 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4458a7bb-fba0-4b46-a511-2529bd16ca45 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:14.790323 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 492/980] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:09:14 2021] GET /identity/v3/role_assignments?user.id=19d72c913c2b4442836a991120eec243&scope.project.id=6f4cba10fe824640b2ed37aab02346ac&role.id=0171a2b804da44c999835c4ec63cf931 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:15.626197 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133ad72-4513-450d-9dd6-ca897483d846 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:15.626768 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133ad72-4513-450d-9dd6-ca897483d846 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:15.626768 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133ad72-4513-450d-9dd6-ca897483d846 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:15.628810 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 489/981] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:09:15.635070 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb786f9-0a78-422c-afa3-b14a2c8af05b None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:15.635522 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb786f9-0a78-422c-afa3-b14a2c8af05b None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:15.635644 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb786f9-0a78-422c-afa3-b14a2c8af05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:15.653934 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-8eb786f9-0a78-422c-afa3-b14a2c8af05b None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:15.655182 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-8eb786f9-0a78-422c-afa3-b14a2c8af05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:15.663254 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 493/982] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:15 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:09:15.686337 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133ad72-4513-450d-9dd6-ca897483d846 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:15.699151 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133ad72-4513-450d-9dd6-ca897483d846 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:15.703943 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bb9b6-052b-46f9-a652-6a0b45e74921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:15.704761 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bb9b6-052b-46f9-a652-6a0b45e74921 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:15.705037 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bb9b6-052b-46f9-a652-6a0b45e74921 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:15.705304 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bb9b6-052b-46f9-a652-6a0b45e74921 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:15.705981 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524bb9b6-052b-46f9-a652-6a0b45e74921 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:15.707645 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524bb9b6-052b-46f9-a652-6a0b45e74921 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:15.719144 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-524bb9b6-052b-46f9-a652-6a0b45e74921 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 29 20:09:15.720645 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 490/983] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:09:15 2021] GET /identity/v3/services/compute => generated 88 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:15.727111 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb786f9-0a78-422c-afa3-b14a2c8af05b None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:15.736140 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb786f9-0a78-422c-afa3-b14a2c8af05b None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:15.740661 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92015c-dcbc-4e7b-ba6f-46809f390d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:15.741313 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92015c-dcbc-4e7b-ba6f-46809f390d02 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:15.741593 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92015c-dcbc-4e7b-ba6f-46809f390d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:15.741867 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92015c-dcbc-4e7b-ba6f-46809f390d02 admin admin] PATH_INFO: `/v3/services` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:15.742586 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e92015c-dcbc-4e7b-ba6f-46809f390d02 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:15.742917 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e92015c-dcbc-4e7b-ba6f-46809f390d02 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:15.744506 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e92015c-dcbc-4e7b-ba6f-46809f390d02 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:15.749399 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 494/984] 10.222.0.15 () {56 vars in 1133 bytes} [Mon Nov 29 20:09:15 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:15.755360 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bb9b6-052b-46f9-a652-6a0b45e74921 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:15.765456 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bb9b6-052b-46f9-a652-6a0b45e74921 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:15.769947 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835e7c23-b293-40c1-b887-5bb381cf900a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:15.770600 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e7c23-b293-40c1-b887-5bb381cf900a admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:15.770899 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e7c23-b293-40c1-b887-5bb381cf900a admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:15.771182 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835e7c23-b293-40c1-b887-5bb381cf900a admin admin] PATH_INFO: `/v3/services` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:15.771906 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e7c23-b293-40c1-b887-5bb381cf900a admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:15.772209 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e7c23-b293-40c1-b887-5bb381cf900a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:15.773796 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835e7c23-b293-40c1-b887-5bb381cf900a admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:15.778642 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 491/985] 10.222.0.15 () {56 vars in 1133 bytes} [Mon Nov 29 20:09:15 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:16.899478 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3ddf5-7b0a-420d-88fc-430418ca4acd None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:16.900139 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3ddf5-7b0a-420d-88fc-430418ca4acd None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:16.900139 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3ddf5-7b0a-420d-88fc-430418ca4acd None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:16.902064 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 495/986] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:09:16.908236 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f36c9-ec79-4935-93f2-7009d757f66b None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:16.908760 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f36c9-ec79-4935-93f2-7009d757f66b None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:16.908760 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f36c9-ec79-4935-93f2-7009d757f66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:16.927206 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-f39f36c9-ec79-4935-93f2-7009d757f66b None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:16.928406 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-f39f36c9-ec79-4935-93f2-7009d757f66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:16.936577 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 492/987] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:16 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:09:16.961052 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3ddf5-7b0a-420d-88fc-430418ca4acd None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:16.973411 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3ddf5-7b0a-420d-88fc-430418ca4acd None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:16.977808 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cbb865-4539-49fb-a675-17fed74aca39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:16.978458 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbb865-4539-49fb-a675-17fed74aca39 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:16.978735 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbb865-4539-49fb-a675-17fed74aca39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:16.979036 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbb865-4539-49fb-a675-17fed74aca39 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:16.979757 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cbb865-4539-49fb-a675-17fed74aca39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:16.981596 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cbb865-4539-49fb-a675-17fed74aca39 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:16.982973 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.common [None req-b3cbb865-4539-49fb-a675-17fed74aca39 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Nov 29 20:09:17.001852 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.sql.core [None req-b3cbb865-4539-49fb-a675-17fed74aca39 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Nov 29 20:09:17.001852 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Nov 29 20:09:17.001852 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [parameters: {'id': '802745cf06f645ee969ef231e039a74a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Nov 29 20:09:17.001852 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79167) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 29 20:09:17.008644 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-b3cbb865-4539-49fb-a675-17fed74aca39 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 802745cf06f645ee969ef231e039a74a.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 802745cf06f645ee969ef231e039a74a. Nov 29 20:09:17.010299 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 496/988] 10.222.0.15 () {60 vars in 1161 bytes} [Mon Nov 29 20:09:16 2021] POST /identity/v3/projects => generated 262 bytes in 50 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:17.016995 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f36c9-ec79-4935-93f2-7009d757f66b None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:17.026569 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f36c9-ec79-4935-93f2-7009d757f66b None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:17.031342 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b4b71-7967-4822-8c28-4bc60e3a95f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:17.032232 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b4b71-7967-4822-8c28-4bc60e3a95f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:17.032513 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b4b71-7967-4822-8c28-4bc60e3a95f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:17.032786 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b4b71-7967-4822-8c28-4bc60e3a95f9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:17.040161 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b4b71-7967-4822-8c28-4bc60e3a95f9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:17.042132 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b4b71-7967-4822-8c28-4bc60e3a95f9 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:17.055435 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-967b4b71-7967-4822-8c28-4bc60e3a95f9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 29 20:09:17.056929 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 493/989] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:09:17 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:09:17.063572 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cbb865-4539-49fb-a675-17fed74aca39 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:17.074690 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cbb865-4539-49fb-a675-17fed74aca39 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:17.079330 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0b3e3-c8a7-4880-8640-7dd93cb63fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:17.079917 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0b3e3-c8a7-4880-8640-7dd93cb63fef admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:17.080195 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0b3e3-c8a7-4880-8640-7dd93cb63fef admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:17.080467 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0b3e3-c8a7-4880-8640-7dd93cb63fef admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:17.081235 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da0b3e3-c8a7-4880-8640-7dd93cb63fef admin admin] RBAC: Adding query filter params (name=service) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:17.081539 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da0b3e3-c8a7-4880-8640-7dd93cb63fef admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:17.083708 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da0b3e3-c8a7-4880-8640-7dd93cb63fef admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:17.104827 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 497/990] 10.222.0.15 () {56 vars in 1133 bytes} [Mon Nov 29 20:09:17 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:17.173648 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8b587-1cc1-445c-b7b4-4a7fa48b544d None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:17.173984 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8b587-1cc1-445c-b7b4-4a7fa48b544d None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:17.174189 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8b587-1cc1-445c-b7b4-4a7fa48b544d None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:17.176470 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 494/991] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:09:17.183183 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d572124-ff99-4a10-a6e3-03fc9079d54a None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:17.183506 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d572124-ff99-4a10-a6e3-03fc9079d54a None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:17.183729 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d572124-ff99-4a10-a6e3-03fc9079d54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:17.204051 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-2d572124-ff99-4a10-a6e3-03fc9079d54a None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:17.205605 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-2d572124-ff99-4a10-a6e3-03fc9079d54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:17.214494 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 498/992] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:17 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:09:17.238984 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8b587-1cc1-445c-b7b4-4a7fa48b544d None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:17.248020 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557552a-1e23-48af-aa15-c6e8cda18b3e None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:17.248359 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557552a-1e23-48af-aa15-c6e8cda18b3e None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:17.248586 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557552a-1e23-48af-aa15-c6e8cda18b3e None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:17.250896 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 499/993] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 29 20:09:17.257589 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8b587-1cc1-445c-b7b4-4a7fa48b544d None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:17.258291 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8d89a-dfd4-4492-9f23-a29e6b0bc93b None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:17.258585 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8d89a-dfd4-4492-9f23-a29e6b0bc93b None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:17.258893 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8d89a-dfd4-4492-9f23-a29e6b0bc93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:17.263215 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b69524-2a23-4d0c-adf1-bcb337028183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:17.264359 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b69524-2a23-4d0c-adf1-bcb337028183 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:17.265177 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b69524-2a23-4d0c-adf1-bcb337028183 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:17.265653 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b69524-2a23-4d0c-adf1-bcb337028183 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:17.266564 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b69524-2a23-4d0c-adf1-bcb337028183 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:17.268384 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b69524-2a23-4d0c-adf1-bcb337028183 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:17.279482 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-a5e8d89a-dfd4-4492-9f23-a29e6b0bc93b None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:17.280772 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-a5e8d89a-dfd4-4492-9f23-a29e6b0bc93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:17.281108 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-b8b69524-2a23-4d0c-adf1-bcb337028183 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 29 20:09:17.288366 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 495/994] 10.222.0.15 () {56 vars in 1147 bytes} [Mon Nov 29 20:09:17 2021] GET /identity/v3/services/object-store => generated 93 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:17.289156 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 500/995] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:17 2021] POST /identity/v3/auth/tokens => generated 2138 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:09:17.290422 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b69524-2a23-4d0c-adf1-bcb337028183 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:17.304773 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b69524-2a23-4d0c-adf1-bcb337028183 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:17.310101 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5148433-4b58-4576-9b20-9cb25367f47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:17.311132 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5148433-4b58-4576-9b20-9cb25367f47c admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:17.311730 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5148433-4b58-4576-9b20-9cb25367f47c admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:17.312227 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5148433-4b58-4576-9b20-9cb25367f47c admin admin] PATH_INFO: `/v3/services` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:17.313304 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5148433-4b58-4576-9b20-9cb25367f47c admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:17.313832 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5148433-4b58-4576-9b20-9cb25367f47c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:17.316044 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5148433-4b58-4576-9b20-9cb25367f47c admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:17.316394 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8d89a-dfd4-4492-9f23-a29e6b0bc93b None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:17.326878 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 496/996] 10.222.0.15 () {56 vars in 1143 bytes} [Mon Nov 29 20:09:17 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:17.327070 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8d89a-dfd4-4492-9f23-a29e6b0bc93b None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:17.329207 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5148433-4b58-4576-9b20-9cb25367f47c admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:17.332043 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e970cc-f736-4f62-96f6-342843b99eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:17.332804 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e970cc-f736-4f62-96f6-342843b99eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:17.333085 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e970cc-f736-4f62-96f6-342843b99eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:17.333359 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e970cc-f736-4f62-96f6-342843b99eb0 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:17.334031 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e970cc-f736-4f62-96f6-342843b99eb0 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:17.335686 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e970cc-f736-4f62-96f6-342843b99eb0 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:17.341495 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5148433-4b58-4576-9b20-9cb25367f47c admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:17.346485 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91401002-22b4-47de-9c65-d2a003a13896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:17.347414 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91401002-22b4-47de-9c65-d2a003a13896 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:17.347873 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91401002-22b4-47de-9c65-d2a003a13896 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:17.348411 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91401002-22b4-47de-9c65-d2a003a13896 admin admin] PATH_INFO: `/v3/services` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:17.349003 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-46e970cc-f736-4f62-96f6-342843b99eb0 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 29 20:09:17.349527 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91401002-22b4-47de-9c65-d2a003a13896 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:17.350037 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91401002-22b4-47de-9c65-d2a003a13896 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:17.350486 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 501/997] 10.222.0.15 () {56 vars in 1126 bytes} [Mon Nov 29 20:09:17 2021] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:09:17.352196 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91401002-22b4-47de-9c65-d2a003a13896 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:17.357593 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e970cc-f736-4f62-96f6-342843b99eb0 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:17.364731 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 497/998] 10.222.0.15 () {56 vars in 1143 bytes} [Mon Nov 29 20:09:17 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:17.365962 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91401002-22b4-47de-9c65-d2a003a13896 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:17.368487 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e970cc-f736-4f62-96f6-342843b99eb0 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:17.373926 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc94ad7-bb90-4da1-ba3a-3eaabb77ecd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:17.377064 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc94ad7-bb90-4da1-ba3a-3eaabb77ecd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:17.377064 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc94ad7-bb90-4da1-ba3a-3eaabb77ecd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:17.377064 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc94ad7-bb90-4da1-ba3a-3eaabb77ecd0 admin admin] PATH_INFO: `/v3/services` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:17.377064 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc94ad7-bb90-4da1-ba3a-3eaabb77ecd0 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:17.377064 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc94ad7-bb90-4da1-ba3a-3eaabb77ecd0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:17.377423 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91401002-22b4-47de-9c65-d2a003a13896 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:17.378058 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc94ad7-bb90-4da1-ba3a-3eaabb77ecd0 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:17.381118 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f1f5e-86f8-4a05-aceb-ede7ffd41423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:17.381750 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f1f5e-86f8-4a05-aceb-ede7ffd41423 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:17.382085 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f1f5e-86f8-4a05-aceb-ede7ffd41423 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:17.382364 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f1f5e-86f8-4a05-aceb-ede7ffd41423 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:17.383109 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99f1f5e-86f8-4a05-aceb-ede7ffd41423 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:17.384310 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 502/999] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:09:17 2021] GET /identity/v3/services?name=image => generated 122 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:17.384659 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99f1f5e-86f8-4a05-aceb-ede7ffd41423 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:17.392518 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc94ad7-bb90-4da1-ba3a-3eaabb77ecd0 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:17.404543 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc94ad7-bb90-4da1-ba3a-3eaabb77ecd0 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:17.409585 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b4128-b3ac-44c6-aa18-722a0b1cadce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:17.410262 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 498/1000] 10.222.0.15 () {60 vars in 1165 bytes} [Mon Nov 29 20:09:17 2021] POST /identity/v3/endpoints => generated 349 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 29 20:09:17.410383 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b4128-b3ac-44c6-aa18-722a0b1cadce admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:17.411276 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b4128-b3ac-44c6-aa18-722a0b1cadce admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:17.412038 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b4128-b3ac-44c6-aa18-722a0b1cadce admin admin] PATH_INFO: `/v3/services` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:17.412934 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b4128-b3ac-44c6-aa18-722a0b1cadce admin admin] RBAC: Adding query filter params (type=image) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:17.413266 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b4128-b3ac-44c6-aa18-722a0b1cadce admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:17.414967 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b4128-b3ac-44c6-aa18-722a0b1cadce admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:17.421038 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 503/1001] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:09:17 2021] GET /identity/v3/services?type=image => generated 122 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:18.147737 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c960a-6a64-4c59-9b59-6798ce1cfa39 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:18.148250 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c960a-6a64-4c59-9b59-6798ce1cfa39 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:18.148250 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c960a-6a64-4c59-9b59-6798ce1cfa39 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:18.150199 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 499/1002] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:09:18.156189 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9668dac-bbbf-4bbb-997a-2674202f02e4 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:18.156663 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9668dac-bbbf-4bbb-997a-2674202f02e4 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:18.156835 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9668dac-bbbf-4bbb-997a-2674202f02e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:18.174372 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-d9668dac-bbbf-4bbb-997a-2674202f02e4 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:18.175572 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-d9668dac-bbbf-4bbb-997a-2674202f02e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:18.192537 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 504/1003] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:18 2021] POST /identity/v3/auth/tokens => generated 2327 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:09:18.215773 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c960a-6a64-4c59-9b59-6798ce1cfa39 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:18.227875 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c960a-6a64-4c59-9b59-6798ce1cfa39 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:18.232292 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37935f-1e6a-4038-978b-571007d50f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:18.232940 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37935f-1e6a-4038-978b-571007d50f30 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:18.233216 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37935f-1e6a-4038-978b-571007d50f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:18.233488 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37935f-1e6a-4038-978b-571007d50f30 admin admin] PATH_INFO: `/v3/services` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:18.234232 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab37935f-1e6a-4038-978b-571007d50f30 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:18.235901 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab37935f-1e6a-4038-978b-571007d50f30 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:18.253592 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 500/1004] 10.222.0.15 () {60 vars in 1162 bytes} [Mon Nov 29 20:09:18 2021] POST /identity/v3/services => generated 242 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:09:19.611116 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b82eab-fc0e-4039-978b-c242ab0ee2cc None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:19.611660 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b82eab-fc0e-4039-978b-c242ab0ee2cc None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:19.611953 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b82eab-fc0e-4039-978b-c242ab0ee2cc None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:19.614163 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 505/1005] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:09:19.620528 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a31b98-79e4-44da-bbb7-1b5352bc30dd None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:19.620971 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a31b98-79e4-44da-bbb7-1b5352bc30dd None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:19.621165 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a31b98-79e4-44da-bbb7-1b5352bc30dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:19.642074 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-29a31b98-79e4-44da-bbb7-1b5352bc30dd None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:19.643300 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-29a31b98-79e4-44da-bbb7-1b5352bc30dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:19.660003 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 501/1006] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:19 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:09:19.685389 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b82eab-fc0e-4039-978b-c242ab0ee2cc None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:19.697928 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b82eab-fc0e-4039-978b-c242ab0ee2cc None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:19.702407 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09e139-94e9-479b-8ed6-02453b76b91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:19.703121 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09e139-94e9-479b-8ed6-02453b76b91b admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:19.703428 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09e139-94e9-479b-8ed6-02453b76b91b admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:19.703738 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc09e139-94e9-479b-8ed6-02453b76b91b admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:19.704456 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09e139-94e9-479b-8ed6-02453b76b91b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:19.706312 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc09e139-94e9-479b-8ed6-02453b76b91b admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:19.721105 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.sql.core [None req-cc09e139-94e9-479b-8ed6-02453b76b91b admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Nov 29 20:09:19.721105 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Nov 29 20:09:19.721105 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [parameters: {'user_id': 'fb366c798be24c79abfee0a4928d6079', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Nov 29 20:09:19.721105 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79167) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Nov 29 20:09:19.727404 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-cc09e139-94e9-479b-8ed6-02453b76b91b admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Nov 29 20:09:19.734323 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 506/1007] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:09:19 2021] POST /identity/v3/users => generated 160 bytes in 44 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:19.735769 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a31b98-79e4-44da-bbb7-1b5352bc30dd None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:19.747706 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a31b98-79e4-44da-bbb7-1b5352bc30dd None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:19.752739 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e9fa59-3c92-4778-8025-43aa0e9ca2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:19.753760 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9fa59-3c92-4778-8025-43aa0e9ca2ed admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:19.754221 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9fa59-3c92-4778-8025-43aa0e9ca2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:19.754686 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e9fa59-3c92-4778-8025-43aa0e9ca2ed admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:19.762621 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e9fa59-3c92-4778-8025-43aa0e9ca2ed admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:19.765292 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e9fa59-3c92-4778-8025-43aa0e9ca2ed admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:19.779739 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-67e9fa59-3c92-4778-8025-43aa0e9ca2ed admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Nov 29 20:09:19.785142 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 502/1008] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:09:19 2021] GET /identity/v3/users/cinder => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:09:19.788373 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09e139-94e9-479b-8ed6-02453b76b91b admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:19.801058 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc09e139-94e9-479b-8ed6-02453b76b91b admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:19.806116 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682ece6-d7fb-4d59-af12-cff5a4ed3d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:19.807041 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682ece6-d7fb-4d59-af12-cff5a4ed3d88 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:19.807519 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682ece6-d7fb-4d59-af12-cff5a4ed3d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:19.807970 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682ece6-d7fb-4d59-af12-cff5a4ed3d88 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:19.808957 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f682ece6-d7fb-4d59-af12-cff5a4ed3d88 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:19.809503 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f682ece6-d7fb-4d59-af12-cff5a4ed3d88 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:19.811822 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f682ece6-d7fb-4d59-af12-cff5a4ed3d88 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:19.816796 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df618f18-31fe-4a8b-beab-4faf51d6ea60 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:19.817086 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df618f18-31fe-4a8b-beab-4faf51d6ea60 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:19.817364 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df618f18-31fe-4a8b-beab-4faf51d6ea60 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:19.819322 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 503/1009] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 29 20:09:19.820257 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cb255-c017-468b-9558-e1660d6b6834 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:19.820548 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cb255-c017-468b-9558-e1660d6b6834 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:19.820824 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cb255-c017-468b-9558-e1660d6b6834 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:19.822475 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 504/1010] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:09:19.831395 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ad91b-0884-4509-b54e-2723ebc22c9e None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:19.831681 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ad91b-0884-4509-b54e-2723ebc22c9e None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:19.831953 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ad91b-0884-4509-b54e-2723ebc22c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:19.849291 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-107ad91b-0884-4509-b54e-2723ebc22c9e None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:19.850481 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-107ad91b-0884-4509-b54e-2723ebc22c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:19.854969 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 507/1011] 10.222.0.15 () {56 vars in 1122 bytes} [Mon Nov 29 20:09:19 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:19.854969 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650467c-49f6-49af-9440-ef1e01e27f76 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:19.854969 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650467c-49f6-49af-9440-ef1e01e27f76 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:19.854969 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650467c-49f6-49af-9440-ef1e01e27f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:19.864664 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 505/1012] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:19 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:09:19.876215 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-3650467c-49f6-49af-9440-ef1e01e27f76 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:19.877901 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-3650467c-49f6-49af-9440-ef1e01e27f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:19.886514 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 508/1013] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:19 2021] POST /identity/v3/auth/tokens => generated 2423 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:09:19.890070 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ad91b-0884-4509-b54e-2723ebc22c9e None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:19.899613 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ad91b-0884-4509-b54e-2723ebc22c9e None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:19.904523 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1a99b-ddd7-4cd4-83f3-ca10ed2eebdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:19.905514 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1a99b-ddd7-4cd4-83f3-ca10ed2eebdc admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:19.905792 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1a99b-ddd7-4cd4-83f3-ca10ed2eebdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:19.906063 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f1a99b-ddd7-4cd4-83f3-ca10ed2eebdc admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:19.906863 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f1a99b-ddd7-4cd4-83f3-ca10ed2eebdc admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:19.908640 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f1a99b-ddd7-4cd4-83f3-ca10ed2eebdc admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:19.910789 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650467c-49f6-49af-9440-ef1e01e27f76 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:19.921246 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650467c-49f6-49af-9440-ef1e01e27f76 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:19.927248 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd86ae1-c734-4d97-a65d-3a3610c6982c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:19.928373 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd86ae1-c734-4d97-a65d-3a3610c6982c admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:19.928851 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd86ae1-c734-4d97-a65d-3a3610c6982c admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:19.929312 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd86ae1-c734-4d97-a65d-3a3610c6982c admin admin] PATH_INFO: `/v3/services` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:19.930353 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd86ae1-c734-4d97-a65d-3a3610c6982c admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:19.930486 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-52f1a99b-ddd7-4cd4-83f3-ca10ed2eebdc admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 29 20:09:19.932030 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 506/1014] 10.222.0.15 () {56 vars in 1147 bytes} [Mon Nov 29 20:09:19 2021] GET /identity/v3/services/object-store => generated 93 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:19.938233 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd86ae1-c734-4d97-a65d-3a3610c6982c admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:19.939236 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1a99b-ddd7-4cd4-83f3-ca10ed2eebdc admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:19.950242 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f1a99b-ddd7-4cd4-83f3-ca10ed2eebdc admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:19.955895 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f3bc6-d51b-41ef-9e10-e18c8d99de3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:19.956665 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f3bc6-d51b-41ef-9e10-e18c8d99de3e admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:19.956996 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f3bc6-d51b-41ef-9e10-e18c8d99de3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:19.957283 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f3bc6-d51b-41ef-9e10-e18c8d99de3e admin admin] PATH_INFO: `/v3/services` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:19.958079 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517f3bc6-d51b-41ef-9e10-e18c8d99de3e admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:19.958437 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517f3bc6-d51b-41ef-9e10-e18c8d99de3e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:19.958682 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 509/1015] 10.222.0.15 () {60 vars in 1162 bytes} [Mon Nov 29 20:09:19 2021] POST /identity/v3/services => generated 242 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 29 20:09:19.964801 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517f3bc6-d51b-41ef-9e10-e18c8d99de3e admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:19.971601 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 507/1016] 10.222.0.15 () {56 vars in 1143 bytes} [Mon Nov 29 20:09:19 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:09:19.978600 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd86ae1-c734-4d97-a65d-3a3610c6982c admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:20.002813 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd86ae1-c734-4d97-a65d-3a3610c6982c admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:20.008136 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaeb3f6-647a-40c4-ab47-d28eb48cf1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:20.009173 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaeb3f6-647a-40c4-ab47-d28eb48cf1bf admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:20.009641 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaeb3f6-647a-40c4-ab47-d28eb48cf1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:20.010088 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaeb3f6-647a-40c4-ab47-d28eb48cf1bf admin admin] PATH_INFO: `/v3/services` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:20.011043 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaeb3f6-647a-40c4-ab47-d28eb48cf1bf admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:20.011553 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaeb3f6-647a-40c4-ab47-d28eb48cf1bf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:20.013431 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaeb3f6-647a-40c4-ab47-d28eb48cf1bf admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:20.021139 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 510/1017] 10.222.0.15 () {56 vars in 1143 bytes} [Mon Nov 29 20:09:19 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:20.028074 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f3bc6-d51b-41ef-9e10-e18c8d99de3e admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:20.039241 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f3bc6-d51b-41ef-9e10-e18c8d99de3e admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:20.044393 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065a650-b9ae-438f-b2da-56f1405d7c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:20.045203 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065a650-b9ae-438f-b2da-56f1405d7c35 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:20.045618 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065a650-b9ae-438f-b2da-56f1405d7c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:20.045962 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065a650-b9ae-438f-b2da-56f1405d7c35 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:20.047024 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065a650-b9ae-438f-b2da-56f1405d7c35 admin admin] RBAC: Adding query filter params (interface=admin, service_id=f4e52ae7753a4289980096750b82a56e, region_id=RegionOne) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:20.047447 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065a650-b9ae-438f-b2da-56f1405d7c35 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:20.049285 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065a650-b9ae-438f-b2da-56f1405d7c35 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:20.061280 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 508/1018] 10.222.0.15 () {56 vars in 1270 bytes} [Mon Nov 29 20:09:20 2021] GET /identity/v3/endpoints?service_id=f4e52ae7753a4289980096750b82a56e&interface=admin®ion_id=RegionOne => generated 193 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:20.062717 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaeb3f6-647a-40c4-ab47-d28eb48cf1bf admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:20.077488 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaeb3f6-647a-40c4-ab47-d28eb48cf1bf admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:20.083035 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbca7b9-c9b0-4958-8c43-c7ad7cd5adf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:20.084167 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbca7b9-c9b0-4958-8c43-c7ad7cd5adf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:20.084677 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbca7b9-c9b0-4958-8c43-c7ad7cd5adf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:20.085199 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbca7b9-c9b0-4958-8c43-c7ad7cd5adf1 admin admin] PATH_INFO: `/v3/services` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:20.086157 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbca7b9-c9b0-4958-8c43-c7ad7cd5adf1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:20.088224 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbca7b9-c9b0-4958-8c43-c7ad7cd5adf1 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:20.103070 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 511/1019] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Nov 29 20:09:20 2021] GET /identity/v3/services => generated 1957 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:09:20.622330 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2a987-7261-4bff-b148-87c643a47b83 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:20.623094 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2a987-7261-4bff-b148-87c643a47b83 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:20.623094 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2a987-7261-4bff-b148-87c643a47b83 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:20.624858 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 509/1020] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:09:20.630357 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac31f68-7c1a-47e9-aac3-2dc55fe4aa89 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:20.630762 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac31f68-7c1a-47e9-aac3-2dc55fe4aa89 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:20.630974 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac31f68-7c1a-47e9-aac3-2dc55fe4aa89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:20.649208 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-3ac31f68-7c1a-47e9-aac3-2dc55fe4aa89 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:20.650367 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-3ac31f68-7c1a-47e9-aac3-2dc55fe4aa89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:20.658553 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 512/1021] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:20 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:09:20.680958 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2a987-7261-4bff-b148-87c643a47b83 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:20.693435 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2a987-7261-4bff-b148-87c643a47b83 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:20.698198 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22567751-a8d5-4762-8234-a46343c86d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:20.698994 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22567751-a8d5-4762-8234-a46343c86d72 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:20.699235 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22567751-a8d5-4762-8234-a46343c86d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:20.699531 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22567751-a8d5-4762-8234-a46343c86d72 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:20.700198 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22567751-a8d5-4762-8234-a46343c86d72 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:20.701773 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22567751-a8d5-4762-8234-a46343c86d72 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:20.712562 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-22567751-a8d5-4762-8234-a46343c86d72 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 29 20:09:20.713919 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 510/1022] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:09:20 2021] GET /identity/v3/services/compute => generated 88 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:09:20.720207 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac31f68-7c1a-47e9-aac3-2dc55fe4aa89 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:20.729119 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac31f68-7c1a-47e9-aac3-2dc55fe4aa89 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:20.733959 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5637ca5-84d4-4cb5-804e-6b30eb2a5c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:20.734602 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5637ca5-84d4-4cb5-804e-6b30eb2a5c4c admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:20.734962 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5637ca5-84d4-4cb5-804e-6b30eb2a5c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:20.735236 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5637ca5-84d4-4cb5-804e-6b30eb2a5c4c admin admin] PATH_INFO: `/v3/services` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:20.735944 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5637ca5-84d4-4cb5-804e-6b30eb2a5c4c admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:20.736242 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5637ca5-84d4-4cb5-804e-6b30eb2a5c4c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:20.737815 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5637ca5-84d4-4cb5-804e-6b30eb2a5c4c admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:20.746889 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 513/1023] 10.222.0.15 () {56 vars in 1133 bytes} [Mon Nov 29 20:09:20 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:20.749094 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22567751-a8d5-4762-8234-a46343c86d72 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:20.759916 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22567751-a8d5-4762-8234-a46343c86d72 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:20.765070 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51862b-cdb0-4853-97e5-79c44440fb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:20.765710 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51862b-cdb0-4853-97e5-79c44440fb6a admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:20.765991 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51862b-cdb0-4853-97e5-79c44440fb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:20.766264 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51862b-cdb0-4853-97e5-79c44440fb6a admin admin] PATH_INFO: `/v3/services` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:20.767012 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51862b-cdb0-4853-97e5-79c44440fb6a admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:20.767331 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51862b-cdb0-4853-97e5-79c44440fb6a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:20.769056 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac51862b-cdb0-4853-97e5-79c44440fb6a admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:20.774149 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 511/1024] 10.222.0.15 () {56 vars in 1133 bytes} [Mon Nov 29 20:09:20 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:20.780528 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5637ca5-84d4-4cb5-804e-6b30eb2a5c4c admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:20.790063 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5637ca5-84d4-4cb5-804e-6b30eb2a5c4c admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:20.794795 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305b360-5d09-4023-b309-dccd999aa6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:20.795553 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305b360-5d09-4023-b309-dccd999aa6cc admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:20.795891 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305b360-5d09-4023-b309-dccd999aa6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:20.796208 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305b360-5d09-4023-b309-dccd999aa6cc admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:20.797068 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1305b360-5d09-4023-b309-dccd999aa6cc admin admin] RBAC: Adding query filter params (interface=public, service_id=c9259139ec474424a7cf2e9bdd1d0905, region_id=RegionOne) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:20.797461 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1305b360-5d09-4023-b309-dccd999aa6cc admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:20.799129 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1305b360-5d09-4023-b309-dccd999aa6cc admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:20.805525 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 514/1025] 10.222.0.15 () {56 vars in 1272 bytes} [Mon Nov 29 20:09:20 2021] GET /identity/v3/endpoints?service_id=c9259139ec474424a7cf2e9bdd1d0905&interface=public®ion_id=RegionOne => generated 194 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:20.811132 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51862b-cdb0-4853-97e5-79c44440fb6a admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:20.820212 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51862b-cdb0-4853-97e5-79c44440fb6a admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:20.824670 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a50505-4aba-4b84-9d83-4dcd0e57823d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:20.825324 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a50505-4aba-4b84-9d83-4dcd0e57823d admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:20.825601 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a50505-4aba-4b84-9d83-4dcd0e57823d admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:20.825872 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a50505-4aba-4b84-9d83-4dcd0e57823d admin admin] PATH_INFO: `/v3/services` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:20.826560 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a50505-4aba-4b84-9d83-4dcd0e57823d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:20.828168 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a50505-4aba-4b84-9d83-4dcd0e57823d admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:20.834824 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 512/1026] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Nov 29 20:09:20 2021] GET /identity/v3/services => generated 1957 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:09:22.348435 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c097e-daf5-4fd5-8faa-e78dcf05f26c None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:22.349018 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c097e-daf5-4fd5-8faa-e78dcf05f26c None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:22.349018 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c097e-daf5-4fd5-8faa-e78dcf05f26c None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:22.352187 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 515/1027] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:09:22.356850 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290dd1fd-b1e5-45e2-8dd5-57cb518d525c None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:22.357271 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290dd1fd-b1e5-45e2-8dd5-57cb518d525c None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:22.357435 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290dd1fd-b1e5-45e2-8dd5-57cb518d525c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:22.375481 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-290dd1fd-b1e5-45e2-8dd5-57cb518d525c None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:22.376693 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-290dd1fd-b1e5-45e2-8dd5-57cb518d525c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:22.384733 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 513/1028] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:22 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:09:22.408430 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c097e-daf5-4fd5-8faa-e78dcf05f26c None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:22.421119 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c097e-daf5-4fd5-8faa-e78dcf05f26c None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:22.425988 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9374c5f-3d47-483c-8327-78ae6b00f1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:22.426768 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9374c5f-3d47-483c-8327-78ae6b00f1b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:22.427071 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9374c5f-3d47-483c-8327-78ae6b00f1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:22.427337 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9374c5f-3d47-483c-8327-78ae6b00f1b9 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:22.427985 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9374c5f-3d47-483c-8327-78ae6b00f1b9 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:22.429710 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9374c5f-3d47-483c-8327-78ae6b00f1b9 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:22.440792 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-b9374c5f-3d47-483c-8327-78ae6b00f1b9 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 29 20:09:22.442199 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 516/1029] 10.222.0.15 () {56 vars in 1126 bytes} [Mon Nov 29 20:09:22 2021] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:22.448734 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290dd1fd-b1e5-45e2-8dd5-57cb518d525c None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:22.454938 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e4020-d96f-4935-8d7c-de82abd9bdfb None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:22.455218 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e4020-d96f-4935-8d7c-de82abd9bdfb None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:22.455492 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e4020-d96f-4935-8d7c-de82abd9bdfb None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:22.457397 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 517/1030] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 29 20:09:22.458266 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290dd1fd-b1e5-45e2-8dd5-57cb518d525c None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:22.463072 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be039a4-d57e-43a5-8e10-d0f39cb12ee8 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:22.463313 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be039a4-d57e-43a5-8e10-d0f39cb12ee8 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:22.463585 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be039a4-d57e-43a5-8e10-d0f39cb12ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:22.463686 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5210fc7-cd83-4e14-87a5-9b335b49e36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:22.464269 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5210fc7-cd83-4e14-87a5-9b335b49e36e admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:22.464551 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5210fc7-cd83-4e14-87a5-9b335b49e36e admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:22.464884 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5210fc7-cd83-4e14-87a5-9b335b49e36e admin admin] PATH_INFO: `/v3/services` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:22.465545 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5210fc7-cd83-4e14-87a5-9b335b49e36e admin admin] RBAC: Adding query filter params (name=image) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:22.465915 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5210fc7-cd83-4e14-87a5-9b335b49e36e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:22.467549 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5210fc7-cd83-4e14-87a5-9b335b49e36e admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:22.477880 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 514/1031] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:09:22 2021] GET /identity/v3/services?name=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:09:22.478943 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5210fc7-cd83-4e14-87a5-9b335b49e36e admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:22.481368 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-5be039a4-d57e-43a5-8e10-d0f39cb12ee8 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:22.482553 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-5be039a4-d57e-43a5-8e10-d0f39cb12ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:22.488656 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5210fc7-cd83-4e14-87a5-9b335b49e36e admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:22.491357 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 518/1032] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:22 2021] POST /identity/v3/auth/tokens => generated 2519 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:09:22.493489 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c05336-8ad8-4442-848f-431fb9923a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:22.494346 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c05336-8ad8-4442-848f-431fb9923a42 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:22.494812 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c05336-8ad8-4442-848f-431fb9923a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:22.495290 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c05336-8ad8-4442-848f-431fb9923a42 admin admin] PATH_INFO: `/v3/services` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:22.496175 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c05336-8ad8-4442-848f-431fb9923a42 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:22.496670 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c05336-8ad8-4442-848f-431fb9923a42 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:22.498396 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c05336-8ad8-4442-848f-431fb9923a42 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:22.503604 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 515/1033] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:09:22 2021] GET /identity/v3/services?type=image => generated 350 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:22.509505 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be039a4-d57e-43a5-8e10-d0f39cb12ee8 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:22.515538 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c05336-8ad8-4442-848f-431fb9923a42 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:22.519604 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be039a4-d57e-43a5-8e10-d0f39cb12ee8 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:22.525409 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd09ba3-06df-44d9-a886-39c10f46d68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:22.525542 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c05336-8ad8-4442-848f-431fb9923a42 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:22.526073 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd09ba3-06df-44d9-a886-39c10f46d68f admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:22.526327 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd09ba3-06df-44d9-a886-39c10f46d68f admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:22.526590 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd09ba3-06df-44d9-a886-39c10f46d68f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:22.527459 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd09ba3-06df-44d9-a886-39c10f46d68f admin admin] RBAC: Adding query filter params (interface=public, service_id=6b56281001b343fe91096af7cbe76716, region_id=RegionOne) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:22.527768 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd09ba3-06df-44d9-a886-39c10f46d68f admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:22.529347 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd09ba3-06df-44d9-a886-39c10f46d68f admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:22.530117 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b46c8-d925-49d7-97ed-b2b643e8e3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:22.530960 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b46c8-d925-49d7-97ed-b2b643e8e3bf admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:22.531243 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b46c8-d925-49d7-97ed-b2b643e8e3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:22.531515 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b46c8-d925-49d7-97ed-b2b643e8e3bf admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:22.532275 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b46c8-d925-49d7-97ed-b2b643e8e3bf admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:22.533844 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b46c8-d925-49d7-97ed-b2b643e8e3bf admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:22.535070 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 519/1034] 10.222.0.15 () {56 vars in 1272 bytes} [Mon Nov 29 20:09:22 2021] GET /identity/v3/endpoints?service_id=6b56281001b343fe91096af7cbe76716&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:22.540710 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd09ba3-06df-44d9-a886-39c10f46d68f admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:22.545069 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-fa4b46c8-d925-49d7-97ed-b2b643e8e3bf admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Nov 29 20:09:22.547458 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 516/1035] 10.222.0.15 () {56 vars in 1147 bytes} [Mon Nov 29 20:09:22 2021] GET /identity/v3/services/object-store => generated 93 bytes in 31 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:22.550781 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd09ba3-06df-44d9-a886-39c10f46d68f admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:22.553057 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b46c8-d925-49d7-97ed-b2b643e8e3bf admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:22.555905 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a9ae6e-dd99-4731-8967-690553793f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:22.556545 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9ae6e-dd99-4731-8967-690553793f5b admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:22.556819 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9ae6e-dd99-4731-8967-690553793f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:22.557086 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9ae6e-dd99-4731-8967-690553793f5b admin admin] PATH_INFO: `/v3/services` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:22.557909 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a9ae6e-dd99-4731-8967-690553793f5b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:22.559346 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a9ae6e-dd99-4731-8967-690553793f5b admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:22.562612 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b46c8-d925-49d7-97ed-b2b643e8e3bf admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:22.566509 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 520/1036] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Nov 29 20:09:22 2021] GET /identity/v3/services => generated 1957 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:09:22.575984 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fe82f-bb6a-4d99-9809-2b5a4ec93cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:22.576683 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fe82f-bb6a-4d99-9809-2b5a4ec93cbf admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:22.576965 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fe82f-bb6a-4d99-9809-2b5a4ec93cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:22.577238 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fe82f-bb6a-4d99-9809-2b5a4ec93cbf admin admin] PATH_INFO: `/v3/services` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:22.577985 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fe82f-bb6a-4d99-9809-2b5a4ec93cbf admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:22.578290 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fe82f-bb6a-4d99-9809-2b5a4ec93cbf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:22.580011 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fe82f-bb6a-4d99-9809-2b5a4ec93cbf admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:22.585962 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 517/1037] 10.222.0.15 () {56 vars in 1143 bytes} [Mon Nov 29 20:09:22 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:09:22.592568 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a9ae6e-dd99-4731-8967-690553793f5b admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:22.602765 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a9ae6e-dd99-4731-8967-690553793f5b admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:22.607318 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa83a1b-eadb-4698-8738-0ad2d52d8ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:22.607995 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa83a1b-eadb-4698-8738-0ad2d52d8ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:22.608273 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa83a1b-eadb-4698-8738-0ad2d52d8ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:22.608546 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa83a1b-eadb-4698-8738-0ad2d52d8ae3 admin admin] PATH_INFO: `/v3/services` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:22.609266 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa83a1b-eadb-4698-8738-0ad2d52d8ae3 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:22.609567 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa83a1b-eadb-4698-8738-0ad2d52d8ae3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:22.611304 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa83a1b-eadb-4698-8738-0ad2d52d8ae3 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:22.622102 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 521/1038] 10.222.0.15 () {56 vars in 1143 bytes} [Mon Nov 29 20:09:22 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:22.623765 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fe82f-bb6a-4d99-9809-2b5a4ec93cbf admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:22.634041 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fe82f-bb6a-4d99-9809-2b5a4ec93cbf admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:22.638882 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a503a4dc-abbe-4313-b1ea-7218f57f600c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:22.639586 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503a4dc-abbe-4313-b1ea-7218f57f600c admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:22.640231 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503a4dc-abbe-4313-b1ea-7218f57f600c admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:22.640509 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503a4dc-abbe-4313-b1ea-7218f57f600c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:22.641425 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a503a4dc-abbe-4313-b1ea-7218f57f600c admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:22.643116 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a503a4dc-abbe-4313-b1ea-7218f57f600c admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:22.663182 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 518/1039] 10.222.0.15 () {60 vars in 1165 bytes} [Mon Nov 29 20:09:22 2021] POST /identity/v3/endpoints => generated 325 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:09:23.140691 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bbf22-5949-4865-857e-1ce620155262 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:23.140928 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bbf22-5949-4865-857e-1ce620155262 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:23.141298 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bbf22-5949-4865-857e-1ce620155262 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:23.143403 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 522/1040] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:09:23.148958 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a07da7-d517-48c4-a2b6-c9a7fc2afddb None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:23.149245 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a07da7-d517-48c4-a2b6-c9a7fc2afddb None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:23.149473 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a07da7-d517-48c4-a2b6-c9a7fc2afddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:23.167344 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-50a07da7-d517-48c4-a2b6-c9a7fc2afddb None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:23.168516 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-50a07da7-d517-48c4-a2b6-c9a7fc2afddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:23.185462 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 519/1041] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:23 2021] POST /identity/v3/auth/tokens => generated 2668 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:09:23.208285 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08bbf22-5949-4865-857e-1ce620155262 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:23.220998 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08bbf22-5949-4865-857e-1ce620155262 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:23.225857 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e7195-23c6-4315-89ef-1d7030696b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:23.226649 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e7195-23c6-4315-89ef-1d7030696b54 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:23.226957 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e7195-23c6-4315-89ef-1d7030696b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:23.227243 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e7195-23c6-4315-89ef-1d7030696b54 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:23.227928 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e7195-23c6-4315-89ef-1d7030696b54 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:23.229516 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e7195-23c6-4315-89ef-1d7030696b54 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:23.241938 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-9a8e7195-23c6-4315-89ef-1d7030696b54 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Nov 29 20:09:23.243280 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 523/1042] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:09:23 2021] GET /identity/v3/services/compute => generated 88 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:23.249462 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a07da7-d517-48c4-a2b6-c9a7fc2afddb None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:23.258393 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a07da7-d517-48c4-a2b6-c9a7fc2afddb None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:23.263057 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e0d9b-f807-488f-bac7-6342749471b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:23.263701 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e0d9b-f807-488f-bac7-6342749471b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:23.263950 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e0d9b-f807-488f-bac7-6342749471b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:23.264214 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503e0d9b-f807-488f-bac7-6342749471b8 admin admin] PATH_INFO: `/v3/services` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:23.265302 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e0d9b-f807-488f-bac7-6342749471b8 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:23.265549 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e0d9b-f807-488f-bac7-6342749471b8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:23.267196 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503e0d9b-f807-488f-bac7-6342749471b8 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:23.272407 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 520/1043] 10.222.0.15 () {56 vars in 1133 bytes} [Mon Nov 29 20:09:23 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:23.278018 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e7195-23c6-4315-89ef-1d7030696b54 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:23.288096 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e7195-23c6-4315-89ef-1d7030696b54 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:23.292950 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815575d-1081-4b12-a666-4cd7b89384e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:23.293593 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815575d-1081-4b12-a666-4cd7b89384e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:23.293876 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815575d-1081-4b12-a666-4cd7b89384e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:23.294138 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815575d-1081-4b12-a666-4cd7b89384e5 admin admin] PATH_INFO: `/v3/services` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:23.294869 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6815575d-1081-4b12-a666-4cd7b89384e5 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:23.295175 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6815575d-1081-4b12-a666-4cd7b89384e5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:23.296757 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6815575d-1081-4b12-a666-4cd7b89384e5 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:23.301984 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 524/1044] 10.222.0.15 () {56 vars in 1133 bytes} [Mon Nov 29 20:09:23 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:23.308044 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e0d9b-f807-488f-bac7-6342749471b8 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:23.317813 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503e0d9b-f807-488f-bac7-6342749471b8 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:23.322299 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7a41a-a9ee-4250-a318-09f6ce1597c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:23.323045 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7a41a-a9ee-4250-a318-09f6ce1597c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:23.323611 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7a41a-a9ee-4250-a318-09f6ce1597c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:23.323956 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7a41a-a9ee-4250-a318-09f6ce1597c2 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:23.324782 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df7a41a-a9ee-4250-a318-09f6ce1597c2 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:23.326426 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df7a41a-a9ee-4250-a318-09f6ce1597c2 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:23.347076 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 521/1045] 10.222.0.15 () {60 vars in 1165 bytes} [Mon Nov 29 20:09:23 2021] POST /identity/v3/endpoints => generated 334 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 29 20:09:24.950737 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881b325-1912-44a0-8f96-0bdd9e6af1ca None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:24.951347 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881b325-1912-44a0-8f96-0bdd9e6af1ca None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:24.951445 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881b325-1912-44a0-8f96-0bdd9e6af1ca None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:24.953209 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 525/1046] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:09:24.959185 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2d135-8d2e-4fef-9ed7-4dd1b36e064d None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:24.959629 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2d135-8d2e-4fef-9ed7-4dd1b36e064d None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:24.959713 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d2d135-8d2e-4fef-9ed7-4dd1b36e064d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:24.978270 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-92d2d135-8d2e-4fef-9ed7-4dd1b36e064d None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:24.979495 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-92d2d135-8d2e-4fef-9ed7-4dd1b36e064d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:24.996839 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 522/1047] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:24 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:09:25.020767 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881b325-1912-44a0-8f96-0bdd9e6af1ca None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:25.033587 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881b325-1912-44a0-8f96-0bdd9e6af1ca None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:25.038132 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79745b-8dfa-4e7b-944a-2f2872edbcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:25.038939 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79745b-8dfa-4e7b-944a-2f2872edbcf7 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:25.039218 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79745b-8dfa-4e7b-944a-2f2872edbcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:25.039489 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79745b-8dfa-4e7b-944a-2f2872edbcf7 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:25.040140 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d79745b-8dfa-4e7b-944a-2f2872edbcf7 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:25.041723 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d79745b-8dfa-4e7b-944a-2f2872edbcf7 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:25.047040 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fcef3b-844b-4743-a617-e7a49697bb24 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:25.047334 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fcef3b-844b-4743-a617-e7a49697bb24 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:25.047699 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fcef3b-844b-4743-a617-e7a49697bb24 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:25.049605 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 523/1048] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:09:25.052860 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-1d79745b-8dfa-4e7b-944a-2f2872edbcf7 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Nov 29 20:09:25.054124 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 526/1049] 10.222.0.15 () {56 vars in 1126 bytes} [Mon Nov 29 20:09:25 2021] GET /identity/v3/services/image => generated 86 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:25.054963 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e702d7-72fc-4bad-bb5e-ff6835fe2bd8 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:25.055226 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e702d7-72fc-4bad-bb5e-ff6835fe2bd8 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:25.055499 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e702d7-72fc-4bad-bb5e-ff6835fe2bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:25.060247 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79745b-8dfa-4e7b-944a-2f2872edbcf7 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:25.070098 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79745b-8dfa-4e7b-944a-2f2872edbcf7 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:25.072966 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-87e702d7-72fc-4bad-bb5e-ff6835fe2bd8 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:25.074148 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-87e702d7-72fc-4bad-bb5e-ff6835fe2bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:25.074613 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd04bdb-fd1b-4730-97fb-d8ba829954f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:25.075311 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd04bdb-fd1b-4730-97fb-d8ba829954f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:25.075591 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd04bdb-fd1b-4730-97fb-d8ba829954f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:25.075909 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd04bdb-fd1b-4730-97fb-d8ba829954f6 admin admin] PATH_INFO: `/v3/services` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:25.076560 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd04bdb-fd1b-4730-97fb-d8ba829954f6 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:25.076864 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd04bdb-fd1b-4730-97fb-d8ba829954f6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:25.078440 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd04bdb-fd1b-4730-97fb-d8ba829954f6 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:25.082322 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 524/1050] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:25 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:09:25.083462 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 527/1051] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:09:25 2021] GET /identity/v3/services?name=image => generated 122 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:09:25.091731 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e702d7-72fc-4bad-bb5e-ff6835fe2bd8 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:25.100791 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e702d7-72fc-4bad-bb5e-ff6835fe2bd8 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:25.105226 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063db83b-1c54-412f-b1f1-0cba1b411644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:25.106050 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063db83b-1c54-412f-b1f1-0cba1b411644 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:25.106164 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063db83b-1c54-412f-b1f1-0cba1b411644 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:25.106389 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063db83b-1c54-412f-b1f1-0cba1b411644 admin admin] PATH_INFO: `/v3/services` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:25.106997 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd04bdb-fd1b-4730-97fb-d8ba829954f6 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:25.107191 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063db83b-1c54-412f-b1f1-0cba1b411644 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:25.107463 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063db83b-1c54-412f-b1f1-0cba1b411644 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:25.109039 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063db83b-1c54-412f-b1f1-0cba1b411644 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:25.113921 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 525/1052] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:09:25 2021] GET /identity/v3/services?type=image => generated 350 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:25.116353 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd04bdb-fd1b-4730-97fb-d8ba829954f6 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:25.120170 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063db83b-1c54-412f-b1f1-0cba1b411644 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:25.120998 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e804ce-1cb3-40bd-8c1b-3444d728d348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:25.121787 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e804ce-1cb3-40bd-8c1b-3444d728d348 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:25.122069 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e804ce-1cb3-40bd-8c1b-3444d728d348 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:25.122341 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e804ce-1cb3-40bd-8c1b-3444d728d348 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:25.123563 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e804ce-1cb3-40bd-8c1b-3444d728d348 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:25.125244 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e804ce-1cb3-40bd-8c1b-3444d728d348 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:25.130641 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 528/1053] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:09:25 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:09:25.132853 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e804ce-1cb3-40bd-8c1b-3444d728d348 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:25.133054 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063db83b-1c54-412f-b1f1-0cba1b411644 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:25.137355 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e2b5b-042d-4b6c-b5dd-798ddc8a4cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:25.138178 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e2b5b-042d-4b6c-b5dd-798ddc8a4cfa admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:25.138453 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e2b5b-042d-4b6c-b5dd-798ddc8a4cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:25.139258 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e2b5b-042d-4b6c-b5dd-798ddc8a4cfa admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:25.140343 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e2b5b-042d-4b6c-b5dd-798ddc8a4cfa admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:25.141947 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e2b5b-042d-4b6c-b5dd-798ddc8a4cfa admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:25.142588 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e804ce-1cb3-40bd-8c1b-3444d728d348 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:25.147289 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a73095a-62bd-4c8e-9dcc-76181fdeeef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:25.148062 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73095a-62bd-4c8e-9dcc-76181fdeeef9 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:25.148241 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73095a-62bd-4c8e-9dcc-76181fdeeef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:25.148481 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a73095a-62bd-4c8e-9dcc-76181fdeeef9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:25.149280 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a73095a-62bd-4c8e-9dcc-76181fdeeef9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:25.151052 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a73095a-62bd-4c8e-9dcc-76181fdeeef9 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:25.162400 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 526/1054] 10.222.0.15 () {60 vars in 1165 bytes} [Mon Nov 29 20:09:25 2021] POST /identity/v3/endpoints => generated 327 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 29 20:09:25.186918 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 529/1055] 10.222.0.15 () {60 vars in 1162 bytes} [Mon Nov 29 20:09:25 2021] POST /identity/v3/projects => generated 311 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 29 20:09:25.792524 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045b6ca-d1f5-452f-bb86-50faf431178a None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:25.792793 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045b6ca-d1f5-452f-bb86-50faf431178a None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:25.793074 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045b6ca-d1f5-452f-bb86-50faf431178a None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:25.794934 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 527/1056] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:09:25.801089 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2876651-d5a3-44f8-99b3-e2948a87d8e7 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:25.801375 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2876651-d5a3-44f8-99b3-e2948a87d8e7 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:25.801653 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2876651-d5a3-44f8-99b3-e2948a87d8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:25.820651 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-e2876651-d5a3-44f8-99b3-e2948a87d8e7 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:25.821838 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-e2876651-d5a3-44f8-99b3-e2948a87d8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:25.892373 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 530/1057] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:25 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:09:25.915035 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045b6ca-d1f5-452f-bb86-50faf431178a None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:25.927648 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045b6ca-d1f5-452f-bb86-50faf431178a None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:25.932194 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f0f9c-e9c4-4df8-8249-8ab56a035028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:25.933157 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f0f9c-e9c4-4df8-8249-8ab56a035028 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:25.933601 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f0f9c-e9c4-4df8-8249-8ab56a035028 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:25.934035 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f0f9c-e9c4-4df8-8249-8ab56a035028 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:25.944965 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f0f9c-e9c4-4df8-8249-8ab56a035028 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:09:25.952455 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-733f0f9c-e9c4-4df8-8249-8ab56a035028 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 29 20:09:25.953951 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 528/1058] 10.222.0.15 () {56 vars in 1141 bytes} [Mon Nov 29 20:09:25 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:25.960660 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2876651-d5a3-44f8-99b3-e2948a87d8e7 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:25.970027 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2876651-d5a3-44f8-99b3-e2948a87d8e7 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:25.974887 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9b509-0ada-408c-973c-a892a1d0aa0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:25.975574 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9b509-0ada-408c-973c-a892a1d0aa0e admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:25.975862 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9b509-0ada-408c-973c-a892a1d0aa0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:25.976137 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9b509-0ada-408c-973c-a892a1d0aa0e admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:25.976910 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b9b509-0ada-408c-973c-a892a1d0aa0e admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:25.977222 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b9b509-0ada-408c-973c-a892a1d0aa0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:25.979052 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b9b509-0ada-408c-973c-a892a1d0aa0e admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:25.988646 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 531/1059] 10.222.0.15 () {56 vars in 1136 bytes} [Mon Nov 29 20:09:25 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:25.995126 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f0f9c-e9c4-4df8-8249-8ab56a035028 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:26.006130 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f0f9c-e9c4-4df8-8249-8ab56a035028 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:26.011357 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5197b-2bf2-4022-9284-23dc10b0ffde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:26.012246 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5197b-2bf2-4022-9284-23dc10b0ffde admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:26.012535 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5197b-2bf2-4022-9284-23dc10b0ffde admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:26.012810 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a5197b-2bf2-4022-9284-23dc10b0ffde admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:26.024193 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a5197b-2bf2-4022-9284-23dc10b0ffde admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:26.026093 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a5197b-2bf2-4022-9284-23dc10b0ffde admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:26.050045 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-02a5197b-2bf2-4022-9284-23dc10b0ffde admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:09:26.051443 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 529/1060] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:09:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:26.059103 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9b509-0ada-408c-973c-a892a1d0aa0e admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:26.069214 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9b509-0ada-408c-973c-a892a1d0aa0e admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:26.074081 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11043df-9dce-46c9-9e14-466df1669dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:26.074975 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11043df-9dce-46c9-9e14-466df1669dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:26.075395 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11043df-9dce-46c9-9e14-466df1669dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:26.075834 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11043df-9dce-46c9-9e14-466df1669dc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:26.076711 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11043df-9dce-46c9-9e14-466df1669dc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:26.077165 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11043df-9dce-46c9-9e14-466df1669dc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:26.078914 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11043df-9dce-46c9-9e14-466df1669dc7 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:26.092747 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 532/1061] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:09:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:26.101160 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5197b-2bf2-4022-9284-23dc10b0ffde admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:26.113750 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a5197b-2bf2-4022-9284-23dc10b0ffde admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:26.118798 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91336f7-be27-43c6-b0e6-1594c1efc375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:26.119633 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91336f7-be27-43c6-b0e6-1594c1efc375 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:26.119916 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91336f7-be27-43c6-b0e6-1594c1efc375 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:26.120191 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91336f7-be27-43c6-b0e6-1594c1efc375 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:26.128816 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91336f7-be27-43c6-b0e6-1594c1efc375 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:26.130864 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91336f7-be27-43c6-b0e6-1594c1efc375 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:26.145449 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-f91336f7-be27-43c6-b0e6-1594c1efc375 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 29 20:09:26.146918 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 530/1062] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Nov 29 20:09:26 2021] GET /identity/v3/users/nova => generated 82 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:26.152952 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11043df-9dce-46c9-9e14-466df1669dc7 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:26.163990 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11043df-9dce-46c9-9e14-466df1669dc7 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:26.168634 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12f6c0-f801-4b1d-af8a-5cba8c1b0d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:26.169304 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12f6c0-f801-4b1d-af8a-5cba8c1b0d1c admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:26.169586 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12f6c0-f801-4b1d-af8a-5cba8c1b0d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:26.169857 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12f6c0-f801-4b1d-af8a-5cba8c1b0d1c admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:26.170707 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c12f6c0-f801-4b1d-af8a-5cba8c1b0d1c admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:26.171053 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c12f6c0-f801-4b1d-af8a-5cba8c1b0d1c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:26.172956 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c12f6c0-f801-4b1d-af8a-5cba8c1b0d1c admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:26.190750 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 533/1063] 10.222.0.15 () {56 vars in 1154 bytes} [Mon Nov 29 20:09:26 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:26.196809 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91336f7-be27-43c6-b0e6-1594c1efc375 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:26.206708 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91336f7-be27-43c6-b0e6-1594c1efc375 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:26.211219 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e991e7-8821-4538-b955-077e1f9b8d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:26.211864 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e991e7-8821-4538-b955-077e1f9b8d26 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:26.212146 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e991e7-8821-4538-b955-077e1f9b8d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:26.212422 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e991e7-8821-4538-b955-077e1f9b8d26 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:26.220224 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e991e7-8821-4538-b955-077e1f9b8d26 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:26.222012 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e991e7-8821-4538-b955-077e1f9b8d26 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:26.231076 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 531/1064] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:09:26 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:09:26.237463 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12f6c0-f801-4b1d-af8a-5cba8c1b0d1c admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:26.247249 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12f6c0-f801-4b1d-af8a-5cba8c1b0d1c admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:26.251932 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815bc581-6f56-4673-a4fe-b68601475d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:26.252724 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815bc581-6f56-4673-a4fe-b68601475d6b admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:26.253005 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815bc581-6f56-4673-a4fe-b68601475d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:26.253281 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815bc581-6f56-4673-a4fe-b68601475d6b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:26.263699 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815bc581-6f56-4673-a4fe-b68601475d6b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:26.265862 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815bc581-6f56-4673-a4fe-b68601475d6b admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:26.282550 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-815bc581-6f56-4673-a4fe-b68601475d6b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:09:26.283935 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 534/1065] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:09:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:26.289910 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e991e7-8821-4538-b955-077e1f9b8d26 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:26.299008 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e991e7-8821-4538-b955-077e1f9b8d26 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:26.303549 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f8c8b3-ed9b-4f4e-a2d6-9a3c3f11a9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:26.304147 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8c8b3-ed9b-4f4e-a2d6-9a3c3f11a9c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:26.304427 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8c8b3-ed9b-4f4e-a2d6-9a3c3f11a9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:26.304698 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8c8b3-ed9b-4f4e-a2d6-9a3c3f11a9c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:26.305432 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f8c8b3-ed9b-4f4e-a2d6-9a3c3f11a9c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:26.305735 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f8c8b3-ed9b-4f4e-a2d6-9a3c3f11a9c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:26.307343 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f8c8b3-ed9b-4f4e-a2d6-9a3c3f11a9c3 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:26.319375 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 532/1066] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:09:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:26.325607 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815bc581-6f56-4673-a4fe-b68601475d6b admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:26.335959 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815bc581-6f56-4673-a4fe-b68601475d6b admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:26.340802 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1e5ee-b214-4f5d-b5de-84300402be03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:26.341591 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1e5ee-b214-4f5d-b5de-84300402be03 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:26.341868 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1e5ee-b214-4f5d-b5de-84300402be03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:26.342144 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1e5ee-b214-4f5d-b5de-84300402be03 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:26.349554 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b1e5ee-b214-4f5d-b5de-84300402be03 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:26.351568 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b1e5ee-b214-4f5d-b5de-84300402be03 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:26.364704 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-75b1e5ee-b214-4f5d-b5de-84300402be03 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 29 20:09:26.366090 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 535/1067] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:09:26 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:26.372642 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f8c8b3-ed9b-4f4e-a2d6-9a3c3f11a9c3 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:26.382661 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f8c8b3-ed9b-4f4e-a2d6-9a3c3f11a9c3 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:26.388082 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beddd16-8614-40c2-b905-44e2542829e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:26.389372 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beddd16-8614-40c2-b905-44e2542829e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:26.390235 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beddd16-8614-40c2-b905-44e2542829e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:26.390789 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beddd16-8614-40c2-b905-44e2542829e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:26.392717 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beddd16-8614-40c2-b905-44e2542829e4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:26.393317 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beddd16-8614-40c2-b905-44e2542829e4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:26.395388 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beddd16-8614-40c2-b905-44e2542829e4 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:26.409134 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 533/1068] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Nov 29 20:09:26 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:26.415608 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1e5ee-b214-4f5d-b5de-84300402be03 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:26.427787 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1e5ee-b214-4f5d-b5de-84300402be03 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:26.432735 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ffcac9-b42e-475a-8ad6-7e80187a54ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:26.433377 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffcac9-b42e-475a-8ad6-7e80187a54ec admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:26.433657 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffcac9-b42e-475a-8ad6-7e80187a54ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:26.434068 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ffcac9-b42e-475a-8ad6-7e80187a54ec admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:26.434936 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ffcac9-b42e-475a-8ad6-7e80187a54ec admin admin] RBAC: Adding query filter params (role.id=0171a2b804da44c999835c4ec63cf931, scope.project.id=6f4cba10fe824640b2ed37aab02346ac, user.id=5f76a8c3d04e440b92d12ced18d97941) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:26.435246 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ffcac9-b42e-475a-8ad6-7e80187a54ec admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:26.437187 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ffcac9-b42e-475a-8ad6-7e80187a54ec admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:26.445512 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 536/1069] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:09:26 2021] GET /identity/v3/role_assignments?user.id=5f76a8c3d04e440b92d12ced18d97941&scope.project.id=6f4cba10fe824640b2ed37aab02346ac&role.id=0171a2b804da44c999835c4ec63cf931 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:09:27.620788 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c7d1e-d78e-4805-a97f-ba7a4eef4a7e None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:27.621363 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c7d1e-d78e-4805-a97f-ba7a4eef4a7e None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:27.621363 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c7d1e-d78e-4805-a97f-ba7a4eef4a7e None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:27.623129 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 534/1070] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:09:27.629357 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1e768-1a8a-4d72-9d73-12ef7babd344 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:27.629839 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1e768-1a8a-4d72-9d73-12ef7babd344 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:27.629925 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1e768-1a8a-4d72-9d73-12ef7babd344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:27.645270 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569426c0-edee-476c-b1ba-1bfcf75d8417 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:27.645515 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569426c0-edee-476c-b1ba-1bfcf75d8417 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:27.645780 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569426c0-edee-476c-b1ba-1bfcf75d8417 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:27.647614 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 535/1071] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 29 20:09:27.648832 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-f4f1e768-1a8a-4d72-9d73-12ef7babd344 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:27.650053 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-f4f1e768-1a8a-4d72-9d73-12ef7babd344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:27.653782 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829afbd-7446-40fc-b737-3551333ab88e None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:27.653992 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829afbd-7446-40fc-b737-3551333ab88e None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:27.654226 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829afbd-7446-40fc-b737-3551333ab88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:27.658418 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 537/1072] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:27 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:09:27.672341 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-8829afbd-7446-40fc-b737-3551333ab88e None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:27.673548 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-8829afbd-7446-40fc-b737-3551333ab88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:27.681197 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1e768-1a8a-4d72-9d73-12ef7babd344 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:27.681738 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 536/1073] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:27 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:09:27.690285 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1e768-1a8a-4d72-9d73-12ef7babd344 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:27.695116 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98125a-266f-446c-a0ae-7fb973ac1d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:27.695745 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98125a-266f-446c-a0ae-7fb973ac1d3c admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:27.696025 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98125a-266f-446c-a0ae-7fb973ac1d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:27.696248 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98125a-266f-446c-a0ae-7fb973ac1d3c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:27.704298 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c98125a-266f-446c-a0ae-7fb973ac1d3c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:27.706032 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c98125a-266f-446c-a0ae-7fb973ac1d3c admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:27.707613 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829afbd-7446-40fc-b737-3551333ab88e None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:27.715387 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 538/1074] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:09:27 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 29 20:09:27.716568 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829afbd-7446-40fc-b737-3551333ab88e None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:27.721324 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f037a-bd32-4822-894c-8675fe3cf398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:27.721541 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98125a-266f-446c-a0ae-7fb973ac1d3c admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:27.722108 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f037a-bd32-4822-894c-8675fe3cf398 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:27.722388 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f037a-bd32-4822-894c-8675fe3cf398 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:27.722658 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f037a-bd32-4822-894c-8675fe3cf398 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:27.723940 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f037a-bd32-4822-894c-8675fe3cf398 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:27.725615 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f037a-bd32-4822-894c-8675fe3cf398 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:27.729855 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98125a-266f-446c-a0ae-7fb973ac1d3c admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:27.730188 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 537/1075] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:09:27 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:27.733331 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f037a-bd32-4822-894c-8675fe3cf398 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:27.734692 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3841d203-a315-4806-917e-bbdc591d2e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:27.735587 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841d203-a315-4806-917e-bbdc591d2e1e admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:27.735863 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841d203-a315-4806-917e-bbdc591d2e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:27.736131 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841d203-a315-4806-917e-bbdc591d2e1e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:27.737274 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3841d203-a315-4806-917e-bbdc591d2e1e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:27.739022 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3841d203-a315-4806-917e-bbdc591d2e1e admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:27.740878 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 539/1076] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:09:27 2021] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:09:27.743183 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f037a-bd32-4822-894c-8675fe3cf398 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:27.747918 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e667ec-2c03-4060-87d9-aa0468fac812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:27.748631 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e667ec-2c03-4060-87d9-aa0468fac812 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:27.748912 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e667ec-2c03-4060-87d9-aa0468fac812 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:27.749186 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e667ec-2c03-4060-87d9-aa0468fac812 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:27.749932 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e667ec-2c03-4060-87d9-aa0468fac812 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:27.752056 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e667ec-2c03-4060-87d9-aa0468fac812 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:27.779215 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 538/1077] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Nov 29 20:09:27 2021] POST /identity/v3/users => generated 285 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:09:28.764013 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d441e2b-1176-4409-9198-c2cce8abb12d None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:28.764595 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d441e2b-1176-4409-9198-c2cce8abb12d None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:28.764595 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d441e2b-1176-4409-9198-c2cce8abb12d None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:28.766729 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 540/1078] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:09:28.772874 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a934a-3022-4fff-a0b2-2ddf4216fc3c None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:28.773273 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a934a-3022-4fff-a0b2-2ddf4216fc3c None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:28.773451 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a934a-3022-4fff-a0b2-2ddf4216fc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:28.791739 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-7c8a934a-3022-4fff-a0b2-2ddf4216fc3c None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:28.792912 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-7c8a934a-3022-4fff-a0b2-2ddf4216fc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:28.801860 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 539/1079] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:28 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:09:28.825054 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d441e2b-1176-4409-9198-c2cce8abb12d None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:28.837863 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d441e2b-1176-4409-9198-c2cce8abb12d None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:28.842597 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ce20c-28e0-4d17-a00d-8823749e2cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:28.843427 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ce20c-28e0-4d17-a00d-8823749e2cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:28.843703 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ce20c-28e0-4d17-a00d-8823749e2cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:28.843940 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ce20c-28e0-4d17-a00d-8823749e2cd1 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:28.854424 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ce20c-28e0-4d17-a00d-8823749e2cd1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:09:28.861676 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-944ce20c-28e0-4d17-a00d-8823749e2cd1 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 29 20:09:28.863041 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 541/1080] 10.222.0.15 () {56 vars in 1141 bytes} [Mon Nov 29 20:09:28 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:28.869337 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a934a-3022-4fff-a0b2-2ddf4216fc3c None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:28.878337 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a934a-3022-4fff-a0b2-2ddf4216fc3c None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:28.883239 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3b599-d817-4125-bbbd-3609aa089c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:28.883894 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3b599-d817-4125-bbbd-3609aa089c1f admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:28.884175 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3b599-d817-4125-bbbd-3609aa089c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:28.884441 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d3b599-d817-4125-bbbd-3609aa089c1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:28.885189 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d3b599-d817-4125-bbbd-3609aa089c1f admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:28.885485 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d3b599-d817-4125-bbbd-3609aa089c1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:28.887095 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d3b599-d817-4125-bbbd-3609aa089c1f admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:28.895604 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 540/1081] 10.222.0.15 () {56 vars in 1136 bytes} [Mon Nov 29 20:09:28 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:28.901761 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ce20c-28e0-4d17-a00d-8823749e2cd1 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:28.912078 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ce20c-28e0-4d17-a00d-8823749e2cd1 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:28.917011 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb4953-0fcb-48b2-9b81-b80fa52e5b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:28.917776 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb4953-0fcb-48b2-9b81-b80fa52e5b69 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:28.918047 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb4953-0fcb-48b2-9b81-b80fa52e5b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:28.918309 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb4953-0fcb-48b2-9b81-b80fa52e5b69 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:28.928661 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb4953-0fcb-48b2-9b81-b80fa52e5b69 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:28.930484 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb4953-0fcb-48b2-9b81-b80fa52e5b69 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:28.946828 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-c2bb4953-0fcb-48b2-9b81-b80fa52e5b69 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:09:28.948001 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 542/1082] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:09:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:28.954263 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3b599-d817-4125-bbbd-3609aa089c1f admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:28.964126 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d3b599-d817-4125-bbbd-3609aa089c1f admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:28.969185 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378dc03-3679-4fda-a7a5-e602123f4834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:28.969896 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378dc03-3679-4fda-a7a5-e602123f4834 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:28.970148 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378dc03-3679-4fda-a7a5-e602123f4834 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:28.970440 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5378dc03-3679-4fda-a7a5-e602123f4834 admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:28.971229 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5378dc03-3679-4fda-a7a5-e602123f4834 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:28.971527 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5378dc03-3679-4fda-a7a5-e602123f4834 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:28.973140 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5378dc03-3679-4fda-a7a5-e602123f4834 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:28.985932 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 541/1083] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:09:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:28.992253 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb4953-0fcb-48b2-9b81-b80fa52e5b69 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:29.002786 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb4953-0fcb-48b2-9b81-b80fa52e5b69 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:29.008671 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc6c9e5-35b9-4522-9079-79e410e738e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:29.009448 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6c9e5-35b9-4522-9079-79e410e738e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:29.009732 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6c9e5-35b9-4522-9079-79e410e738e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:29.010007 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6c9e5-35b9-4522-9079-79e410e738e3 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:29.018271 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc6c9e5-35b9-4522-9079-79e410e738e3 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:29.020267 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc6c9e5-35b9-4522-9079-79e410e738e3 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:29.034122 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-1fc6c9e5-35b9-4522-9079-79e410e738e3 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 29 20:09:29.035292 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 543/1084] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Nov 29 20:09:28 2021] GET /identity/v3/users/nova => generated 82 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:29.041637 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378dc03-3679-4fda-a7a5-e602123f4834 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:29.051872 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5378dc03-3679-4fda-a7a5-e602123f4834 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:29.057567 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d724012-92b7-48f0-8356-96d3b66f7910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:29.058223 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d724012-92b7-48f0-8356-96d3b66f7910 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:29.058497 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d724012-92b7-48f0-8356-96d3b66f7910 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:29.058761 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d724012-92b7-48f0-8356-96d3b66f7910 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:29.059641 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d724012-92b7-48f0-8356-96d3b66f7910 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:29.059942 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d724012-92b7-48f0-8356-96d3b66f7910 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:29.061783 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d724012-92b7-48f0-8356-96d3b66f7910 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:29.079673 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 542/1085] 10.222.0.15 () {56 vars in 1154 bytes} [Mon Nov 29 20:09:29 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:29.085805 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc6c9e5-35b9-4522-9079-79e410e738e3 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:29.096077 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc6c9e5-35b9-4522-9079-79e410e738e3 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:29.100966 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176435dd-59b2-417c-a1dd-735bb3190c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:29.101746 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176435dd-59b2-417c-a1dd-735bb3190c21 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:29.102029 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176435dd-59b2-417c-a1dd-735bb3190c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:29.102300 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176435dd-59b2-417c-a1dd-735bb3190c21 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:29.113120 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176435dd-59b2-417c-a1dd-735bb3190c21 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:29.114992 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176435dd-59b2-417c-a1dd-735bb3190c21 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:29.132504 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-176435dd-59b2-417c-a1dd-735bb3190c21 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:09:29.133660 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 544/1086] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:09:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:29.140039 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d724012-92b7-48f0-8356-96d3b66f7910 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:29.150691 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d724012-92b7-48f0-8356-96d3b66f7910 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:29.156463 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444e2d3-f59d-459f-a610-6a75c60d8d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:29.157254 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444e2d3-f59d-459f-a610-6a75c60d8d1b admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:29.157593 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444e2d3-f59d-459f-a610-6a75c60d8d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:29.157911 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444e2d3-f59d-459f-a610-6a75c60d8d1b admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:29.158741 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3444e2d3-f59d-459f-a610-6a75c60d8d1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:29.159128 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3444e2d3-f59d-459f-a610-6a75c60d8d1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:29.160768 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3444e2d3-f59d-459f-a610-6a75c60d8d1b admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:29.172490 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 543/1087] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:09:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:29.178657 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176435dd-59b2-417c-a1dd-735bb3190c21 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:29.189049 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176435dd-59b2-417c-a1dd-735bb3190c21 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:29.194976 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dbff68-3be7-4c2c-a4c6-decd09d9efb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:29.195764 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbff68-3be7-4c2c-a4c6-decd09d9efb8 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:29.196042 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbff68-3be7-4c2c-a4c6-decd09d9efb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:29.196310 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbff68-3be7-4c2c-a4c6-decd09d9efb8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:29.203991 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dbff68-3be7-4c2c-a4c6-decd09d9efb8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:29.205948 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dbff68-3be7-4c2c-a4c6-decd09d9efb8 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:29.219224 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-82dbff68-3be7-4c2c-a4c6-decd09d9efb8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 29 20:09:29.220453 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 545/1088] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:09:29 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:29.226772 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444e2d3-f59d-459f-a610-6a75c60d8d1b admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:29.236849 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444e2d3-f59d-459f-a610-6a75c60d8d1b admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:29.242271 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840e2f4-f7e2-451a-8385-acabf936df58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:29.242955 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840e2f4-f7e2-451a-8385-acabf936df58 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:29.243238 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840e2f4-f7e2-451a-8385-acabf936df58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:29.243506 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840e2f4-f7e2-451a-8385-acabf936df58 admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:29.244308 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0840e2f4-f7e2-451a-8385-acabf936df58 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:29.244616 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0840e2f4-f7e2-451a-8385-acabf936df58 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:29.246469 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0840e2f4-f7e2-451a-8385-acabf936df58 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:29.258760 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 544/1089] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Nov 29 20:09:29 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:29.265468 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dbff68-3be7-4c2c-a4c6-decd09d9efb8 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:29.276236 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dbff68-3be7-4c2c-a4c6-decd09d9efb8 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:29.281895 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd6da2-556c-4b73-b89c-fb120d0cd63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:29.282824 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd6da2-556c-4b73-b89c-fb120d0cd63b admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:29.283140 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd6da2-556c-4b73-b89c-fb120d0cd63b admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:29.283408 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd6da2-556c-4b73-b89c-fb120d0cd63b admin admin] PATH_INFO: `/v3/projects/6f4cba10fe824640b2ed37aab02346ac/users/5f76a8c3d04e440b92d12ced18d97941/roles/0171a2b804da44c999835c4ec63cf931` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:29.286038 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd6da2-556c-4b73-b89c-fb120d0cd63b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f4cba10fe824640b2ed37aab02346ac, user_id=5f76a8c3d04e440b92d12ced18d97941, role_id=0171a2b804da44c999835c4ec63cf931)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:29.288702 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd6da2-556c-4b73-b89c-fb120d0cd63b admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:29.303269 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 546/1090] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Nov 29 20:09:29 2021] PUT /identity/v3/projects/6f4cba10fe824640b2ed37aab02346ac/users/5f76a8c3d04e440b92d12ced18d97941/roles/0171a2b804da44c999835c4ec63cf931 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:09:30.164622 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585d1ef-c0e6-4bb5-9e9a-0e6f177afe80 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:30.165158 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585d1ef-c0e6-4bb5-9e9a-0e6f177afe80 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:30.165158 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585d1ef-c0e6-4bb5-9e9a-0e6f177afe80 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:30.167117 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 545/1091] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:09:30.173518 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6863c7b-7a79-499e-b782-52d8c83874c5 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:30.174015 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6863c7b-7a79-499e-b782-52d8c83874c5 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:30.174104 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6863c7b-7a79-499e-b782-52d8c83874c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:30.192909 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-c6863c7b-7a79-499e-b782-52d8c83874c5 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:30.194100 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-c6863c7b-7a79-499e-b782-52d8c83874c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:30.254222 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 547/1092] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:30 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:09:30.284774 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585d1ef-c0e6-4bb5-9e9a-0e6f177afe80 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:30.298813 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585d1ef-c0e6-4bb5-9e9a-0e6f177afe80 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:30.303882 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b20c2b-2364-4fae-862a-3328c826d7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:30.304670 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b20c2b-2364-4fae-862a-3328c826d7ed admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:30.304945 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b20c2b-2364-4fae-862a-3328c826d7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:30.305200 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b20c2b-2364-4fae-862a-3328c826d7ed admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:30.315360 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b20c2b-2364-4fae-862a-3328c826d7ed admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:09:30.321961 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-32b20c2b-2364-4fae-862a-3328c826d7ed admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 29 20:09:30.323126 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 546/1093] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Nov 29 20:09:30 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:30.329732 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6863c7b-7a79-499e-b782-52d8c83874c5 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:30.338886 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6863c7b-7a79-499e-b782-52d8c83874c5 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:30.343905 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d9699-0342-42e8-9343-0f67aada368c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:30.344596 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d9699-0342-42e8-9343-0f67aada368c admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:30.344873 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d9699-0342-42e8-9343-0f67aada368c admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:30.345140 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d9699-0342-42e8-9343-0f67aada368c admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:30.345893 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3d9699-0342-42e8-9343-0f67aada368c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:30.346193 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3d9699-0342-42e8-9343-0f67aada368c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:30.347792 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3d9699-0342-42e8-9343-0f67aada368c admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:30.356175 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 548/1094] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:09:30 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:30.362561 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b20c2b-2364-4fae-862a-3328c826d7ed admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:30.373102 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b20c2b-2364-4fae-862a-3328c826d7ed admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:30.379033 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d01a5-e7b5-4a72-9775-26ee2b969742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:30.379888 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d01a5-e7b5-4a72-9775-26ee2b969742 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:30.380162 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d01a5-e7b5-4a72-9775-26ee2b969742 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:30.380425 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340d01a5-e7b5-4a72-9775-26ee2b969742 admin admin] PATH_INFO: `/v3/users/eea2bc25f32b418eba212daa31500956` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:30.395119 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340d01a5-e7b5-4a72-9775-26ee2b969742 admin admin] RBAC: Authorizing `identity:get_user(user_id=eea2bc25f32b418eba212daa31500956)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:30.397243 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340d01a5-e7b5-4a72-9775-26ee2b969742 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:30.398896 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 547/1095] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:09:30 2021] GET /identity/v3/users/eea2bc25f32b418eba212daa31500956 => generated 285 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:30.405303 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d9699-0342-42e8-9343-0f67aada368c admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:30.415868 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d9699-0342-42e8-9343-0f67aada368c admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:30.421570 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b620c-bd14-4165-a073-41dbad5b9b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:30.422208 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b620c-bd14-4165-a073-41dbad5b9b02 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:30.422510 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b620c-bd14-4165-a073-41dbad5b9b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:30.422865 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b620c-bd14-4165-a073-41dbad5b9b02 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:30.431240 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0b620c-bd14-4165-a073-41dbad5b9b02 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:30.432993 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0b620c-bd14-4165-a073-41dbad5b9b02 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:30.442929 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 549/1096] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:09:30 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:09:30.449513 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d01a5-e7b5-4a72-9775-26ee2b969742 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:30.459901 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340d01a5-e7b5-4a72-9775-26ee2b969742 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:30.466379 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab5280-5d59-4e8c-b543-abda7d91cd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:30.467265 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab5280-5d59-4e8c-b543-abda7d91cd68 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:30.467538 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab5280-5d59-4e8c-b543-abda7d91cd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:30.467809 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab5280-5d59-4e8c-b543-abda7d91cd68 admin admin] PATH_INFO: `/v3/projects/b4899bc9bf5e4683a8de6f85aaf00b17` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:30.469085 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ab5280-5d59-4e8c-b543-abda7d91cd68 admin admin] RBAC: Authorizing `identity:get_project(project_id=b4899bc9bf5e4683a8de6f85aaf00b17)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:30.471168 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ab5280-5d59-4e8c-b543-abda7d91cd68 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:30.472847 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 548/1097] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:09:30 2021] GET /identity/v3/projects/b4899bc9bf5e4683a8de6f85aaf00b17 => generated 311 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:30.479643 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b620c-bd14-4165-a073-41dbad5b9b02 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:30.488776 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b620c-bd14-4165-a073-41dbad5b9b02 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:30.493821 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467a36c-300d-4f84-b13d-07a55f40b39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:30.494456 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467a36c-300d-4f84-b13d-07a55f40b39e admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:30.494730 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467a36c-300d-4f84-b13d-07a55f40b39e admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:30.495044 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467a36c-300d-4f84-b13d-07a55f40b39e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:30.495872 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467a36c-300d-4f84-b13d-07a55f40b39e admin admin] RBAC: Adding query filter params (role.id=33d95c7861b64f1a95af8a333bd626ea, scope.project.id=b4899bc9bf5e4683a8de6f85aaf00b17, user.id=eea2bc25f32b418eba212daa31500956) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:30.496182 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467a36c-300d-4f84-b13d-07a55f40b39e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:30.498013 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467a36c-300d-4f84-b13d-07a55f40b39e admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:30.503805 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 550/1098] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:09:30 2021] GET /identity/v3/role_assignments?user.id=eea2bc25f32b418eba212daa31500956&scope.project.id=b4899bc9bf5e4683a8de6f85aaf00b17&role.id=33d95c7861b64f1a95af8a333bd626ea => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:31.649708 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f57935-d0d8-4fe1-8f2b-2571d06eb5ef None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:31.650244 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f57935-d0d8-4fe1-8f2b-2571d06eb5ef None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:31.650244 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f57935-d0d8-4fe1-8f2b-2571d06eb5ef None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:31.652135 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 549/1099] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:09:31.658246 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6367d-dbce-46eb-918b-0c4f4bfb9391 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:31.658704 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6367d-dbce-46eb-918b-0c4f4bfb9391 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:31.658797 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6367d-dbce-46eb-918b-0c4f4bfb9391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:31.677780 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-59f6367d-dbce-46eb-918b-0c4f4bfb9391 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:31.679004 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-59f6367d-dbce-46eb-918b-0c4f4bfb9391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:31.688220 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 551/1100] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:31 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:09:31.712784 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f57935-d0d8-4fe1-8f2b-2571d06eb5ef None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:31.725539 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f57935-d0d8-4fe1-8f2b-2571d06eb5ef None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:31.730340 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b10db4-d27f-4d47-9de1-97a2ee1954d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:31.731189 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b10db4-d27f-4d47-9de1-97a2ee1954d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:31.731469 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b10db4-d27f-4d47-9de1-97a2ee1954d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:31.731744 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b10db4-d27f-4d47-9de1-97a2ee1954d3 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:31.742661 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b10db4-d27f-4d47-9de1-97a2ee1954d3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:09:31.749876 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-e4b10db4-d27f-4d47-9de1-97a2ee1954d3 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Nov 29 20:09:31.751051 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 550/1101] 10.222.0.15 () {56 vars in 1141 bytes} [Mon Nov 29 20:09:31 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:31.757768 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6367d-dbce-46eb-918b-0c4f4bfb9391 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:31.767554 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6367d-dbce-46eb-918b-0c4f4bfb9391 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:31.772301 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86331028-042b-46a3-92a3-faa428f17295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:31.772958 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86331028-042b-46a3-92a3-faa428f17295 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:31.773240 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86331028-042b-46a3-92a3-faa428f17295 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:31.773517 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86331028-042b-46a3-92a3-faa428f17295 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:31.774276 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86331028-042b-46a3-92a3-faa428f17295 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:31.774583 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86331028-042b-46a3-92a3-faa428f17295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:31.776205 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86331028-042b-46a3-92a3-faa428f17295 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:31.784567 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 552/1102] 10.222.0.15 () {56 vars in 1136 bytes} [Mon Nov 29 20:09:31 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:09:31.790956 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b10db4-d27f-4d47-9de1-97a2ee1954d3 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:31.802532 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b10db4-d27f-4d47-9de1-97a2ee1954d3 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:31.807535 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3f69d-e53c-418b-bb9f-313c09d95884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:31.808309 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3f69d-e53c-418b-bb9f-313c09d95884 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:31.808590 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3f69d-e53c-418b-bb9f-313c09d95884 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:31.808861 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3f69d-e53c-418b-bb9f-313c09d95884 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:31.819627 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab3f69d-e53c-418b-bb9f-313c09d95884 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:31.821463 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab3f69d-e53c-418b-bb9f-313c09d95884 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:31.838261 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-7ab3f69d-e53c-418b-bb9f-313c09d95884 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:09:31.839493 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 551/1103] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:09:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:09:31.846146 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86331028-042b-46a3-92a3-faa428f17295 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:31.856474 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86331028-042b-46a3-92a3-faa428f17295 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:31.862613 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb09f8-c608-4f44-b918-5fac3273b7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:31.863356 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb09f8-c608-4f44-b918-5fac3273b7c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:31.863704 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb09f8-c608-4f44-b918-5fac3273b7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:31.864042 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb09f8-c608-4f44-b918-5fac3273b7c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:31.864843 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb09f8-c608-4f44-b918-5fac3273b7c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:31.865218 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb09f8-c608-4f44-b918-5fac3273b7c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:31.866902 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb09f8-c608-4f44-b918-5fac3273b7c6 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:31.878891 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 553/1104] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:09:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:31.885233 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3f69d-e53c-418b-bb9f-313c09d95884 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:31.895393 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab3f69d-e53c-418b-bb9f-313c09d95884 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:31.900456 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf6659-fd39-40ea-8c56-10c4655f8676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:31.901167 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf6659-fd39-40ea-8c56-10c4655f8676 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:31.901446 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf6659-fd39-40ea-8c56-10c4655f8676 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:31.901719 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf6659-fd39-40ea-8c56-10c4655f8676 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:31.909205 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf6659-fd39-40ea-8c56-10c4655f8676 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:31.911241 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf6659-fd39-40ea-8c56-10c4655f8676 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:31.924832 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-e9bf6659-fd39-40ea-8c56-10c4655f8676 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Nov 29 20:09:31.925953 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 552/1105] 10.222.0.15 () {56 vars in 1114 bytes} [Mon Nov 29 20:09:31 2021] GET /identity/v3/users/nova => generated 82 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:31.932136 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb09f8-c608-4f44-b918-5fac3273b7c6 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:31.942021 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb09f8-c608-4f44-b918-5fac3273b7c6 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:31.947440 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1efa79-d74a-4e41-bb96-8727397c85c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:31.948109 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1efa79-d74a-4e41-bb96-8727397c85c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:31.948390 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1efa79-d74a-4e41-bb96-8727397c85c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:31.948658 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1efa79-d74a-4e41-bb96-8727397c85c6 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:31.949493 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1efa79-d74a-4e41-bb96-8727397c85c6 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:31.949799 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1efa79-d74a-4e41-bb96-8727397c85c6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:31.951748 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1efa79-d74a-4e41-bb96-8727397c85c6 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:31.968914 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 554/1106] 10.222.0.15 () {56 vars in 1154 bytes} [Mon Nov 29 20:09:31 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:31.974880 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf6659-fd39-40ea-8c56-10c4655f8676 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:31.984479 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf6659-fd39-40ea-8c56-10c4655f8676 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:31.989447 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db979691-78d7-436b-8bba-9eedd022a141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:31.990070 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db979691-78d7-436b-8bba-9eedd022a141 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:31.990323 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db979691-78d7-436b-8bba-9eedd022a141 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:31.990622 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db979691-78d7-436b-8bba-9eedd022a141 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:31.998354 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db979691-78d7-436b-8bba-9eedd022a141 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:32.000108 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db979691-78d7-436b-8bba-9eedd022a141 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:32.008849 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 553/1107] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:09:31 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:09:32.014778 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1efa79-d74a-4e41-bb96-8727397c85c6 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:32.025165 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1efa79-d74a-4e41-bb96-8727397c85c6 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:32.031034 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a73ca-f009-4b6b-b241-0149a2732dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:32.031806 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a73ca-f009-4b6b-b241-0149a2732dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:32.032196 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a73ca-f009-4b6b-b241-0149a2732dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:32.032424 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a73ca-f009-4b6b-b241-0149a2732dc8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:32.043295 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a73ca-f009-4b6b-b241-0149a2732dc8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:32.045118 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a73ca-f009-4b6b-b241-0149a2732dc8 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:32.062898 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-5b1a73ca-f009-4b6b-b241-0149a2732dc8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:09:32.064076 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 555/1108] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:09:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:32.070130 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db979691-78d7-436b-8bba-9eedd022a141 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:32.079393 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db979691-78d7-436b-8bba-9eedd022a141 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:32.085226 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218149da-1d47-49d8-975b-4272275e018d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:32.085855 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218149da-1d47-49d8-975b-4272275e018d admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:32.086131 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218149da-1d47-49d8-975b-4272275e018d admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:32.086398 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218149da-1d47-49d8-975b-4272275e018d admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:32.087163 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218149da-1d47-49d8-975b-4272275e018d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:32.087466 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218149da-1d47-49d8-975b-4272275e018d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:32.089073 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218149da-1d47-49d8-975b-4272275e018d admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:32.100790 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 554/1109] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:09:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:32.106734 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a73ca-f009-4b6b-b241-0149a2732dc8 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:32.116658 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a73ca-f009-4b6b-b241-0149a2732dc8 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:32.121764 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd61c18-da42-4b25-af40-4cf6511bb599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:32.122533 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd61c18-da42-4b25-af40-4cf6511bb599 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:32.122815 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd61c18-da42-4b25-af40-4cf6511bb599 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:32.123127 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd61c18-da42-4b25-af40-4cf6511bb599 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:32.130280 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd61c18-da42-4b25-af40-4cf6511bb599 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:32.132262 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd61c18-da42-4b25-af40-4cf6511bb599 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:32.145603 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-9fd61c18-da42-4b25-af40-4cf6511bb599 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 29 20:09:32.146689 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 556/1110] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:09:32 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:32.152982 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218149da-1d47-49d8-975b-4272275e018d admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:32.162956 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218149da-1d47-49d8-975b-4272275e018d admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:32.167718 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892883fb-55a1-4cd5-bab8-ab80af322d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:32.168415 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892883fb-55a1-4cd5-bab8-ab80af322d86 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:32.168696 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892883fb-55a1-4cd5-bab8-ab80af322d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:32.168970 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892883fb-55a1-4cd5-bab8-ab80af322d86 admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:32.169757 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892883fb-55a1-4cd5-bab8-ab80af322d86 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:32.170092 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892883fb-55a1-4cd5-bab8-ab80af322d86 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:32.171954 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892883fb-55a1-4cd5-bab8-ab80af322d86 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:32.184207 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 555/1111] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Nov 29 20:09:32 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:32.191132 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd61c18-da42-4b25-af40-4cf6511bb599 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:32.202243 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd61c18-da42-4b25-af40-4cf6511bb599 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:32.208037 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6a11d-c800-4ece-9d27-e010d6d00c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:32.208681 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6a11d-c800-4ece-9d27-e010d6d00c55 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:32.208962 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6a11d-c800-4ece-9d27-e010d6d00c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:32.209232 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6a11d-c800-4ece-9d27-e010d6d00c55 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:32.210069 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee6a11d-c800-4ece-9d27-e010d6d00c55 admin admin] RBAC: Adding query filter params (role.id=0171a2b804da44c999835c4ec63cf931, scope.project.id=6f4cba10fe824640b2ed37aab02346ac, user.id=5f76a8c3d04e440b92d12ced18d97941) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:32.210383 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee6a11d-c800-4ece-9d27-e010d6d00c55 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:32.212270 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee6a11d-c800-4ece-9d27-e010d6d00c55 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:32.218543 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 557/1112] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:09:32 2021] GET /identity/v3/role_assignments?user.id=5f76a8c3d04e440b92d12ced18d97941&scope.project.id=6f4cba10fe824640b2ed37aab02346ac&role.id=0171a2b804da44c999835c4ec63cf931 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:32.786144 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311a9e4-efeb-4885-ba25-03feaa7fa6df None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:32.786706 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311a9e4-efeb-4885-ba25-03feaa7fa6df None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:32.786706 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311a9e4-efeb-4885-ba25-03feaa7fa6df None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:32.788477 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 556/1113] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:09:32.794501 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8b9d7-d51c-4706-89bc-6da71cebc7ab None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:32.794982 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8b9d7-d51c-4706-89bc-6da71cebc7ab None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:32.795114 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8b9d7-d51c-4706-89bc-6da71cebc7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:32.816575 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-21f8b9d7-d51c-4706-89bc-6da71cebc7ab None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:32.817776 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-21f8b9d7-d51c-4706-89bc-6da71cebc7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:32.828843 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 558/1114] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:32 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:09:32.852387 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311a9e4-efeb-4885-ba25-03feaa7fa6df None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:32.864723 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311a9e4-efeb-4885-ba25-03feaa7fa6df None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:32.869459 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052651d9-1c24-4104-9feb-aa773f4c9fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:32.870251 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052651d9-1c24-4104-9feb-aa773f4c9fdf admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:32.870511 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052651d9-1c24-4104-9feb-aa773f4c9fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:32.870777 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052651d9-1c24-4104-9feb-aa773f4c9fdf admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:32.881389 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052651d9-1c24-4104-9feb-aa773f4c9fdf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:09:32.888203 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-052651d9-1c24-4104-9feb-aa773f4c9fdf admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 29 20:09:32.889526 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 557/1115] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Nov 29 20:09:32 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:32.896375 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8b9d7-d51c-4706-89bc-6da71cebc7ab None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:32.905433 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8b9d7-d51c-4706-89bc-6da71cebc7ab None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:32.909967 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198a985-da8f-404f-8d93-700d1b79c95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:32.910650 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198a985-da8f-404f-8d93-700d1b79c95e admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:32.910958 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198a985-da8f-404f-8d93-700d1b79c95e admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:32.911232 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198a985-da8f-404f-8d93-700d1b79c95e admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:32.911988 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198a985-da8f-404f-8d93-700d1b79c95e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:32.912288 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198a985-da8f-404f-8d93-700d1b79c95e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:32.913877 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198a985-da8f-404f-8d93-700d1b79c95e admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:32.922182 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 559/1116] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:09:32 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:32.928556 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052651d9-1c24-4104-9feb-aa773f4c9fdf admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:32.938946 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052651d9-1c24-4104-9feb-aa773f4c9fdf admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:32.943421 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9b80d-8c90-4981-a471-1bd7c258ac1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:32.944271 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9b80d-8c90-4981-a471-1bd7c258ac1b admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:32.944539 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9b80d-8c90-4981-a471-1bd7c258ac1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:32.944802 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9b80d-8c90-4981-a471-1bd7c258ac1b admin admin] PATH_INFO: `/v3/users/eea2bc25f32b418eba212daa31500956` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:32.945984 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9b80d-8c90-4981-a471-1bd7c258ac1b admin admin] RBAC: Authorizing `identity:get_user(user_id=eea2bc25f32b418eba212daa31500956)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:32.948123 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9b80d-8c90-4981-a471-1bd7c258ac1b admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:32.949995 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 558/1117] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:09:32 2021] GET /identity/v3/users/eea2bc25f32b418eba212daa31500956 => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:32.956010 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198a985-da8f-404f-8d93-700d1b79c95e admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:32.965576 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198a985-da8f-404f-8d93-700d1b79c95e admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:32.970098 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aed67b-afc2-44dd-91b9-b3b129ccc73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:32.970965 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aed67b-afc2-44dd-91b9-b3b129ccc73e admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:32.971245 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aed67b-afc2-44dd-91b9-b3b129ccc73e admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:32.971514 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aed67b-afc2-44dd-91b9-b3b129ccc73e admin admin] PATH_INFO: `/v3/projects/b4899bc9bf5e4683a8de6f85aaf00b17` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:32.972678 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aed67b-afc2-44dd-91b9-b3b129ccc73e admin admin] RBAC: Authorizing `identity:get_project(project_id=b4899bc9bf5e4683a8de6f85aaf00b17)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:32.974703 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aed67b-afc2-44dd-91b9-b3b129ccc73e admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:32.976428 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 560/1118] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:09:32 2021] GET /identity/v3/projects/b4899bc9bf5e4683a8de6f85aaf00b17 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:32.982825 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9b80d-8c90-4981-a471-1bd7c258ac1b admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:32.992977 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9b80d-8c90-4981-a471-1bd7c258ac1b admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:32.997511 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0e82c-7e83-4036-b109-ff83680a0664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:32.998415 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0e82c-7e83-4036-b109-ff83680a0664 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:32.998726 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0e82c-7e83-4036-b109-ff83680a0664 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:32.999041 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0e82c-7e83-4036-b109-ff83680a0664 admin admin] PATH_INFO: `/v3/projects/b4899bc9bf5e4683a8de6f85aaf00b17/users/eea2bc25f32b418eba212daa31500956/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:33.000999 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0e82c-7e83-4036-b109-ff83680a0664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4899bc9bf5e4683a8de6f85aaf00b17, user_id=eea2bc25f32b418eba212daa31500956, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:33.003684 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0e82c-7e83-4036-b109-ff83680a0664 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:33.018554 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 559/1119] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Nov 29 20:09:32 2021] PUT /identity/v3/projects/b4899bc9bf5e4683a8de6f85aaf00b17/users/eea2bc25f32b418eba212daa31500956/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:09:35.289162 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1531fb-8998-486e-a457-8bbeac3dd7f7 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:35.289749 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1531fb-8998-486e-a457-8bbeac3dd7f7 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:35.289749 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1531fb-8998-486e-a457-8bbeac3dd7f7 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:35.291518 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 561/1120] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:09:35.298403 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454afe73-a823-47c2-ae3e-0488c29a6dcc None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:35.299212 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454afe73-a823-47c2-ae3e-0488c29a6dcc None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:35.299400 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454afe73-a823-47c2-ae3e-0488c29a6dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:35.323343 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-454afe73-a823-47c2-ae3e-0488c29a6dcc None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:35.324524 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-454afe73-a823-47c2-ae3e-0488c29a6dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:35.382809 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 560/1121] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:35 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:09:35.408108 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1531fb-8998-486e-a457-8bbeac3dd7f7 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:35.427965 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1531fb-8998-486e-a457-8bbeac3dd7f7 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:35.434502 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3cfc0-cb9c-4ca9-9426-b778c1ea20b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:35.435308 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3cfc0-cb9c-4ca9-9426-b778c1ea20b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:35.435580 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3cfc0-cb9c-4ca9-9426-b778c1ea20b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:35.435848 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3cfc0-cb9c-4ca9-9426-b778c1ea20b3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:35.447762 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff3cfc0-cb9c-4ca9-9426-b778c1ea20b3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:09:35.454589 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-4ff3cfc0-cb9c-4ca9-9426-b778c1ea20b3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 29 20:09:35.455720 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 562/1122] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Nov 29 20:09:35 2021] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:35.462555 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454afe73-a823-47c2-ae3e-0488c29a6dcc None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:35.477364 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454afe73-a823-47c2-ae3e-0488c29a6dcc None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:35.486195 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7959e95-006c-4359-abc0-0d0026feedf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:35.486888 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7959e95-006c-4359-abc0-0d0026feedf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:35.487141 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7959e95-006c-4359-abc0-0d0026feedf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:35.487411 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7959e95-006c-4359-abc0-0d0026feedf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:35.488168 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7959e95-006c-4359-abc0-0d0026feedf0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:35.488466 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7959e95-006c-4359-abc0-0d0026feedf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:35.490046 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7959e95-006c-4359-abc0-0d0026feedf0 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:35.498744 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 561/1123] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:09:35 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:35.504882 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3cfc0-cb9c-4ca9-9426-b778c1ea20b3 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:35.515844 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3cfc0-cb9c-4ca9-9426-b778c1ea20b3 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:35.522029 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5bdf70-58f9-4cb8-ab52-ea362c0c614e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:35.523068 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5bdf70-58f9-4cb8-ab52-ea362c0c614e admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:35.523370 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5bdf70-58f9-4cb8-ab52-ea362c0c614e admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:35.523883 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5bdf70-58f9-4cb8-ab52-ea362c0c614e admin admin] PATH_INFO: `/v3/users/eea2bc25f32b418eba212daa31500956` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:35.525758 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5bdf70-58f9-4cb8-ab52-ea362c0c614e admin admin] RBAC: Authorizing `identity:get_user(user_id=eea2bc25f32b418eba212daa31500956)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:35.529235 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5bdf70-58f9-4cb8-ab52-ea362c0c614e admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:35.531846 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 563/1124] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:09:35 2021] GET /identity/v3/users/eea2bc25f32b418eba212daa31500956 => generated 285 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:35.538173 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7959e95-006c-4359-abc0-0d0026feedf0 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:35.551793 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7959e95-006c-4359-abc0-0d0026feedf0 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:35.557197 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf2b7a-7b86-4b45-8e26-0e8a204cfd2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:35.557860 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf2b7a-7b86-4b45-8e26-0e8a204cfd2b admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:35.558144 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf2b7a-7b86-4b45-8e26-0e8a204cfd2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:35.558417 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf2b7a-7b86-4b45-8e26-0e8a204cfd2b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:35.566714 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf2b7a-7b86-4b45-8e26-0e8a204cfd2b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:35.568491 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf2b7a-7b86-4b45-8e26-0e8a204cfd2b admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:35.577569 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 562/1125] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:09:35 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:09:35.585387 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5bdf70-58f9-4cb8-ab52-ea362c0c614e admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:35.596135 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5bdf70-58f9-4cb8-ab52-ea362c0c614e admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:35.602202 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e7c96-2987-47f5-b584-9b6c4a234765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:35.603049 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e7c96-2987-47f5-b584-9b6c4a234765 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:35.603324 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e7c96-2987-47f5-b584-9b6c4a234765 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:35.603612 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e7c96-2987-47f5-b584-9b6c4a234765 admin admin] PATH_INFO: `/v3/projects/b4899bc9bf5e4683a8de6f85aaf00b17` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:35.604998 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e7c96-2987-47f5-b584-9b6c4a234765 admin admin] RBAC: Authorizing `identity:get_project(project_id=b4899bc9bf5e4683a8de6f85aaf00b17)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:35.607057 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e7c96-2987-47f5-b584-9b6c4a234765 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:35.608687 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 564/1126] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:09:35 2021] GET /identity/v3/projects/b4899bc9bf5e4683a8de6f85aaf00b17 => generated 311 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:35.615980 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf2b7a-7b86-4b45-8e26-0e8a204cfd2b admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:35.629626 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf2b7a-7b86-4b45-8e26-0e8a204cfd2b admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:35.638741 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9492a0-da8e-416c-9502-0d80b0d1faa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:35.639714 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9492a0-da8e-416c-9502-0d80b0d1faa5 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:35.640089 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9492a0-da8e-416c-9502-0d80b0d1faa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:35.640702 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9492a0-da8e-416c-9502-0d80b0d1faa5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:35.641889 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9492a0-da8e-416c-9502-0d80b0d1faa5 admin admin] RBAC: Adding query filter params (role.id=33d95c7861b64f1a95af8a333bd626ea, scope.project.id=b4899bc9bf5e4683a8de6f85aaf00b17, user.id=eea2bc25f32b418eba212daa31500956) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:35.642191 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9492a0-da8e-416c-9502-0d80b0d1faa5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:35.644009 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9492a0-da8e-416c-9502-0d80b0d1faa5 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:35.650045 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 563/1127] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:09:35 2021] GET /identity/v3/role_assignments?user.id=eea2bc25f32b418eba212daa31500956&scope.project.id=b4899bc9bf5e4683a8de6f85aaf00b17&role.id=33d95c7861b64f1a95af8a333bd626ea => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:37.978206 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647eab95-ab18-4fcb-bde9-34ee1110df70 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:37.978791 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647eab95-ab18-4fcb-bde9-34ee1110df70 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:37.979146 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647eab95-ab18-4fcb-bde9-34ee1110df70 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:37.982046 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 565/1128] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:37 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:09:37.990190 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56939e7-ff84-495a-958e-828e52c350c4 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:37.990634 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56939e7-ff84-495a-958e-828e52c350c4 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:37.990749 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56939e7-ff84-495a-958e-828e52c350c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:38.010175 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-d56939e7-ff84-495a-958e-828e52c350c4 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:38.011396 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-d56939e7-ff84-495a-958e-828e52c350c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:38.022994 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 564/1129] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:37 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:09:38.050499 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647eab95-ab18-4fcb-bde9-34ee1110df70 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:38.065909 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647eab95-ab18-4fcb-bde9-34ee1110df70 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:38.072188 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd44b19-c72b-4981-8d46-1ecfaae3bef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:38.072960 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd44b19-c72b-4981-8d46-1ecfaae3bef3 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:38.073240 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd44b19-c72b-4981-8d46-1ecfaae3bef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:38.073543 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd44b19-c72b-4981-8d46-1ecfaae3bef3 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:38.074879 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd44b19-c72b-4981-8d46-1ecfaae3bef3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:38.076572 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd44b19-c72b-4981-8d46-1ecfaae3bef3 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:38.078124 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 566/1130] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:09:38 2021] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:38.084815 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56939e7-ff84-495a-958e-828e52c350c4 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:38.097743 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56939e7-ff84-495a-958e-828e52c350c4 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:38.103492 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af64e8-3481-4486-b589-2ee694f33825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:38.104138 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af64e8-3481-4486-b589-2ee694f33825 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:38.104413 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af64e8-3481-4486-b589-2ee694f33825 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:38.104679 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af64e8-3481-4486-b589-2ee694f33825 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:38.105385 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af64e8-3481-4486-b589-2ee694f33825 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:38.107311 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af64e8-3481-4486-b589-2ee694f33825 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:38.129310 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 565/1131] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Nov 29 20:09:38 2021] POST /identity/v3/users => generated 286 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:09:40.487791 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918e5ba-b3fe-4a0e-9fc3-a36a80382c2a None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:40.488652 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918e5ba-b3fe-4a0e-9fc3-a36a80382c2a None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:40.488652 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918e5ba-b3fe-4a0e-9fc3-a36a80382c2a None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:40.491571 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 567/1132] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:40 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:09:40.498464 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b306862-fbac-425c-88b3-aafd8c15a12a None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:40.498917 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b306862-fbac-425c-88b3-aafd8c15a12a None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:40.499094 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b306862-fbac-425c-88b3-aafd8c15a12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:40.519612 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-8b306862-fbac-425c-88b3-aafd8c15a12a None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:40.520830 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-8b306862-fbac-425c-88b3-aafd8c15a12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:40.528977 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 566/1133] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:40 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:09:40.554363 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918e5ba-b3fe-4a0e-9fc3-a36a80382c2a None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:40.572755 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918e5ba-b3fe-4a0e-9fc3-a36a80382c2a None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:40.578993 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a79ca2-9e6b-485d-a8b8-1fac8e6fb417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:40.579846 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a79ca2-9e6b-485d-a8b8-1fac8e6fb417 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:40.580123 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a79ca2-9e6b-485d-a8b8-1fac8e6fb417 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:40.580401 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a79ca2-9e6b-485d-a8b8-1fac8e6fb417 admin admin] PATH_INFO: `/v3/roles/d63eb17a7e7d455ea5f2c6696d92978c` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:40.581983 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a79ca2-9e6b-485d-a8b8-1fac8e6fb417 admin admin] RBAC: Authorizing `identity:get_role(role_id=d63eb17a7e7d455ea5f2c6696d92978c)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:40.583040 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING py.warnings [None req-29a79ca2-9e6b-485d-a8b8-1fac8e6fb417 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 29 20:09:40.583040 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: warnings.warn(msg) Nov 29 20:09:40.583040 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: Nov 29 20:09:40.583918 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a79ca2-9e6b-485d-a8b8-1fac8e6fb417 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:40.585248 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 568/1134] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:09:40 2021] GET /identity/v3/roles/d63eb17a7e7d455ea5f2c6696d92978c => generated 223 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:40.591563 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b306862-fbac-425c-88b3-aafd8c15a12a None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:40.601196 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b306862-fbac-425c-88b3-aafd8c15a12a None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:40.606827 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e5f35-e5b2-4dd0-8f48-0ee488d1273b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:40.607727 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e5f35-e5b2-4dd0-8f48-0ee488d1273b admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:40.608007 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e5f35-e5b2-4dd0-8f48-0ee488d1273b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:40.608278 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e5f35-e5b2-4dd0-8f48-0ee488d1273b admin admin] PATH_INFO: `/v3/users/663c59914bdd441cacd42a7097d31699` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:40.623320 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e5f35-e5b2-4dd0-8f48-0ee488d1273b admin admin] RBAC: Authorizing `identity:get_user(user_id=663c59914bdd441cacd42a7097d31699)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:40.625465 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e5f35-e5b2-4dd0-8f48-0ee488d1273b admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:40.627118 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 567/1135] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:09:40 2021] GET /identity/v3/users/663c59914bdd441cacd42a7097d31699 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:40.633706 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a79ca2-9e6b-485d-a8b8-1fac8e6fb417 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:40.647679 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a79ca2-9e6b-485d-a8b8-1fac8e6fb417 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:40.654017 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b4051-489a-45e9-8201-9ec41199655a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:40.654633 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b4051-489a-45e9-8201-9ec41199655a admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:40.654938 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b4051-489a-45e9-8201-9ec41199655a admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:40.655209 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b4051-489a-45e9-8201-9ec41199655a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:40.663944 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b4051-489a-45e9-8201-9ec41199655a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:40.665664 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58b4051-489a-45e9-8201-9ec41199655a admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:40.675292 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 569/1136] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:09:40 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:09:40.684995 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e5f35-e5b2-4dd0-8f48-0ee488d1273b admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:40.701104 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e5f35-e5b2-4dd0-8f48-0ee488d1273b admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:40.708112 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ab6d1-afb1-4871-b363-04acc1f672aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:40.708930 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ab6d1-afb1-4871-b363-04acc1f672aa admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:40.709217 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ab6d1-afb1-4871-b363-04acc1f672aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:40.709490 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ab6d1-afb1-4871-b363-04acc1f672aa admin admin] PATH_INFO: `/v3/projects/b4899bc9bf5e4683a8de6f85aaf00b17` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:40.710796 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ab6d1-afb1-4871-b363-04acc1f672aa admin admin] RBAC: Authorizing `identity:get_project(project_id=b4899bc9bf5e4683a8de6f85aaf00b17)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:40.712816 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ab6d1-afb1-4871-b363-04acc1f672aa admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:40.714414 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 568/1137] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:09:40 2021] GET /identity/v3/projects/b4899bc9bf5e4683a8de6f85aaf00b17 => generated 311 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:40.720831 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b4051-489a-45e9-8201-9ec41199655a admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:40.729682 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58b4051-489a-45e9-8201-9ec41199655a admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:40.735575 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9d6da7-34d9-4f34-b132-aba807533394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:40.736179 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d6da7-34d9-4f34-b132-aba807533394 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:40.736460 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d6da7-34d9-4f34-b132-aba807533394 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:40.736725 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9d6da7-34d9-4f34-b132-aba807533394 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:40.737539 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9d6da7-34d9-4f34-b132-aba807533394 admin admin] RBAC: Adding query filter params (role.id=d63eb17a7e7d455ea5f2c6696d92978c, scope.project.id=b4899bc9bf5e4683a8de6f85aaf00b17, user.id=663c59914bdd441cacd42a7097d31699) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:40.737907 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9d6da7-34d9-4f34-b132-aba807533394 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:40.739761 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9d6da7-34d9-4f34-b132-aba807533394 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:40.745449 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 570/1138] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:09:40 2021] GET /identity/v3/role_assignments?user.id=663c59914bdd441cacd42a7097d31699&scope.project.id=b4899bc9bf5e4683a8de6f85aaf00b17&role.id=d63eb17a7e7d455ea5f2c6696d92978c => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:43.027272 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4599810-e442-4545-ac63-0537f9996514 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:43.028180 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4599810-e442-4545-ac63-0537f9996514 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:43.028180 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4599810-e442-4545-ac63-0537f9996514 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:43.031009 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 569/1139] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:43 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:09:43.037840 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d67db-6a2d-4e93-8dee-054acc457f93 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:43.038522 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d67db-6a2d-4e93-8dee-054acc457f93 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:43.038699 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d67db-6a2d-4e93-8dee-054acc457f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:43.061122 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-0f4d67db-6a2d-4e93-8dee-054acc457f93 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:43.062426 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-0f4d67db-6a2d-4e93-8dee-054acc457f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:43.071746 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 571/1140] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:43 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:09:43.095008 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4599810-e442-4545-ac63-0537f9996514 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:43.108961 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4599810-e442-4545-ac63-0537f9996514 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:43.114327 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a729f-c92b-4967-b8ac-681cc208fa65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:43.115204 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a729f-c92b-4967-b8ac-681cc208fa65 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:43.115482 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a729f-c92b-4967-b8ac-681cc208fa65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:43.115753 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a729f-c92b-4967-b8ac-681cc208fa65 admin admin] PATH_INFO: `/v3/roles/d63eb17a7e7d455ea5f2c6696d92978c` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:43.117267 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a729f-c92b-4967-b8ac-681cc208fa65 admin admin] RBAC: Authorizing `identity:get_role(role_id=d63eb17a7e7d455ea5f2c6696d92978c)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:43.118303 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING py.warnings [None req-226a729f-c92b-4967-b8ac-681cc208fa65 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 29 20:09:43.118303 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: warnings.warn(msg) Nov 29 20:09:43.118303 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: Nov 29 20:09:43.119229 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a729f-c92b-4967-b8ac-681cc208fa65 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:43.120560 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 570/1141] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:09:43 2021] GET /identity/v3/roles/d63eb17a7e7d455ea5f2c6696d92978c => generated 223 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:43.127040 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d67db-6a2d-4e93-8dee-054acc457f93 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:43.141846 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d67db-6a2d-4e93-8dee-054acc457f93 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:43.147830 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ac398-fc80-4897-ba4a-6413523b3192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:43.148686 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ac398-fc80-4897-ba4a-6413523b3192 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:43.148967 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ac398-fc80-4897-ba4a-6413523b3192 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:43.149241 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ac398-fc80-4897-ba4a-6413523b3192 admin admin] PATH_INFO: `/v3/users/663c59914bdd441cacd42a7097d31699` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:43.150601 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ac398-fc80-4897-ba4a-6413523b3192 admin admin] RBAC: Authorizing `identity:get_user(user_id=663c59914bdd441cacd42a7097d31699)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:43.152761 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ac398-fc80-4897-ba4a-6413523b3192 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:43.154324 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 572/1142] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:09:43 2021] GET /identity/v3/users/663c59914bdd441cacd42a7097d31699 => generated 286 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:43.160089 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a729f-c92b-4967-b8ac-681cc208fa65 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:43.169993 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a729f-c92b-4967-b8ac-681cc208fa65 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:43.175827 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbb9911-2260-4755-91c3-3b0836771882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:43.176624 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb9911-2260-4755-91c3-3b0836771882 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:43.176900 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb9911-2260-4755-91c3-3b0836771882 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:43.177177 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbb9911-2260-4755-91c3-3b0836771882 admin admin] PATH_INFO: `/v3/projects/b4899bc9bf5e4683a8de6f85aaf00b17` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:43.178476 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb9911-2260-4755-91c3-3b0836771882 admin admin] RBAC: Authorizing `identity:get_project(project_id=b4899bc9bf5e4683a8de6f85aaf00b17)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:43.180501 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbb9911-2260-4755-91c3-3b0836771882 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:43.182100 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 571/1143] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:09:43 2021] GET /identity/v3/projects/b4899bc9bf5e4683a8de6f85aaf00b17 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:43.187985 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ac398-fc80-4897-ba4a-6413523b3192 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:43.197778 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ac398-fc80-4897-ba4a-6413523b3192 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:43.203574 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed479cfd-e28e-4173-9899-7e6757bf99dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:43.204435 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed479cfd-e28e-4173-9899-7e6757bf99dd admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:43.204713 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed479cfd-e28e-4173-9899-7e6757bf99dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:43.204987 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed479cfd-e28e-4173-9899-7e6757bf99dd admin admin] PATH_INFO: `/v3/projects/b4899bc9bf5e4683a8de6f85aaf00b17/users/663c59914bdd441cacd42a7097d31699/roles/d63eb17a7e7d455ea5f2c6696d92978c` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:43.207603 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed479cfd-e28e-4173-9899-7e6757bf99dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4899bc9bf5e4683a8de6f85aaf00b17, user_id=663c59914bdd441cacd42a7097d31699, role_id=d63eb17a7e7d455ea5f2c6696d92978c)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:43.210166 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed479cfd-e28e-4173-9899-7e6757bf99dd admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:43.225342 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 573/1144] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Nov 29 20:09:43 2021] PUT /identity/v3/projects/b4899bc9bf5e4683a8de6f85aaf00b17/users/663c59914bdd441cacd42a7097d31699/roles/d63eb17a7e7d455ea5f2c6696d92978c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:09:45.496915 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd9ad1-1048-43fc-80f1-67881075108c None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:45.497480 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd9ad1-1048-43fc-80f1-67881075108c None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:45.497480 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd9ad1-1048-43fc-80f1-67881075108c None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:45.499267 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 572/1145] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:09:45.506175 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b20a5-b1ea-4403-bca8-2809aa2b7c4a None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:45.506938 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b20a5-b1ea-4403-bca8-2809aa2b7c4a None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:45.507088 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8b20a5-b1ea-4403-bca8-2809aa2b7c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:45.539705 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-4e8b20a5-b1ea-4403-bca8-2809aa2b7c4a None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:45.541524 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-4e8b20a5-b1ea-4403-bca8-2809aa2b7c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:45.607610 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 574/1146] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:45 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:09:45.639366 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd9ad1-1048-43fc-80f1-67881075108c None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:45.652988 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd9ad1-1048-43fc-80f1-67881075108c None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:45.657618 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca3003e-9ae2-4881-8a18-5c4ecce90e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:45.658451 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3003e-9ae2-4881-8a18-5c4ecce90e4e admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:45.658724 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3003e-9ae2-4881-8a18-5c4ecce90e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:45.659025 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3003e-9ae2-4881-8a18-5c4ecce90e4e admin admin] PATH_INFO: `/v3/roles/d63eb17a7e7d455ea5f2c6696d92978c` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:45.660501 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca3003e-9ae2-4881-8a18-5c4ecce90e4e admin admin] RBAC: Authorizing `identity:get_role(role_id=d63eb17a7e7d455ea5f2c6696d92978c)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:45.662064 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca3003e-9ae2-4881-8a18-5c4ecce90e4e admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:45.663417 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 573/1147] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:09:45 2021] GET /identity/v3/roles/d63eb17a7e7d455ea5f2c6696d92978c => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:45.670036 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b20a5-b1ea-4403-bca8-2809aa2b7c4a None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:45.684315 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8b20a5-b1ea-4403-bca8-2809aa2b7c4a None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:45.691757 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100605f-dfff-4b17-bdc8-13127ea84f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:45.692736 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100605f-dfff-4b17-bdc8-13127ea84f9d admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:45.693017 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100605f-dfff-4b17-bdc8-13127ea84f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:45.693299 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100605f-dfff-4b17-bdc8-13127ea84f9d admin admin] PATH_INFO: `/v3/users/663c59914bdd441cacd42a7097d31699` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:45.694778 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f100605f-dfff-4b17-bdc8-13127ea84f9d admin admin] RBAC: Authorizing `identity:get_user(user_id=663c59914bdd441cacd42a7097d31699)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:45.696954 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f100605f-dfff-4b17-bdc8-13127ea84f9d admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:45.698652 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 575/1148] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:09:45 2021] GET /identity/v3/users/663c59914bdd441cacd42a7097d31699 => generated 286 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:45.708201 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca3003e-9ae2-4881-8a18-5c4ecce90e4e admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:45.722779 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca3003e-9ae2-4881-8a18-5c4ecce90e4e admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:45.729357 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006c789-272b-4775-964d-3e5713f16f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:45.729989 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006c789-272b-4775-964d-3e5713f16f40 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:45.730261 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006c789-272b-4775-964d-3e5713f16f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:45.730537 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006c789-272b-4775-964d-3e5713f16f40 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:45.739029 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006c789-272b-4775-964d-3e5713f16f40 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:45.740688 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006c789-272b-4775-964d-3e5713f16f40 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:45.749455 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 574/1149] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:09:45 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:09:45.755553 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100605f-dfff-4b17-bdc8-13127ea84f9d admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:45.766880 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100605f-dfff-4b17-bdc8-13127ea84f9d admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:45.775282 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562e164-fdad-4a49-9a1d-f21dfbc57c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:45.776543 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562e164-fdad-4a49-9a1d-f21dfbc57c37 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:45.776943 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562e164-fdad-4a49-9a1d-f21dfbc57c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:45.777422 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562e164-fdad-4a49-9a1d-f21dfbc57c37 admin admin] PATH_INFO: `/v3/projects/b4899bc9bf5e4683a8de6f85aaf00b17` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:45.779410 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562e164-fdad-4a49-9a1d-f21dfbc57c37 admin admin] RBAC: Authorizing `identity:get_project(project_id=b4899bc9bf5e4683a8de6f85aaf00b17)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:45.782647 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7562e164-fdad-4a49-9a1d-f21dfbc57c37 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:45.784299 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 576/1150] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:09:45 2021] GET /identity/v3/projects/b4899bc9bf5e4683a8de6f85aaf00b17 => generated 311 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:45.790564 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006c789-272b-4775-964d-3e5713f16f40 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:45.799591 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006c789-272b-4775-964d-3e5713f16f40 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:45.805400 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4db39-005a-40c8-812d-28d5bbabb42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:45.806012 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4db39-005a-40c8-812d-28d5bbabb42b admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:45.806286 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4db39-005a-40c8-812d-28d5bbabb42b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:45.806554 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4db39-005a-40c8-812d-28d5bbabb42b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:45.807410 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4db39-005a-40c8-812d-28d5bbabb42b admin admin] RBAC: Adding query filter params (role.id=d63eb17a7e7d455ea5f2c6696d92978c, scope.project.id=b4899bc9bf5e4683a8de6f85aaf00b17, user.id=663c59914bdd441cacd42a7097d31699) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:45.807711 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4db39-005a-40c8-812d-28d5bbabb42b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:45.809525 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b4db39-005a-40c8-812d-28d5bbabb42b admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:45.815757 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 575/1151] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:09:45 2021] GET /identity/v3/role_assignments?user.id=663c59914bdd441cacd42a7097d31699&scope.project.id=b4899bc9bf5e4683a8de6f85aaf00b17&role.id=d63eb17a7e7d455ea5f2c6696d92978c => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:48.129283 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc33a78-a780-49ea-99b5-58eb1f7a03f6 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:48.129880 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc33a78-a780-49ea-99b5-58eb1f7a03f6 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:48.129880 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc33a78-a780-49ea-99b5-58eb1f7a03f6 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:48.131580 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 577/1152] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:09:48.138422 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517a9d7-c472-485a-8ec0-82c7e1a5b295 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:48.139245 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517a9d7-c472-485a-8ec0-82c7e1a5b295 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:48.139428 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517a9d7-c472-485a-8ec0-82c7e1a5b295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:48.160626 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-1517a9d7-c472-485a-8ec0-82c7e1a5b295 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:48.161908 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-1517a9d7-c472-485a-8ec0-82c7e1a5b295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:48.171352 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 576/1153] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:48 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:09:48.195831 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc33a78-a780-49ea-99b5-58eb1f7a03f6 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:48.211217 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc33a78-a780-49ea-99b5-58eb1f7a03f6 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:48.218897 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085fef5d-a991-49a5-b01c-eee139d1e558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:48.220101 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085fef5d-a991-49a5-b01c-eee139d1e558 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:48.220590 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085fef5d-a991-49a5-b01c-eee139d1e558 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:48.220988 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085fef5d-a991-49a5-b01c-eee139d1e558 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:48.223192 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085fef5d-a991-49a5-b01c-eee139d1e558 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:48.225899 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085fef5d-a991-49a5-b01c-eee139d1e558 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:48.228453 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 578/1154] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:09:48 2021] GET /identity/v3/domains/default => generated 199 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:48.237434 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517a9d7-c472-485a-8ec0-82c7e1a5b295 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:48.246505 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517a9d7-c472-485a-8ec0-82c7e1a5b295 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:48.252274 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18587fbd-6256-4d8a-8c26-5c7beac476bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:48.252906 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18587fbd-6256-4d8a-8c26-5c7beac476bb admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:48.253177 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18587fbd-6256-4d8a-8c26-5c7beac476bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:48.253441 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18587fbd-6256-4d8a-8c26-5c7beac476bb admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:48.254151 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18587fbd-6256-4d8a-8c26-5c7beac476bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:48.256047 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18587fbd-6256-4d8a-8c26-5c7beac476bb admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:48.284616 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 577/1155] 10.222.0.15 () {60 vars in 1162 bytes} [Mon Nov 29 20:09:48 2021] POST /identity/v3/projects => generated 311 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:09:50.647039 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db653f88-ab30-4415-ae1d-9b3aad109510 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:50.647934 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db653f88-ab30-4415-ae1d-9b3aad109510 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:50.648081 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db653f88-ab30-4415-ae1d-9b3aad109510 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:50.650950 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 579/1156] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:50 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:09:50.660996 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81658e1-9d2a-492e-a3f5-f6c4122a9ece None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:50.661419 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81658e1-9d2a-492e-a3f5-f6c4122a9ece None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:50.661561 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81658e1-9d2a-492e-a3f5-f6c4122a9ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:50.684562 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-c81658e1-9d2a-492e-a3f5-f6c4122a9ece None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:50.685767 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-c81658e1-9d2a-492e-a3f5-f6c4122a9ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:50.743429 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 578/1157] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:50 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:09:50.770221 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db653f88-ab30-4415-ae1d-9b3aad109510 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:50.788470 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db653f88-ab30-4415-ae1d-9b3aad109510 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:50.794064 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a263923-1bb3-49be-9676-b90bc1d9a3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:50.794834 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a263923-1bb3-49be-9676-b90bc1d9a3f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:50.795136 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a263923-1bb3-49be-9676-b90bc1d9a3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:50.795401 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a263923-1bb3-49be-9676-b90bc1d9a3f6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:50.796783 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a263923-1bb3-49be-9676-b90bc1d9a3f6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:50.798451 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a263923-1bb3-49be-9676-b90bc1d9a3f6 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:50.800040 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 580/1158] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:09:50 2021] GET /identity/v3/domains/default => generated 199 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:50.806113 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81658e1-9d2a-492e-a3f5-f6c4122a9ece None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:50.815327 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81658e1-9d2a-492e-a3f5-f6c4122a9ece None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:50.820765 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd50851-4615-4f85-bbc8-249af4194c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:50.821444 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd50851-4615-4f85-bbc8-249af4194c21 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:50.821719 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd50851-4615-4f85-bbc8-249af4194c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:50.821993 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd50851-4615-4f85-bbc8-249af4194c21 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:50.822717 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd50851-4615-4f85-bbc8-249af4194c21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:50.824677 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd50851-4615-4f85-bbc8-249af4194c21 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:50.846539 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 579/1159] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Nov 29 20:09:50 2021] POST /identity/v3/users => generated 286 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:09:53.156362 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef245a1-f6ee-474c-8364-1fa51c3a19b7 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:53.157241 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef245a1-f6ee-474c-8364-1fa51c3a19b7 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:53.157241 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef245a1-f6ee-474c-8364-1fa51c3a19b7 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:53.160028 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 581/1160] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:53 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:09:53.169826 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453642d-e693-4bea-93dd-fd597aaacea2 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:53.170245 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453642d-e693-4bea-93dd-fd597aaacea2 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:53.170424 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453642d-e693-4bea-93dd-fd597aaacea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:53.195724 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-b453642d-e693-4bea-93dd-fd597aaacea2 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:53.196938 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-b453642d-e693-4bea-93dd-fd597aaacea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:53.205948 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 580/1161] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:53 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:09:53.230049 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef245a1-f6ee-474c-8364-1fa51c3a19b7 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:53.245583 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef245a1-f6ee-474c-8364-1fa51c3a19b7 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:53.250842 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c4c1b-5997-433c-b04c-d7bff60af911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:53.251744 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c4c1b-5997-433c-b04c-d7bff60af911 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:53.252049 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c4c1b-5997-433c-b04c-d7bff60af911 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:53.252324 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c4c1b-5997-433c-b04c-d7bff60af911 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:53.263360 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c4c1b-5997-433c-b04c-d7bff60af911 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:09:53.270405 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-4f7c4c1b-5997-433c-b04c-d7bff60af911 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 29 20:09:53.271600 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 582/1162] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Nov 29 20:09:53 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:53.278574 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453642d-e693-4bea-93dd-fd597aaacea2 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:53.289101 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453642d-e693-4bea-93dd-fd597aaacea2 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:53.294944 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87dd13-598d-4a52-b575-78b994a9a14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:53.295603 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87dd13-598d-4a52-b575-78b994a9a14f admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:53.295885 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87dd13-598d-4a52-b575-78b994a9a14f admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:53.296160 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87dd13-598d-4a52-b575-78b994a9a14f admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:53.296928 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e87dd13-598d-4a52-b575-78b994a9a14f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:53.297236 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e87dd13-598d-4a52-b575-78b994a9a14f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:53.298840 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e87dd13-598d-4a52-b575-78b994a9a14f admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:53.307232 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 581/1163] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:09:53 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:53.313301 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c4c1b-5997-433c-b04c-d7bff60af911 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:53.324198 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c4c1b-5997-433c-b04c-d7bff60af911 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:53.329581 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d9f32-8e54-4667-a525-bb2d07a177f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:53.330404 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d9f32-8e54-4667-a525-bb2d07a177f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:53.330684 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d9f32-8e54-4667-a525-bb2d07a177f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:53.330985 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d9f32-8e54-4667-a525-bb2d07a177f6 admin admin] PATH_INFO: `/v3/users/db24b489da0c4b4d9efd29b05e06b5f7` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:53.345906 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d9f32-8e54-4667-a525-bb2d07a177f6 admin admin] RBAC: Authorizing `identity:get_user(user_id=db24b489da0c4b4d9efd29b05e06b5f7)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:53.348112 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d9f32-8e54-4667-a525-bb2d07a177f6 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:53.349717 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 583/1164] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:09:53 2021] GET /identity/v3/users/db24b489da0c4b4d9efd29b05e06b5f7 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:09:53.358698 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87dd13-598d-4a52-b575-78b994a9a14f admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:53.368568 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87dd13-598d-4a52-b575-78b994a9a14f admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:53.373552 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec2786-2d43-49f8-a8ff-403674329f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:53.374169 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec2786-2d43-49f8-a8ff-403674329f63 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:53.374449 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec2786-2d43-49f8-a8ff-403674329f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:53.374729 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec2786-2d43-49f8-a8ff-403674329f63 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:53.382659 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec2786-2d43-49f8-a8ff-403674329f63 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:53.384426 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec2786-2d43-49f8-a8ff-403674329f63 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:53.393685 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 582/1165] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:09:53 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 29 20:09:53.403643 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d9f32-8e54-4667-a525-bb2d07a177f6 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:53.420015 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d9f32-8e54-4667-a525-bb2d07a177f6 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:53.427171 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b829b7-a0b9-4d5d-88ee-8b443771af95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:53.427993 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b829b7-a0b9-4d5d-88ee-8b443771af95 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:53.428266 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b829b7-a0b9-4d5d-88ee-8b443771af95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:53.428535 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b829b7-a0b9-4d5d-88ee-8b443771af95 admin admin] PATH_INFO: `/v3/projects/3b08157392254e5d8149bdbd060c3b73` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:53.429837 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b829b7-a0b9-4d5d-88ee-8b443771af95 admin admin] RBAC: Authorizing `identity:get_project(project_id=3b08157392254e5d8149bdbd060c3b73)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:53.431877 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b829b7-a0b9-4d5d-88ee-8b443771af95 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:53.433502 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 584/1166] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:09:53 2021] GET /identity/v3/projects/3b08157392254e5d8149bdbd060c3b73 => generated 311 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:53.439546 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec2786-2d43-49f8-a8ff-403674329f63 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:53.448084 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec2786-2d43-49f8-a8ff-403674329f63 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:53.453128 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f3ec3-766f-4ca3-aa99-d01b7320f102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:53.453736 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f3ec3-766f-4ca3-aa99-d01b7320f102 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:53.454009 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f3ec3-766f-4ca3-aa99-d01b7320f102 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:53.454314 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f3ec3-766f-4ca3-aa99-d01b7320f102 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:53.455198 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f3ec3-766f-4ca3-aa99-d01b7320f102 admin admin] RBAC: Adding query filter params (role.id=33d95c7861b64f1a95af8a333bd626ea, scope.project.id=3b08157392254e5d8149bdbd060c3b73, user.id=db24b489da0c4b4d9efd29b05e06b5f7) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:53.455508 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f3ec3-766f-4ca3-aa99-d01b7320f102 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:53.457287 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f3ec3-766f-4ca3-aa99-d01b7320f102 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:53.462951 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 583/1167] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:09:53 2021] GET /identity/v3/role_assignments?user.id=db24b489da0c4b4d9efd29b05e06b5f7&scope.project.id=3b08157392254e5d8149bdbd060c3b73&role.id=33d95c7861b64f1a95af8a333bd626ea => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:55.773237 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef220c84-7a15-43d7-8455-03a94e6ef803 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:55.774242 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef220c84-7a15-43d7-8455-03a94e6ef803 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:55.774242 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef220c84-7a15-43d7-8455-03a94e6ef803 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:55.777003 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 585/1168] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:55 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:09:55.783930 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9278f5a-f168-4df9-8d8f-a11258ba947d None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:55.784665 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9278f5a-f168-4df9-8d8f-a11258ba947d None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:55.784798 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9278f5a-f168-4df9-8d8f-a11258ba947d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:55.807691 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-d9278f5a-f168-4df9-8d8f-a11258ba947d None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:55.808875 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-d9278f5a-f168-4df9-8d8f-a11258ba947d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:55.818127 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 584/1169] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:55 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:09:55.841399 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef220c84-7a15-43d7-8455-03a94e6ef803 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:55.856846 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef220c84-7a15-43d7-8455-03a94e6ef803 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:55.862787 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6f0c0-c106-4aed-a847-c68f94894abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:55.863708 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6f0c0-c106-4aed-a847-c68f94894abe admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:55.863990 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6f0c0-c106-4aed-a847-c68f94894abe admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:55.864257 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6f0c0-c106-4aed-a847-c68f94894abe admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:55.874446 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f6f0c0-c106-4aed-a847-c68f94894abe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:09:55.881127 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-f5f6f0c0-c106-4aed-a847-c68f94894abe admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 29 20:09:55.882295 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 586/1170] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Nov 29 20:09:55 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:55.889388 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9278f5a-f168-4df9-8d8f-a11258ba947d None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:55.900400 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9278f5a-f168-4df9-8d8f-a11258ba947d None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:55.906193 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95fd57b-8a4e-4d38-a18a-0e3acc7f4e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:55.906859 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95fd57b-8a4e-4d38-a18a-0e3acc7f4e40 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:55.907148 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95fd57b-8a4e-4d38-a18a-0e3acc7f4e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:55.907417 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95fd57b-8a4e-4d38-a18a-0e3acc7f4e40 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:55.908175 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95fd57b-8a4e-4d38-a18a-0e3acc7f4e40 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:55.908476 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95fd57b-8a4e-4d38-a18a-0e3acc7f4e40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:55.910052 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95fd57b-8a4e-4d38-a18a-0e3acc7f4e40 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:55.919528 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 585/1171] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:09:55 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:55.926384 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6f0c0-c106-4aed-a847-c68f94894abe admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:55.943161 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6f0c0-c106-4aed-a847-c68f94894abe admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:55.951873 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388209cc-3856-45bf-8803-dcfb375fadd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:55.953172 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388209cc-3856-45bf-8803-dcfb375fadd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:55.953612 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388209cc-3856-45bf-8803-dcfb375fadd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:55.954040 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388209cc-3856-45bf-8803-dcfb375fadd7 admin admin] PATH_INFO: `/v3/users/db24b489da0c4b4d9efd29b05e06b5f7` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:55.955669 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388209cc-3856-45bf-8803-dcfb375fadd7 admin admin] RBAC: Authorizing `identity:get_user(user_id=db24b489da0c4b4d9efd29b05e06b5f7)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:55.957800 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388209cc-3856-45bf-8803-dcfb375fadd7 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:55.959419 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 587/1172] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:09:55 2021] GET /identity/v3/users/db24b489da0c4b4d9efd29b05e06b5f7 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:55.965286 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95fd57b-8a4e-4d38-a18a-0e3acc7f4e40 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:55.974652 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95fd57b-8a4e-4d38-a18a-0e3acc7f4e40 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:55.979684 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c28227-bbc2-4be4-8382-1aa68118e5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:55.980490 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c28227-bbc2-4be4-8382-1aa68118e5dc admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:55.980767 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c28227-bbc2-4be4-8382-1aa68118e5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:55.981041 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c28227-bbc2-4be4-8382-1aa68118e5dc admin admin] PATH_INFO: `/v3/projects/3b08157392254e5d8149bdbd060c3b73` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:55.982241 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c28227-bbc2-4be4-8382-1aa68118e5dc admin admin] RBAC: Authorizing `identity:get_project(project_id=3b08157392254e5d8149bdbd060c3b73)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:55.984268 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c28227-bbc2-4be4-8382-1aa68118e5dc admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:55.985879 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 586/1173] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:09:55 2021] GET /identity/v3/projects/3b08157392254e5d8149bdbd060c3b73 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:55.991795 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388209cc-3856-45bf-8803-dcfb375fadd7 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:56.001639 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388209cc-3856-45bf-8803-dcfb375fadd7 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:56.007432 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2363aae-fb9e-4a7c-9aa7-698fec77ff1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:56.008287 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2363aae-fb9e-4a7c-9aa7-698fec77ff1f admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:56.008568 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2363aae-fb9e-4a7c-9aa7-698fec77ff1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:56.008841 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2363aae-fb9e-4a7c-9aa7-698fec77ff1f admin admin] PATH_INFO: `/v3/projects/3b08157392254e5d8149bdbd060c3b73/users/db24b489da0c4b4d9efd29b05e06b5f7/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:56.010946 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2363aae-fb9e-4a7c-9aa7-698fec77ff1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b08157392254e5d8149bdbd060c3b73, user_id=db24b489da0c4b4d9efd29b05e06b5f7, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:56.013526 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2363aae-fb9e-4a7c-9aa7-698fec77ff1f admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:56.029129 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 588/1174] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Nov 29 20:09:55 2021] PUT /identity/v3/projects/3b08157392254e5d8149bdbd060c3b73/users/db24b489da0c4b4d9efd29b05e06b5f7/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:09:58.320949 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6dd5ec-812c-4bb3-b36c-88c15d2a8dd7 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:58.321820 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6dd5ec-812c-4bb3-b36c-88c15d2a8dd7 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:58.321820 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6dd5ec-812c-4bb3-b36c-88c15d2a8dd7 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:58.324710 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 587/1175] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:09:58 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:09:58.334434 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5f429-2b99-4340-83f8-6ec895c28304 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:58.334881 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5f429-2b99-4340-83f8-6ec895c28304 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:58.335026 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5f429-2b99-4340-83f8-6ec895c28304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:58.356837 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-71c5f429-2b99-4340-83f8-6ec895c28304 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:09:58.358036 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-71c5f429-2b99-4340-83f8-6ec895c28304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:09:58.416995 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 589/1176] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:09:58 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:09:58.441626 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6dd5ec-812c-4bb3-b36c-88c15d2a8dd7 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:58.463830 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6dd5ec-812c-4bb3-b36c-88c15d2a8dd7 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:58.472122 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca76b6-5540-47de-a4cd-fe428ded51cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:58.472888 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca76b6-5540-47de-a4cd-fe428ded51cb admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:58.473164 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca76b6-5540-47de-a4cd-fe428ded51cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:58.473428 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca76b6-5540-47de-a4cd-fe428ded51cb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:58.490374 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca76b6-5540-47de-a4cd-fe428ded51cb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:09:58.497104 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-3dca76b6-5540-47de-a4cd-fe428ded51cb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 29 20:09:58.498268 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 588/1177] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Nov 29 20:09:58 2021] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:09:58.505582 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5f429-2b99-4340-83f8-6ec895c28304 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:58.520769 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5f429-2b99-4340-83f8-6ec895c28304 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:58.529836 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb6f29-906f-43e3-a500-a5b0e618d637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:58.530842 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb6f29-906f-43e3-a500-a5b0e618d637 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:58.531260 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb6f29-906f-43e3-a500-a5b0e618d637 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:58.531670 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb6f29-906f-43e3-a500-a5b0e618d637 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:58.532889 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eb6f29-906f-43e3-a500-a5b0e618d637 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:58.533190 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eb6f29-906f-43e3-a500-a5b0e618d637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:58.534822 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eb6f29-906f-43e3-a500-a5b0e618d637 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:58.543286 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 590/1178] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:09:58 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:58.549248 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca76b6-5540-47de-a4cd-fe428ded51cb admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:58.559326 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca76b6-5540-47de-a4cd-fe428ded51cb admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:58.565001 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8fb8c8-4188-45ca-9da0-607a358d0136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:58.565827 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fb8c8-4188-45ca-9da0-607a358d0136 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:58.566107 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fb8c8-4188-45ca-9da0-607a358d0136 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:58.566375 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fb8c8-4188-45ca-9da0-607a358d0136 admin admin] PATH_INFO: `/v3/users/db24b489da0c4b4d9efd29b05e06b5f7` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:58.567674 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8fb8c8-4188-45ca-9da0-607a358d0136 admin admin] RBAC: Authorizing `identity:get_user(user_id=db24b489da0c4b4d9efd29b05e06b5f7)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:58.569778 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8fb8c8-4188-45ca-9da0-607a358d0136 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:58.571411 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 589/1179] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:09:58 2021] GET /identity/v3/users/db24b489da0c4b4d9efd29b05e06b5f7 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:58.577116 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb6f29-906f-43e3-a500-a5b0e618d637 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:58.586590 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb6f29-906f-43e3-a500-a5b0e618d637 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:58.592343 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3e597-68ac-4bbb-9a3e-0b64c354d9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:58.592944 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3e597-68ac-4bbb-9a3e-0b64c354d9e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:58.593217 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3e597-68ac-4bbb-9a3e-0b64c354d9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:58.593481 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3e597-68ac-4bbb-9a3e-0b64c354d9e4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:58.601767 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa3e597-68ac-4bbb-9a3e-0b64c354d9e4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:58.603505 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa3e597-68ac-4bbb-9a3e-0b64c354d9e4 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:58.612401 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 591/1180] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:09:58 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 29 20:09:58.621687 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8fb8c8-4188-45ca-9da0-607a358d0136 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:58.637152 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8fb8c8-4188-45ca-9da0-607a358d0136 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:58.645055 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60858064-f60a-443f-844d-60eda4e137d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:58.645854 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60858064-f60a-443f-844d-60eda4e137d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:58.646131 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60858064-f60a-443f-844d-60eda4e137d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:58.646405 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60858064-f60a-443f-844d-60eda4e137d1 admin admin] PATH_INFO: `/v3/projects/3b08157392254e5d8149bdbd060c3b73` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:58.647722 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60858064-f60a-443f-844d-60eda4e137d1 admin admin] RBAC: Authorizing `identity:get_project(project_id=3b08157392254e5d8149bdbd060c3b73)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:58.649716 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60858064-f60a-443f-844d-60eda4e137d1 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:58.651360 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 590/1181] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:09:58 2021] GET /identity/v3/projects/3b08157392254e5d8149bdbd060c3b73 => generated 311 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:09:58.657608 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3e597-68ac-4bbb-9a3e-0b64c354d9e4 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:09:58.666884 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3e597-68ac-4bbb-9a3e-0b64c354d9e4 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:09:58.672652 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996050cc-2995-4972-9a94-cb3fc2710415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:09:58.673295 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996050cc-2995-4972-9a94-cb3fc2710415 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:09:58.673570 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996050cc-2995-4972-9a94-cb3fc2710415 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:09:58.673838 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996050cc-2995-4972-9a94-cb3fc2710415 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:09:58.674640 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996050cc-2995-4972-9a94-cb3fc2710415 admin admin] RBAC: Adding query filter params (role.id=33d95c7861b64f1a95af8a333bd626ea, scope.project.id=3b08157392254e5d8149bdbd060c3b73, user.id=db24b489da0c4b4d9efd29b05e06b5f7) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:09:58.674974 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996050cc-2995-4972-9a94-cb3fc2710415 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:09:58.676734 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996050cc-2995-4972-9a94-cb3fc2710415 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:09:58.683291 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 592/1182] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:09:58 2021] GET /identity/v3/role_assignments?user.id=db24b489da0c4b4d9efd29b05e06b5f7&scope.project.id=3b08157392254e5d8149bdbd060c3b73&role.id=33d95c7861b64f1a95af8a333bd626ea => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:10:01.028910 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d5d60-1037-4c90-aea3-0c2b8cc6cc77 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:10:01.029460 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d5d60-1037-4c90-aea3-0c2b8cc6cc77 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:10:01.029460 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d5d60-1037-4c90-aea3-0c2b8cc6cc77 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:10:01.031262 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 591/1183] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:10:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:10:01.038202 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdcffd9-aa25-4d9b-ae41-5f57ba8eb23a None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:10:01.038929 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdcffd9-aa25-4d9b-ae41-5f57ba8eb23a None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:10:01.039120 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdcffd9-aa25-4d9b-ae41-5f57ba8eb23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:10:01.062622 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-2fdcffd9-aa25-4d9b-ae41-5f57ba8eb23a None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:10:01.063857 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-2fdcffd9-aa25-4d9b-ae41-5f57ba8eb23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:10:01.073811 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 593/1184] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:10:01 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:10:01.096300 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12d5d60-1037-4c90-aea3-0c2b8cc6cc77 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:10:01.109141 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12d5d60-1037-4c90-aea3-0c2b8cc6cc77 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:10:01.114583 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689bee9-be45-4954-a9da-e3981da2444f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:10:01.115230 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689bee9-be45-4954-a9da-e3981da2444f admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:10:01.115504 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689bee9-be45-4954-a9da-e3981da2444f admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:10:01.115765 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689bee9-be45-4954-a9da-e3981da2444f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:10:01.123680 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1689bee9-be45-4954-a9da-e3981da2444f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:10:01.125399 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1689bee9-be45-4954-a9da-e3981da2444f admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:10:01.134627 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 592/1185] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:10:01 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:10:01.141736 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdcffd9-aa25-4d9b-ae41-5f57ba8eb23a None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:10:01.151687 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdcffd9-aa25-4d9b-ae41-5f57ba8eb23a None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:10:01.157534 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6dbc7-e43e-4a31-9aa9-d188046dc76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:10:01.158318 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6dbc7-e43e-4a31-9aa9-d188046dc76a admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:10:01.158595 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6dbc7-e43e-4a31-9aa9-d188046dc76a admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:10:01.158908 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6dbc7-e43e-4a31-9aa9-d188046dc76a admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:10:01.166908 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e6dbc7-e43e-4a31-9aa9-d188046dc76a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:10:01.168793 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e6dbc7-e43e-4a31-9aa9-d188046dc76a admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:10:01.184412 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-20e6dbc7-e43e-4a31-9aa9-d188046dc76a admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Nov 29 20:10:01.185617 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 594/1186] 10.222.0.15 () {56 vars in 1138 bytes} [Mon Nov 29 20:10:01 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:10:01.196235 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689bee9-be45-4954-a9da-e3981da2444f admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:10:01.208414 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689bee9-be45-4954-a9da-e3981da2444f admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:10:01.214893 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c692e-b0b4-447b-a93b-90e05cb77b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:10:01.215563 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c692e-b0b4-447b-a93b-90e05cb77b9b admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:10:01.215838 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c692e-b0b4-447b-a93b-90e05cb77b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:10:01.216104 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c692e-b0b4-447b-a93b-90e05cb77b9b admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:10:01.216829 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c692e-b0b4-447b-a93b-90e05cb77b9b admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:10:01.217126 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c692e-b0b4-447b-a93b-90e05cb77b9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:10:01.218695 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c692e-b0b4-447b-a93b-90e05cb77b9b admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:10:01.226147 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 593/1187] 10.222.0.15 () {56 vars in 1136 bytes} [Mon Nov 29 20:10:01 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:10:03.497138 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd1785-ae27-4dbb-8ccd-0ac7350242c9 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:10:03.498025 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd1785-ae27-4dbb-8ccd-0ac7350242c9 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:10:03.498025 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd1785-ae27-4dbb-8ccd-0ac7350242c9 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:10:03.501023 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 595/1188] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:10:03 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:10:03.507060 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4b168-2078-4b23-9d7d-19c4c8f07223 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:10:03.507477 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4b168-2078-4b23-9d7d-19c4c8f07223 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:10:03.507566 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4b168-2078-4b23-9d7d-19c4c8f07223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:10:03.526205 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-05a4b168-2078-4b23-9d7d-19c4c8f07223 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:10:03.527403 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-05a4b168-2078-4b23-9d7d-19c4c8f07223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:10:03.536045 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 594/1189] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:10:03 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:10:03.560616 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd1785-ae27-4dbb-8ccd-0ac7350242c9 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:10:03.581826 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd1785-ae27-4dbb-8ccd-0ac7350242c9 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:10:03.589869 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea9e1e-5f2f-47ad-89f7-e239a6714f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:10:03.590949 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea9e1e-5f2f-47ad-89f7-e239a6714f39 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:10:03.591443 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea9e1e-5f2f-47ad-89f7-e239a6714f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:10:03.591899 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea9e1e-5f2f-47ad-89f7-e239a6714f39 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:10:03.593136 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea9e1e-5f2f-47ad-89f7-e239a6714f39 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:10:03.594812 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING py.warnings [None req-f3ea9e1e-5f2f-47ad-89f7-e239a6714f39 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Nov 29 20:10:03.594812 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: warnings.warn(msg) Nov 29 20:10:03.594812 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: Nov 29 20:10:03.596205 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea9e1e-5f2f-47ad-89f7-e239a6714f39 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:10:03.620783 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 596/1190] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Nov 29 20:10:03 2021] POST /identity/v3/domains => generated 267 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:10:05.916278 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a914d045-d29f-40b0-b8dc-a313a2de0b21 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:10:05.916820 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a914d045-d29f-40b0-b8dc-a313a2de0b21 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:10:05.916820 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a914d045-d29f-40b0-b8dc-a313a2de0b21 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:10:05.918653 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 595/1191] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:10:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:10:05.925586 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426bcee-4179-4086-8305-ea2840b68997 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:10:05.926258 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426bcee-4179-4086-8305-ea2840b68997 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:10:05.926476 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426bcee-4179-4086-8305-ea2840b68997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:10:05.951142 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-5426bcee-4179-4086-8305-ea2840b68997 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:10:05.952343 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-5426bcee-4179-4086-8305-ea2840b68997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:10:06.012380 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 597/1192] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:10:05 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:10:06.044355 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a914d045-d29f-40b0-b8dc-a313a2de0b21 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:10:06.058294 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a914d045-d29f-40b0-b8dc-a313a2de0b21 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:10:06.063828 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7184f7ad-7245-46cd-b940-9406d1d9241a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:10:06.064669 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184f7ad-7245-46cd-b940-9406d1d9241a admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:10:06.064943 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184f7ad-7245-46cd-b940-9406d1d9241a admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:10:06.065209 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184f7ad-7245-46cd-b940-9406d1d9241a admin admin] PATH_INFO: `/v3/domains/498923a4de024950b9954047b0448eb3` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:10:06.076573 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7184f7ad-7245-46cd-b940-9406d1d9241a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=498923a4de024950b9954047b0448eb3)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:10:06.078519 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7184f7ad-7245-46cd-b940-9406d1d9241a admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:10:06.080251 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 596/1193] 10.222.0.15 () {56 vars in 1204 bytes} [Mon Nov 29 20:10:06 2021] GET /identity/v3/domains/498923a4de024950b9954047b0448eb3 => generated 267 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:10:06.087022 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426bcee-4179-4086-8305-ea2840b68997 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:10:06.099876 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426bcee-4179-4086-8305-ea2840b68997 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:10:06.106521 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfce792-4e64-4069-a533-1d70521a2cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:10:06.107208 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfce792-4e64-4069-a533-1d70521a2cca admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:10:06.107484 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfce792-4e64-4069-a533-1d70521a2cca admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:10:06.107761 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfce792-4e64-4069-a533-1d70521a2cca admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:10:06.108469 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfce792-4e64-4069-a533-1d70521a2cca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:10:06.110353 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfce792-4e64-4069-a533-1d70521a2cca admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:10:06.139017 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 598/1194] 10.222.0.15 () {60 vars in 1162 bytes} [Mon Nov 29 20:10:06 2021] POST /identity/v3/projects => generated 361 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:10:08.469671 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6685176-d459-4be5-95d8-2ebcf7326a93 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:10:08.470264 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6685176-d459-4be5-95d8-2ebcf7326a93 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:10:08.470264 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6685176-d459-4be5-95d8-2ebcf7326a93 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:10:08.472058 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 597/1195] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:10:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:10:08.478907 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a83ec9-dbd2-4a1d-b85a-cd0b9a37ad18 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:10:08.479603 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a83ec9-dbd2-4a1d-b85a-cd0b9a37ad18 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:10:08.479780 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a83ec9-dbd2-4a1d-b85a-cd0b9a37ad18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:10:08.502279 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-b9a83ec9-dbd2-4a1d-b85a-cd0b9a37ad18 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:10:08.503551 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-b9a83ec9-dbd2-4a1d-b85a-cd0b9a37ad18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:10:08.564837 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 599/1196] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:10:08 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:10:08.596479 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6685176-d459-4be5-95d8-2ebcf7326a93 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:10:08.612177 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6685176-d459-4be5-95d8-2ebcf7326a93 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:10:08.618273 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f1c88-e0ee-4ec5-9095-efe11d7465b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:10:08.619166 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f1c88-e0ee-4ec5-9095-efe11d7465b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:10:08.619447 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f1c88-e0ee-4ec5-9095-efe11d7465b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:10:08.619719 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f1c88-e0ee-4ec5-9095-efe11d7465b9 admin admin] PATH_INFO: `/v3/domains/498923a4de024950b9954047b0448eb3` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:10:08.621044 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f1c88-e0ee-4ec5-9095-efe11d7465b9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=498923a4de024950b9954047b0448eb3)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:10:08.623033 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f1c88-e0ee-4ec5-9095-efe11d7465b9 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:10:08.624590 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 598/1197] 10.222.0.15 () {56 vars in 1204 bytes} [Mon Nov 29 20:10:08 2021] GET /identity/v3/domains/498923a4de024950b9954047b0448eb3 => generated 267 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:10:08.630700 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a83ec9-dbd2-4a1d-b85a-cd0b9a37ad18 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:10:08.640480 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a83ec9-dbd2-4a1d-b85a-cd0b9a37ad18 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:10:08.646537 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a59706e-fd2a-4d68-b40f-d79069104608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:10:08.647237 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59706e-fd2a-4d68-b40f-d79069104608 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:10:08.647520 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59706e-fd2a-4d68-b40f-d79069104608 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:10:08.647798 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a59706e-fd2a-4d68-b40f-d79069104608 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:10:08.648517 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a59706e-fd2a-4d68-b40f-d79069104608 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:10:08.650422 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a59706e-fd2a-4d68-b40f-d79069104608 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:10:08.672056 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 600/1198] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Nov 29 20:10:08 2021] POST /identity/v3/users => generated 311 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:10:11.032310 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4c13a-320b-485d-b933-151c6d516951 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:10:11.032882 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4c13a-320b-485d-b933-151c6d516951 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:10:11.032882 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4c13a-320b-485d-b933-151c6d516951 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:10:11.034650 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 599/1199] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:10:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:10:11.041548 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3ea53-dcda-47bb-b36c-8b1a201f6265 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:10:11.042264 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3ea53-dcda-47bb-b36c-8b1a201f6265 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:10:11.042432 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3ea53-dcda-47bb-b36c-8b1a201f6265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:10:11.068551 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-ffc3ea53-dcda-47bb-b36c-8b1a201f6265 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:10:11.069737 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-ffc3ea53-dcda-47bb-b36c-8b1a201f6265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:10:11.079316 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 601/1200] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:10:11 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:10:11.103617 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4c13a-320b-485d-b933-151c6d516951 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:10:11.117746 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4c13a-320b-485d-b933-151c6d516951 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:10:11.123306 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba704c-158f-4ba1-b3b0-7566b42ba023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:10:11.124069 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba704c-158f-4ba1-b3b0-7566b42ba023 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:10:11.124346 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba704c-158f-4ba1-b3b0-7566b42ba023 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:10:11.124619 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba704c-158f-4ba1-b3b0-7566b42ba023 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:10:11.135789 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba704c-158f-4ba1-b3b0-7566b42ba023 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:10:11.142908 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-bcba704c-158f-4ba1-b3b0-7566b42ba023 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 29 20:10:11.144085 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 600/1201] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Nov 29 20:10:11 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:10:11.150834 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3ea53-dcda-47bb-b36c-8b1a201f6265 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:10:11.162176 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3ea53-dcda-47bb-b36c-8b1a201f6265 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:10:11.168282 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a5d39-6623-4841-99a9-e8fb1dd677fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:10:11.168923 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a5d39-6623-4841-99a9-e8fb1dd677fc admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:10:11.169198 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a5d39-6623-4841-99a9-e8fb1dd677fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:10:11.169458 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a5d39-6623-4841-99a9-e8fb1dd677fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:10:11.170202 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a5d39-6623-4841-99a9-e8fb1dd677fc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:10:11.170502 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a5d39-6623-4841-99a9-e8fb1dd677fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:10:11.172111 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a5d39-6623-4841-99a9-e8fb1dd677fc admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:10:11.180456 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 602/1202] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:10:11 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:10:11.186304 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba704c-158f-4ba1-b3b0-7566b42ba023 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:10:11.196558 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba704c-158f-4ba1-b3b0-7566b42ba023 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:10:11.202181 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc6f7c-4266-49c1-b0e1-7853447dba2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:10:11.203029 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc6f7c-4266-49c1-b0e1-7853447dba2e admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:10:11.203311 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc6f7c-4266-49c1-b0e1-7853447dba2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:10:11.203581 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc6f7c-4266-49c1-b0e1-7853447dba2e admin admin] PATH_INFO: `/v3/users/2887562411c442e495e54458198fbed1` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:10:11.218936 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc6f7c-4266-49c1-b0e1-7853447dba2e admin admin] RBAC: Authorizing `identity:get_user(user_id=2887562411c442e495e54458198fbed1)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:10:11.221120 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc6f7c-4266-49c1-b0e1-7853447dba2e admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:10:11.222698 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 601/1203] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:10:11 2021] GET /identity/v3/users/2887562411c442e495e54458198fbed1 => generated 311 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:10:11.229180 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a5d39-6623-4841-99a9-e8fb1dd677fc admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:10:11.244537 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a5d39-6623-4841-99a9-e8fb1dd677fc admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:10:11.252931 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ba067-bf94-4bb2-80aa-f42f700cb778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:10:11.253546 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ba067-bf94-4bb2-80aa-f42f700cb778 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:10:11.253820 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ba067-bf94-4bb2-80aa-f42f700cb778 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:10:11.254084 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ba067-bf94-4bb2-80aa-f42f700cb778 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:10:11.262284 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ba067-bf94-4bb2-80aa-f42f700cb778 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:10:11.264036 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530ba067-bf94-4bb2-80aa-f42f700cb778 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:10:11.273238 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 603/1204] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:10:11 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:10:11.279455 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc6f7c-4266-49c1-b0e1-7853447dba2e admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:10:11.290204 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc6f7c-4266-49c1-b0e1-7853447dba2e admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:10:11.296681 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fdfd17-88ad-4d79-8cb6-ed5b898c439a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:10:11.297501 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fdfd17-88ad-4d79-8cb6-ed5b898c439a admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:10:11.297784 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fdfd17-88ad-4d79-8cb6-ed5b898c439a admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:10:11.298077 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fdfd17-88ad-4d79-8cb6-ed5b898c439a admin admin] PATH_INFO: `/v3/projects/26e1ad2e4e0247289d357288e5f7eecf` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:10:11.299496 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fdfd17-88ad-4d79-8cb6-ed5b898c439a admin admin] RBAC: Authorizing `identity:get_project(project_id=26e1ad2e4e0247289d357288e5f7eecf)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:10:11.301498 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fdfd17-88ad-4d79-8cb6-ed5b898c439a admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:10:11.303135 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 602/1205] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:10:11 2021] GET /identity/v3/projects/26e1ad2e4e0247289d357288e5f7eecf => generated 361 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:10:11.309445 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ba067-bf94-4bb2-80aa-f42f700cb778 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:10:11.318104 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ba067-bf94-4bb2-80aa-f42f700cb778 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:10:11.324233 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36fddbb-9c3f-4006-a930-f75acdc4ee1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:10:11.324835 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fddbb-9c3f-4006-a930-f75acdc4ee1d admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:10:11.325108 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fddbb-9c3f-4006-a930-f75acdc4ee1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:10:11.325376 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fddbb-9c3f-4006-a930-f75acdc4ee1d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:10:11.326179 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36fddbb-9c3f-4006-a930-f75acdc4ee1d admin admin] RBAC: Adding query filter params (role.id=33d95c7861b64f1a95af8a333bd626ea, scope.project.id=26e1ad2e4e0247289d357288e5f7eecf, user.id=2887562411c442e495e54458198fbed1) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:10:11.326479 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36fddbb-9c3f-4006-a930-f75acdc4ee1d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:10:11.328275 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36fddbb-9c3f-4006-a930-f75acdc4ee1d admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:10:11.333672 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 604/1206] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:10:11 2021] GET /identity/v3/role_assignments?user.id=2887562411c442e495e54458198fbed1&scope.project.id=26e1ad2e4e0247289d357288e5f7eecf&role.id=33d95c7861b64f1a95af8a333bd626ea => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:10:13.582416 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2d981-cd43-45f7-adf2-76b22666a689 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:10:13.583019 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2d981-cd43-45f7-adf2-76b22666a689 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:10:13.583019 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d2d981-cd43-45f7-adf2-76b22666a689 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:10:13.585795 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 603/1207] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:10:13 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:10:13.594886 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ec5df-0318-4feb-a5eb-2c2b2cd7d84b None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:10:13.595326 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ec5df-0318-4feb-a5eb-2c2b2cd7d84b None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:10:13.595416 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ec5df-0318-4feb-a5eb-2c2b2cd7d84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:10:13.614390 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-5b9ec5df-0318-4feb-a5eb-2c2b2cd7d84b None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:10:13.615597 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-5b9ec5df-0318-4feb-a5eb-2c2b2cd7d84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:10:13.624541 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 605/1208] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:10:13 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:10:13.654759 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2d981-cd43-45f7-adf2-76b22666a689 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:10:13.668300 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d2d981-cd43-45f7-adf2-76b22666a689 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:10:13.673313 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40dc5a2-0a80-46aa-9545-da5a873cc5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:10:13.674083 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40dc5a2-0a80-46aa-9545-da5a873cc5cc admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:10:13.674360 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40dc5a2-0a80-46aa-9545-da5a873cc5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:10:13.674631 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40dc5a2-0a80-46aa-9545-da5a873cc5cc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:10:13.685280 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40dc5a2-0a80-46aa-9545-da5a873cc5cc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:10:13.692098 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-b40dc5a2-0a80-46aa-9545-da5a873cc5cc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 29 20:10:13.693229 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 604/1209] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Nov 29 20:10:13 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:10:13.700161 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ec5df-0318-4feb-a5eb-2c2b2cd7d84b None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:10:13.711437 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ec5df-0318-4feb-a5eb-2c2b2cd7d84b None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:10:13.716893 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331df805-1a93-4dec-a0bf-5ae21d6987d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:10:13.717538 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331df805-1a93-4dec-a0bf-5ae21d6987d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:10:13.717808 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331df805-1a93-4dec-a0bf-5ae21d6987d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:10:13.718072 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331df805-1a93-4dec-a0bf-5ae21d6987d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:10:13.718815 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331df805-1a93-4dec-a0bf-5ae21d6987d4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:10:13.719146 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331df805-1a93-4dec-a0bf-5ae21d6987d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:10:13.720721 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331df805-1a93-4dec-a0bf-5ae21d6987d4 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:10:13.729772 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 606/1210] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:10:13 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:10:13.735920 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40dc5a2-0a80-46aa-9545-da5a873cc5cc admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:10:13.746607 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40dc5a2-0a80-46aa-9545-da5a873cc5cc admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:10:13.752008 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73600594-bcbb-4caa-883b-63bf8e10426a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:10:13.753896 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73600594-bcbb-4caa-883b-63bf8e10426a admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:10:13.753896 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73600594-bcbb-4caa-883b-63bf8e10426a admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:10:13.753896 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73600594-bcbb-4caa-883b-63bf8e10426a admin admin] PATH_INFO: `/v3/users/2887562411c442e495e54458198fbed1` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:10:13.754555 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73600594-bcbb-4caa-883b-63bf8e10426a admin admin] RBAC: Authorizing `identity:get_user(user_id=2887562411c442e495e54458198fbed1)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:10:13.756713 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73600594-bcbb-4caa-883b-63bf8e10426a admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:10:13.758242 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 605/1211] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:10:13 2021] GET /identity/v3/users/2887562411c442e495e54458198fbed1 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:10:13.764140 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331df805-1a93-4dec-a0bf-5ae21d6987d4 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:10:13.774207 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331df805-1a93-4dec-a0bf-5ae21d6987d4 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:10:13.779594 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7001676-cb4f-45fb-880a-85eaf736002b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:10:13.780419 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7001676-cb4f-45fb-880a-85eaf736002b admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:10:13.780693 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7001676-cb4f-45fb-880a-85eaf736002b admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:10:13.780956 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7001676-cb4f-45fb-880a-85eaf736002b admin admin] PATH_INFO: `/v3/projects/26e1ad2e4e0247289d357288e5f7eecf` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:10:13.782250 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7001676-cb4f-45fb-880a-85eaf736002b admin admin] RBAC: Authorizing `identity:get_project(project_id=26e1ad2e4e0247289d357288e5f7eecf)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:10:13.784306 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7001676-cb4f-45fb-880a-85eaf736002b admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:10:13.785917 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 607/1212] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:10:13 2021] GET /identity/v3/projects/26e1ad2e4e0247289d357288e5f7eecf => generated 361 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:10:13.791914 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73600594-bcbb-4caa-883b-63bf8e10426a admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:10:13.801367 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73600594-bcbb-4caa-883b-63bf8e10426a admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:10:13.806299 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2795c8-aa03-4d4f-a348-e8f90fe7a393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:10:13.807156 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2795c8-aa03-4d4f-a348-e8f90fe7a393 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:10:13.807432 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2795c8-aa03-4d4f-a348-e8f90fe7a393 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:10:13.807701 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2795c8-aa03-4d4f-a348-e8f90fe7a393 admin admin] PATH_INFO: `/v3/projects/26e1ad2e4e0247289d357288e5f7eecf/users/2887562411c442e495e54458198fbed1/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:10:13.809713 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2795c8-aa03-4d4f-a348-e8f90fe7a393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26e1ad2e4e0247289d357288e5f7eecf, user_id=2887562411c442e495e54458198fbed1, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:10:13.812335 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2795c8-aa03-4d4f-a348-e8f90fe7a393 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:10:13.826944 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 606/1213] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Nov 29 20:10:13 2021] PUT /identity/v3/projects/26e1ad2e4e0247289d357288e5f7eecf/users/2887562411c442e495e54458198fbed1/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:10:16.100934 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f173806-2bff-4bf0-a997-8fac02a7925e None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:10:16.101457 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f173806-2bff-4bf0-a997-8fac02a7925e None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:10:16.101457 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f173806-2bff-4bf0-a997-8fac02a7925e None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:10:16.104173 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 608/1214] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:10:16 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:10:16.113592 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b6525-a3c1-4aad-987a-e49c5689a9ca None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:10:16.113987 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b6525-a3c1-4aad-987a-e49c5689a9ca None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:10:16.114160 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b6525-a3c1-4aad-987a-e49c5689a9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:10:16.143698 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-850b6525-a3c1-4aad-987a-e49c5689a9ca None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:10:16.144894 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-850b6525-a3c1-4aad-987a-e49c5689a9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:10:16.212478 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 607/1215] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:10:16 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:10:16.242148 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f173806-2bff-4bf0-a997-8fac02a7925e None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:10:16.262087 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f173806-2bff-4bf0-a997-8fac02a7925e None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:10:16.268035 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e111a1c-2cb0-49a3-90da-699620f3f981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:10:16.268816 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e111a1c-2cb0-49a3-90da-699620f3f981 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:10:16.269094 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e111a1c-2cb0-49a3-90da-699620f3f981 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:10:16.269391 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e111a1c-2cb0-49a3-90da-699620f3f981 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:10:16.281933 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e111a1c-2cb0-49a3-90da-699620f3f981 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:10:16.288871 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-6e111a1c-2cb0-49a3-90da-699620f3f981 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 29 20:10:16.290035 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 609/1216] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Nov 29 20:10:16 2021] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:10:16.297073 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850b6525-a3c1-4aad-987a-e49c5689a9ca None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:10:16.306945 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850b6525-a3c1-4aad-987a-e49c5689a9ca None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:10:16.312748 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50abe0ee-1451-4c75-bd71-8c045bee2f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:10:16.313501 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50abe0ee-1451-4c75-bd71-8c045bee2f93 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:10:16.313782 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50abe0ee-1451-4c75-bd71-8c045bee2f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:10:16.314057 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50abe0ee-1451-4c75-bd71-8c045bee2f93 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:10:16.314820 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50abe0ee-1451-4c75-bd71-8c045bee2f93 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:10:16.315151 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50abe0ee-1451-4c75-bd71-8c045bee2f93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:10:16.316733 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50abe0ee-1451-4c75-bd71-8c045bee2f93 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:10:16.325376 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 608/1217] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:10:16 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:10:16.331789 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e111a1c-2cb0-49a3-90da-699620f3f981 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:10:16.346206 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e111a1c-2cb0-49a3-90da-699620f3f981 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:10:16.352718 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c56349-2c98-41fb-8903-8d23a2b518e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:10:16.353510 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c56349-2c98-41fb-8903-8d23a2b518e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:10:16.353790 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c56349-2c98-41fb-8903-8d23a2b518e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:10:16.354063 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c56349-2c98-41fb-8903-8d23a2b518e6 admin admin] PATH_INFO: `/v3/users/2887562411c442e495e54458198fbed1` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:10:16.355491 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c56349-2c98-41fb-8903-8d23a2b518e6 admin admin] RBAC: Authorizing `identity:get_user(user_id=2887562411c442e495e54458198fbed1)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:10:16.357628 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c56349-2c98-41fb-8903-8d23a2b518e6 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:10:16.359244 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 610/1218] 10.222.0.15 () {56 vars in 1198 bytes} [Mon Nov 29 20:10:16 2021] GET /identity/v3/users/2887562411c442e495e54458198fbed1 => generated 311 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:10:16.365492 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50abe0ee-1451-4c75-bd71-8c045bee2f93 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:10:16.376446 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50abe0ee-1451-4c75-bd71-8c045bee2f93 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:10:16.382094 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766659b-de44-4efe-85fd-e3ffe8b80754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:10:16.382716 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766659b-de44-4efe-85fd-e3ffe8b80754 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:10:16.383026 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766659b-de44-4efe-85fd-e3ffe8b80754 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:10:16.383295 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766659b-de44-4efe-85fd-e3ffe8b80754 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:10:16.391864 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5766659b-de44-4efe-85fd-e3ffe8b80754 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:10:16.393567 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5766659b-de44-4efe-85fd-e3ffe8b80754 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:10:16.402818 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 609/1219] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:10:16 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:10:16.409422 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c56349-2c98-41fb-8903-8d23a2b518e6 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:10:16.419694 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c56349-2c98-41fb-8903-8d23a2b518e6 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:10:16.426313 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88294445-72eb-40f1-a5cc-ecc20915f3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:10:16.427167 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88294445-72eb-40f1-a5cc-ecc20915f3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:10:16.427447 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88294445-72eb-40f1-a5cc-ecc20915f3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:10:16.427724 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88294445-72eb-40f1-a5cc-ecc20915f3d1 admin admin] PATH_INFO: `/v3/projects/26e1ad2e4e0247289d357288e5f7eecf` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:10:16.429121 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88294445-72eb-40f1-a5cc-ecc20915f3d1 admin admin] RBAC: Authorizing `identity:get_project(project_id=26e1ad2e4e0247289d357288e5f7eecf)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:10:16.431185 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88294445-72eb-40f1-a5cc-ecc20915f3d1 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:10:16.432825 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 611/1220] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:10:16 2021] GET /identity/v3/projects/26e1ad2e4e0247289d357288e5f7eecf => generated 361 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:10:16.439660 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766659b-de44-4efe-85fd-e3ffe8b80754 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:10:16.453467 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766659b-de44-4efe-85fd-e3ffe8b80754 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:10:16.462915 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cde11e-53b3-486f-93ae-2dfa3fdff1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:10:16.463878 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cde11e-53b3-486f-93ae-2dfa3fdff1b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:10:16.464251 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cde11e-53b3-486f-93ae-2dfa3fdff1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:10:16.464640 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cde11e-53b3-486f-93ae-2dfa3fdff1b4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:10:16.465941 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cde11e-53b3-486f-93ae-2dfa3fdff1b4 admin admin] RBAC: Adding query filter params (role.id=33d95c7861b64f1a95af8a333bd626ea, scope.project.id=26e1ad2e4e0247289d357288e5f7eecf, user.id=2887562411c442e495e54458198fbed1) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:10:16.466370 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cde11e-53b3-486f-93ae-2dfa3fdff1b4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:10:16.469241 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cde11e-53b3-486f-93ae-2dfa3fdff1b4 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:10:16.475937 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 610/1221] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:10:16 2021] GET /identity/v3/role_assignments?user.id=2887562411c442e495e54458198fbed1&scope.project.id=26e1ad2e4e0247289d357288e5f7eecf&role.id=33d95c7861b64f1a95af8a333bd626ea => generated 608 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:11:13.946084 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7597b1-2d4c-4bb3-b039-b2241f0482a6 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:13.946084 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7597b1-2d4c-4bb3-b039-b2241f0482a6 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:13.946084 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7597b1-2d4c-4bb3-b039-b2241f0482a6 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:13.946084 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 612/1222] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:11:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:11:13.952754 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4ec61-25bb-4f25-9e29-6fdcbdbd5707 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:13.953582 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4ec61-25bb-4f25-9e29-6fdcbdbd5707 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:13.953855 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b4ec61-25bb-4f25-9e29-6fdcbdbd5707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:13.975547 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-a7b4ec61-25bb-4f25-9e29-6fdcbdbd5707 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:11:13.976788 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-a7b4ec61-25bb-4f25-9e29-6fdcbdbd5707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:11:13.986431 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 611/1223] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:11:13 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:11:14.020379 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7597b1-2d4c-4bb3-b039-b2241f0482a6 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:14.035664 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7597b1-2d4c-4bb3-b039-b2241f0482a6 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:14.041078 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477d089-37a1-4569-9bc9-25bb3ec32e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:14.042160 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477d089-37a1-4569-9bc9-25bb3ec32e7e admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:14.042495 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477d089-37a1-4569-9bc9-25bb3ec32e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:14.042769 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477d089-37a1-4569-9bc9-25bb3ec32e7e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:14.060981 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477d089-37a1-4569-9bc9-25bb3ec32e7e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:14.063069 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477d089-37a1-4569-9bc9-25bb3ec32e7e admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:14.085857 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-d477d089-37a1-4569-9bc9-25bb3ec32e7e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:11:14.087414 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 613/1224] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:11:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:11:14.096289 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4ec61-25bb-4f25-9e29-6fdcbdbd5707 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:14.107722 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b4ec61-25bb-4f25-9e29-6fdcbdbd5707 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:14.113388 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3605bd5-11e3-4019-a4e4-cdfcba3875c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:14.114274 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3605bd5-11e3-4019-a4e4-cdfcba3875c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:14.114644 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3605bd5-11e3-4019-a4e4-cdfcba3875c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:14.114999 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3605bd5-11e3-4019-a4e4-cdfcba3875c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:14.115869 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3605bd5-11e3-4019-a4e4-cdfcba3875c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:11:14.116237 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3605bd5-11e3-4019-a4e4-cdfcba3875c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:14.118129 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3605bd5-11e3-4019-a4e4-cdfcba3875c0 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:14.133708 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 612/1225] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:11:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:11:14.139753 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477d089-37a1-4569-9bc9-25bb3ec32e7e admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:14.150342 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477d089-37a1-4569-9bc9-25bb3ec32e7e admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:14.156055 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2abfb-4f2b-4edf-93f1-26195ee0c782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:14.156875 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2abfb-4f2b-4edf-93f1-26195ee0c782 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:14.157167 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2abfb-4f2b-4edf-93f1-26195ee0c782 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:14.157528 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2abfb-4f2b-4edf-93f1-26195ee0c782 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:14.158274 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2abfb-4f2b-4edf-93f1-26195ee0c782 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:14.160766 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2abfb-4f2b-4edf-93f1-26195ee0c782 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:14.183386 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 614/1226] 10.222.0.15 () {60 vars in 1153 bytes} [Mon Nov 29 20:11:14 2021] POST /identity/v3/users => generated 251 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:11:16.730775 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306aa51-70d8-40b8-a9ff-ae771e51cccd None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:16.731579 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306aa51-70d8-40b8-a9ff-ae771e51cccd None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:16.731579 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306aa51-70d8-40b8-a9ff-ae771e51cccd None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:16.733265 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 613/1227] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:11:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:11:16.739659 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834aeca-2894-4891-9849-f3ab902c7145 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:16.740219 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834aeca-2894-4891-9849-f3ab902c7145 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:16.740350 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3834aeca-2894-4891-9849-f3ab902c7145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:16.759655 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-3834aeca-2894-4891-9849-f3ab902c7145 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:11:16.760962 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-3834aeca-2894-4891-9849-f3ab902c7145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:11:16.769936 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 615/1228] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:11:16 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:11:16.796497 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306aa51-70d8-40b8-a9ff-ae771e51cccd None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:16.810944 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306aa51-70d8-40b8-a9ff-ae771e51cccd None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:16.816224 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f2f4f-211c-43a3-8ed9-9e79a45fa69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:16.817645 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f2f4f-211c-43a3-8ed9-9e79a45fa69a admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:16.817962 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f2f4f-211c-43a3-8ed9-9e79a45fa69a admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:16.818325 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1f2f4f-211c-43a3-8ed9-9e79a45fa69a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:16.832729 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1f2f4f-211c-43a3-8ed9-9e79a45fa69a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:11:16.841047 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-fc1f2f4f-211c-43a3-8ed9-9e79a45fa69a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 29 20:11:16.842423 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 614/1229] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Nov 29 20:11:16 2021] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:11:16.849422 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834aeca-2894-4891-9849-f3ab902c7145 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:16.859825 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3834aeca-2894-4891-9849-f3ab902c7145 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:16.866230 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff25d298-3681-4e57-a3f0-f5a86b9355ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:16.867359 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25d298-3681-4e57-a3f0-f5a86b9355ca admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:16.867640 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25d298-3681-4e57-a3f0-f5a86b9355ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:16.867912 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff25d298-3681-4e57-a3f0-f5a86b9355ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:16.868674 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff25d298-3681-4e57-a3f0-f5a86b9355ca admin admin] RBAC: Adding query filter params (name=service) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:11:16.868976 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff25d298-3681-4e57-a3f0-f5a86b9355ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:16.870566 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff25d298-3681-4e57-a3f0-f5a86b9355ca admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:16.881225 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 616/1230] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Nov 29 20:11:16 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:11:16.887900 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f2f4f-211c-43a3-8ed9-9e79a45fa69a admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:16.898973 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1f2f4f-211c-43a3-8ed9-9e79a45fa69a admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:16.903744 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af9e5a-aa21-4735-bd6c-de678799baaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:16.904555 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af9e5a-aa21-4735-bd6c-de678799baaf admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:16.904834 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af9e5a-aa21-4735-bd6c-de678799baaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:16.905105 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af9e5a-aa21-4735-bd6c-de678799baaf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:16.916591 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af9e5a-aa21-4735-bd6c-de678799baaf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:16.918658 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84af9e5a-aa21-4735-bd6c-de678799baaf admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:16.938098 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-84af9e5a-aa21-4735-bd6c-de678799baaf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:11:16.939547 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 615/1231] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:11:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:11:16.946294 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff25d298-3681-4e57-a3f0-f5a86b9355ca admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:16.957381 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff25d298-3681-4e57-a3f0-f5a86b9355ca admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:16.962242 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1021640-72bf-42c2-875f-dcd779295e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:16.962902 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1021640-72bf-42c2-875f-dcd779295e1c admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:16.963226 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1021640-72bf-42c2-875f-dcd779295e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:16.963464 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1021640-72bf-42c2-875f-dcd779295e1c admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:16.964190 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1021640-72bf-42c2-875f-dcd779295e1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:11:16.964472 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1021640-72bf-42c2-875f-dcd779295e1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:16.966036 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1021640-72bf-42c2-875f-dcd779295e1c admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:16.979216 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 617/1232] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:11:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:11:16.986108 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af9e5a-aa21-4735-bd6c-de678799baaf admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:16.998710 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af9e5a-aa21-4735-bd6c-de678799baaf admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:17.004724 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747944ef-92a9-4c25-ac04-e181371e9974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:17.005565 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747944ef-92a9-4c25-ac04-e181371e9974 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:17.005879 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747944ef-92a9-4c25-ac04-e181371e9974 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:17.006205 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747944ef-92a9-4c25-ac04-e181371e9974 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:17.015075 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747944ef-92a9-4c25-ac04-e181371e9974 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:17.017864 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747944ef-92a9-4c25-ac04-e181371e9974 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:17.033965 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-747944ef-92a9-4c25-ac04-e181371e9974 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 29 20:11:17.035315 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 616/1233] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:11:16 2021] GET /identity/v3/users/placement => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:11:17.042154 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1021640-72bf-42c2-875f-dcd779295e1c admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:17.053637 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1021640-72bf-42c2-875f-dcd779295e1c admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:17.058310 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c58b46f-ebbf-41ab-81ce-03e0608ee94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:17.059011 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58b46f-ebbf-41ab-81ce-03e0608ee94e admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:17.059290 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58b46f-ebbf-41ab-81ce-03e0608ee94e admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:17.059577 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58b46f-ebbf-41ab-81ce-03e0608ee94e admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:17.060421 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c58b46f-ebbf-41ab-81ce-03e0608ee94e admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:11:17.060722 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c58b46f-ebbf-41ab-81ce-03e0608ee94e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:17.063253 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c58b46f-ebbf-41ab-81ce-03e0608ee94e admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:17.081990 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 618/1234] 10.222.0.15 () {56 vars in 1164 bytes} [Mon Nov 29 20:11:17 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:11:17.088668 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747944ef-92a9-4c25-ac04-e181371e9974 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:17.100943 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747944ef-92a9-4c25-ac04-e181371e9974 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:17.105889 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d409d-1887-431b-b57c-a5fe011e6ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:17.106488 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d409d-1887-431b-b57c-a5fe011e6ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:17.106769 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d409d-1887-431b-b57c-a5fe011e6ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:17.107076 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851d409d-1887-431b-b57c-a5fe011e6ba5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:17.115387 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d409d-1887-431b-b57c-a5fe011e6ba5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:17.117180 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851d409d-1887-431b-b57c-a5fe011e6ba5 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:17.126754 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 617/1235] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:11:17 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 29 20:11:17.133110 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c58b46f-ebbf-41ab-81ce-03e0608ee94e admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:17.143535 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c58b46f-ebbf-41ab-81ce-03e0608ee94e admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:17.148311 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ffd4a5-d889-47ac-80fc-0380473129f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:17.149124 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffd4a5-d889-47ac-80fc-0380473129f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:17.149414 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffd4a5-d889-47ac-80fc-0380473129f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:17.149688 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffd4a5-d889-47ac-80fc-0380473129f8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:17.160544 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ffd4a5-d889-47ac-80fc-0380473129f8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:17.162841 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ffd4a5-d889-47ac-80fc-0380473129f8 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:17.181320 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-11ffd4a5-d889-47ac-80fc-0380473129f8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:11:17.182586 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 619/1236] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:11:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:11:17.189248 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d409d-1887-431b-b57c-a5fe011e6ba5 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:17.198527 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851d409d-1887-431b-b57c-a5fe011e6ba5 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:17.203489 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d6519-4ab8-4eed-a7af-d5b1e7d0a0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:17.204170 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d6519-4ab8-4eed-a7af-d5b1e7d0a0ad admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:17.204446 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d6519-4ab8-4eed-a7af-d5b1e7d0a0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:17.204712 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192d6519-4ab8-4eed-a7af-d5b1e7d0a0ad admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:17.205476 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d6519-4ab8-4eed-a7af-d5b1e7d0a0ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:11:17.205768 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d6519-4ab8-4eed-a7af-d5b1e7d0a0ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:17.207396 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192d6519-4ab8-4eed-a7af-d5b1e7d0a0ad admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:17.219698 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 618/1237] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:11:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:11:17.226104 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ffd4a5-d889-47ac-80fc-0380473129f8 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:17.236347 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ffd4a5-d889-47ac-80fc-0380473129f8 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:17.241156 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88b235-eb5c-4351-ac95-7eb41a05d549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:17.241999 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88b235-eb5c-4351-ac95-7eb41a05d549 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:17.242281 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88b235-eb5c-4351-ac95-7eb41a05d549 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:17.242595 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88b235-eb5c-4351-ac95-7eb41a05d549 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:17.249975 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d88b235-eb5c-4351-ac95-7eb41a05d549 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:17.251969 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d88b235-eb5c-4351-ac95-7eb41a05d549 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:17.267444 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-3d88b235-eb5c-4351-ac95-7eb41a05d549 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 29 20:11:17.268724 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 620/1238] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:11:17 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:11:17.275275 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d6519-4ab8-4eed-a7af-d5b1e7d0a0ad admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:17.285359 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192d6519-4ab8-4eed-a7af-d5b1e7d0a0ad admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:17.290480 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7490dd-be88-4709-aac1-3db8a8ba9a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:17.291149 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7490dd-be88-4709-aac1-3db8a8ba9a4c admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:17.291423 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7490dd-be88-4709-aac1-3db8a8ba9a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:17.291690 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7490dd-be88-4709-aac1-3db8a8ba9a4c admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:17.292588 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7490dd-be88-4709-aac1-3db8a8ba9a4c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:11:17.292899 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7490dd-be88-4709-aac1-3db8a8ba9a4c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:17.294767 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7490dd-be88-4709-aac1-3db8a8ba9a4c admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:17.308125 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 619/1239] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Nov 29 20:11:17 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:11:17.315152 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88b235-eb5c-4351-ac95-7eb41a05d549 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:17.326215 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88b235-eb5c-4351-ac95-7eb41a05d549 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:17.331672 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ef15a-2d95-4a68-b096-b074019a2c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:17.332360 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ef15a-2d95-4a68-b096-b074019a2c80 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:17.332643 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ef15a-2d95-4a68-b096-b074019a2c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:17.332963 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ef15a-2d95-4a68-b096-b074019a2c80 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:17.333858 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434ef15a-2d95-4a68-b096-b074019a2c80 admin admin] RBAC: Adding query filter params (role.id=4851b1a48d8a4188b335219acbede502, scope.project.id=6f4cba10fe824640b2ed37aab02346ac, user.id=b954c18d7e9349e899f4c1cd42b89166) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:11:17.334169 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434ef15a-2d95-4a68-b096-b074019a2c80 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:17.336147 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434ef15a-2d95-4a68-b096-b074019a2c80 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:17.341943 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 621/1240] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:11:17 2021] GET /identity/v3/role_assignments?user.id=b954c18d7e9349e899f4c1cd42b89166&scope.project.id=6f4cba10fe824640b2ed37aab02346ac&role.id=4851b1a48d8a4188b335219acbede502 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:11:19.739752 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed434074-d241-4c00-a6a3-2d9f3e85f072 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:19.740334 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed434074-d241-4c00-a6a3-2d9f3e85f072 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:19.740334 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed434074-d241-4c00-a6a3-2d9f3e85f072 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:19.742049 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 620/1241] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:11:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:11:19.748106 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbafbc-7c99-4e88-a75d-bedfb238ace1 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:19.748592 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbafbc-7c99-4e88-a75d-bedfb238ace1 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:19.748684 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbafbc-7c99-4e88-a75d-bedfb238ace1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:19.769429 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-23bbafbc-7c99-4e88-a75d-bedfb238ace1 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:11:19.770862 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-23bbafbc-7c99-4e88-a75d-bedfb238ace1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:11:19.779449 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 622/1242] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:11:19 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:11:19.802471 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed434074-d241-4c00-a6a3-2d9f3e85f072 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:19.814676 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed434074-d241-4c00-a6a3-2d9f3e85f072 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:19.819353 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9cb3c8-1c42-4fda-a8ad-8b1c5c355010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:19.820259 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cb3c8-1c42-4fda-a8ad-8b1c5c355010 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:19.820566 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cb3c8-1c42-4fda-a8ad-8b1c5c355010 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:19.820870 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9cb3c8-1c42-4fda-a8ad-8b1c5c355010 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:19.831906 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9cb3c8-1c42-4fda-a8ad-8b1c5c355010 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:11:19.838665 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-5a9cb3c8-1c42-4fda-a8ad-8b1c5c355010 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 29 20:11:19.839885 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 621/1243] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Nov 29 20:11:19 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:11:19.846644 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bbafbc-7c99-4e88-a75d-bedfb238ace1 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:19.856914 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bbafbc-7c99-4e88-a75d-bedfb238ace1 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:19.863272 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c4a73-316c-4ced-9746-658121798990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:19.864117 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c4a73-316c-4ced-9746-658121798990 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:19.864402 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c4a73-316c-4ced-9746-658121798990 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:19.864672 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c4a73-316c-4ced-9746-658121798990 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:19.865433 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c4a73-316c-4ced-9746-658121798990 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:11:19.865736 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c4a73-316c-4ced-9746-658121798990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:19.867381 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c4a73-316c-4ced-9746-658121798990 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:19.875900 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 623/1244] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Nov 29 20:11:19 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:11:19.883103 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9cb3c8-1c42-4fda-a8ad-8b1c5c355010 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:19.895424 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9cb3c8-1c42-4fda-a8ad-8b1c5c355010 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:19.901008 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ecfd9-e298-497c-8bc5-ff9d11b72349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:19.901896 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ecfd9-e298-497c-8bc5-ff9d11b72349 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:19.902206 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ecfd9-e298-497c-8bc5-ff9d11b72349 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:19.902478 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ecfd9-e298-497c-8bc5-ff9d11b72349 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:19.913692 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ecfd9-e298-497c-8bc5-ff9d11b72349 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:19.915731 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ecfd9-e298-497c-8bc5-ff9d11b72349 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:19.933795 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-4a4ecfd9-e298-497c-8bc5-ff9d11b72349 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:11:19.935172 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 622/1245] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:11:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:11:19.941764 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c4a73-316c-4ced-9746-658121798990 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:19.951627 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c4a73-316c-4ced-9746-658121798990 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:19.957028 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe6dbc-a847-4d37-a370-7ad2ef294c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:19.957678 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe6dbc-a847-4d37-a370-7ad2ef294c69 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:19.957975 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe6dbc-a847-4d37-a370-7ad2ef294c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:19.958217 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffe6dbc-a847-4d37-a370-7ad2ef294c69 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:19.959067 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe6dbc-a847-4d37-a370-7ad2ef294c69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:11:19.959345 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe6dbc-a847-4d37-a370-7ad2ef294c69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:19.960915 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffe6dbc-a847-4d37-a370-7ad2ef294c69 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:19.972932 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 624/1246] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:11:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:11:19.979489 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ecfd9-e298-497c-8bc5-ff9d11b72349 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:19.989236 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ecfd9-e298-497c-8bc5-ff9d11b72349 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:19.993965 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f535c9-28e1-43d3-8834-235b979dc215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:19.994709 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f535c9-28e1-43d3-8834-235b979dc215 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:19.994997 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f535c9-28e1-43d3-8834-235b979dc215 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:19.995267 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f535c9-28e1-43d3-8834-235b979dc215 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:20.002513 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f535c9-28e1-43d3-8834-235b979dc215 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:20.004559 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f535c9-28e1-43d3-8834-235b979dc215 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:20.018659 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-f4f535c9-28e1-43d3-8834-235b979dc215 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 29 20:11:20.019834 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 623/1247] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:11:19 2021] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:11:20.026350 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe6dbc-a847-4d37-a370-7ad2ef294c69 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:20.036284 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffe6dbc-a847-4d37-a370-7ad2ef294c69 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:20.041041 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61985fd-9fb9-492e-a75c-08c3fd0aa5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:20.041698 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61985fd-9fb9-492e-a75c-08c3fd0aa5ed admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:20.041975 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61985fd-9fb9-492e-a75c-08c3fd0aa5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:20.042243 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61985fd-9fb9-492e-a75c-08c3fd0aa5ed admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:20.043102 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61985fd-9fb9-492e-a75c-08c3fd0aa5ed admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:11:20.043403 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61985fd-9fb9-492e-a75c-08c3fd0aa5ed admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:20.045234 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61985fd-9fb9-492e-a75c-08c3fd0aa5ed admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:20.062229 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 625/1248] 10.222.0.15 () {56 vars in 1164 bytes} [Mon Nov 29 20:11:20 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:11:20.068796 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f535c9-28e1-43d3-8834-235b979dc215 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:20.079179 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f535c9-28e1-43d3-8834-235b979dc215 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:20.083965 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39132c3e-93d4-4296-ac32-c59db8647af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:20.084711 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39132c3e-93d4-4296-ac32-c59db8647af8 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:20.084984 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39132c3e-93d4-4296-ac32-c59db8647af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:20.085251 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39132c3e-93d4-4296-ac32-c59db8647af8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:20.096346 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39132c3e-93d4-4296-ac32-c59db8647af8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:20.098537 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39132c3e-93d4-4296-ac32-c59db8647af8 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:20.117495 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-39132c3e-93d4-4296-ac32-c59db8647af8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:11:20.118682 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 624/1249] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:11:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:11:20.125058 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61985fd-9fb9-492e-a75c-08c3fd0aa5ed admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:20.135520 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61985fd-9fb9-492e-a75c-08c3fd0aa5ed admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:20.140888 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc784cd-0e12-49a8-b2d9-d6ccb8e175ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:20.142028 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc784cd-0e12-49a8-b2d9-d6ccb8e175ff admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:20.142338 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc784cd-0e12-49a8-b2d9-d6ccb8e175ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:20.142639 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc784cd-0e12-49a8-b2d9-d6ccb8e175ff admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:20.143403 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc784cd-0e12-49a8-b2d9-d6ccb8e175ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:11:20.143707 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc784cd-0e12-49a8-b2d9-d6ccb8e175ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:20.145536 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc784cd-0e12-49a8-b2d9-d6ccb8e175ff admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:20.157929 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 626/1250] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:11:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:11:20.164293 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39132c3e-93d4-4296-ac32-c59db8647af8 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:20.175048 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39132c3e-93d4-4296-ac32-c59db8647af8 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:20.180533 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ead9f-bd7a-4d4e-ac2e-93893f70e1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:20.181410 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ead9f-bd7a-4d4e-ac2e-93893f70e1e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:20.181710 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ead9f-bd7a-4d4e-ac2e-93893f70e1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:20.181986 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ead9f-bd7a-4d4e-ac2e-93893f70e1e0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:20.189674 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ead9f-bd7a-4d4e-ac2e-93893f70e1e0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:20.191798 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ead9f-bd7a-4d4e-ac2e-93893f70e1e0 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:20.206518 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-f81ead9f-bd7a-4d4e-ac2e-93893f70e1e0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 29 20:11:20.207754 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 625/1251] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:11:20 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:11:20.214081 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc784cd-0e12-49a8-b2d9-d6ccb8e175ff admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:20.224161 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc784cd-0e12-49a8-b2d9-d6ccb8e175ff admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:20.229916 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd95ffbe-dfb4-4eed-9af0-c6c53420d976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:20.230564 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95ffbe-dfb4-4eed-9af0-c6c53420d976 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:20.230841 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95ffbe-dfb4-4eed-9af0-c6c53420d976 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:20.231133 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95ffbe-dfb4-4eed-9af0-c6c53420d976 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:20.231914 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd95ffbe-dfb4-4eed-9af0-c6c53420d976 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:11:20.232215 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd95ffbe-dfb4-4eed-9af0-c6c53420d976 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:20.234116 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd95ffbe-dfb4-4eed-9af0-c6c53420d976 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:20.246452 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 627/1252] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Nov 29 20:11:20 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:11:20.252915 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ead9f-bd7a-4d4e-ac2e-93893f70e1e0 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:20.263622 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ead9f-bd7a-4d4e-ac2e-93893f70e1e0 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:20.270086 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b2b37-a7e6-42f1-8178-b5679cd28791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:20.271058 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b2b37-a7e6-42f1-8178-b5679cd28791 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:20.271374 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b2b37-a7e6-42f1-8178-b5679cd28791 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:20.271655 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b2b37-a7e6-42f1-8178-b5679cd28791 admin admin] PATH_INFO: `/v3/projects/6f4cba10fe824640b2ed37aab02346ac/users/b954c18d7e9349e899f4c1cd42b89166/roles/4851b1a48d8a4188b335219acbede502` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:20.287517 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7b2b37-a7e6-42f1-8178-b5679cd28791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f4cba10fe824640b2ed37aab02346ac, user_id=b954c18d7e9349e899f4c1cd42b89166, role_id=4851b1a48d8a4188b335219acbede502)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:20.290168 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7b2b37-a7e6-42f1-8178-b5679cd28791 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:20.302507 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 626/1253] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Nov 29 20:11:20 2021] PUT /identity/v3/projects/6f4cba10fe824640b2ed37aab02346ac/users/b954c18d7e9349e899f4c1cd42b89166/roles/4851b1a48d8a4188b335219acbede502 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:11:22.879940 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd744d-ebb8-4969-b902-4fa767f3268b None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:22.880494 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd744d-ebb8-4969-b902-4fa767f3268b None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:22.880494 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd744d-ebb8-4969-b902-4fa767f3268b None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:22.882522 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 628/1254] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:11:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:11:22.889364 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679eb6c-d7d5-463f-a78f-3539d3bf4b57 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:22.889822 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679eb6c-d7d5-463f-a78f-3539d3bf4b57 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:22.889968 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679eb6c-d7d5-463f-a78f-3539d3bf4b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:22.911606 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-2679eb6c-d7d5-463f-a78f-3539d3bf4b57 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:11:22.913235 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-2679eb6c-d7d5-463f-a78f-3539d3bf4b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:11:22.978799 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 627/1255] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:11:22 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:11:23.010622 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd744d-ebb8-4969-b902-4fa767f3268b None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:23.025642 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd744d-ebb8-4969-b902-4fa767f3268b None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:23.031966 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db1732-3bab-4103-a5bf-995453751d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:23.032841 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db1732-3bab-4103-a5bf-995453751d8e admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:23.033242 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db1732-3bab-4103-a5bf-995453751d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:23.033569 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db1732-3bab-4103-a5bf-995453751d8e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:23.046136 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db1732-3bab-4103-a5bf-995453751d8e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:11:23.053841 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-58db1732-3bab-4103-a5bf-995453751d8e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Nov 29 20:11:23.055134 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 629/1256] 10.222.0.15 () {56 vars in 1123 bytes} [Mon Nov 29 20:11:23 2021] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:11:23.063795 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679eb6c-d7d5-463f-a78f-3539d3bf4b57 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:23.072973 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679eb6c-d7d5-463f-a78f-3539d3bf4b57 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:23.077893 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4167e9-e6fe-4587-a1bf-73fbeb1c1811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:23.078650 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4167e9-e6fe-4587-a1bf-73fbeb1c1811 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:23.078996 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4167e9-e6fe-4587-a1bf-73fbeb1c1811 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:23.079277 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4167e9-e6fe-4587-a1bf-73fbeb1c1811 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:23.080023 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4167e9-e6fe-4587-a1bf-73fbeb1c1811 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:11:23.080323 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4167e9-e6fe-4587-a1bf-73fbeb1c1811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:23.081932 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4167e9-e6fe-4587-a1bf-73fbeb1c1811 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:23.090976 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 628/1257] 10.222.0.15 () {56 vars in 1124 bytes} [Mon Nov 29 20:11:23 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:11:23.098456 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db1732-3bab-4103-a5bf-995453751d8e admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:23.109858 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db1732-3bab-4103-a5bf-995453751d8e admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:23.115042 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc72763-8b62-4d4f-8c8a-f412652c260c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:23.115816 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc72763-8b62-4d4f-8c8a-f412652c260c admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:23.116093 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc72763-8b62-4d4f-8c8a-f412652c260c admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:23.116359 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc72763-8b62-4d4f-8c8a-f412652c260c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:23.126654 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc72763-8b62-4d4f-8c8a-f412652c260c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:23.128541 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc72763-8b62-4d4f-8c8a-f412652c260c admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:23.145783 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-5bc72763-8b62-4d4f-8c8a-f412652c260c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:11:23.147037 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 630/1258] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:11:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:11:23.154896 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4167e9-e6fe-4587-a1bf-73fbeb1c1811 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:23.164984 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4167e9-e6fe-4587-a1bf-73fbeb1c1811 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:23.169651 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dace67-65eb-48f0-85b4-3ad1943898e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:23.170336 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dace67-65eb-48f0-85b4-3ad1943898e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:23.170640 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dace67-65eb-48f0-85b4-3ad1943898e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:23.170948 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dace67-65eb-48f0-85b4-3ad1943898e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:23.171760 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dace67-65eb-48f0-85b4-3ad1943898e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:11:23.172067 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dace67-65eb-48f0-85b4-3ad1943898e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:23.173722 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dace67-65eb-48f0-85b4-3ad1943898e8 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:23.185953 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 629/1259] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:11:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:11:23.193738 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc72763-8b62-4d4f-8c8a-f412652c260c admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:23.203927 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc72763-8b62-4d4f-8c8a-f412652c260c admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:23.209238 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a1011-61b1-48e8-a188-40eb9d9646c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:23.210358 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a1011-61b1-48e8-a188-40eb9d9646c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:23.210709 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a1011-61b1-48e8-a188-40eb9d9646c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:23.211025 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a1011-61b1-48e8-a188-40eb9d9646c3 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:23.219712 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a1011-61b1-48e8-a188-40eb9d9646c3 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:23.221749 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a1011-61b1-48e8-a188-40eb9d9646c3 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:23.236074 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-930a1011-61b1-48e8-a188-40eb9d9646c3 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 29 20:11:23.237206 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 631/1260] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:11:23 2021] GET /identity/v3/users/placement => generated 87 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:11:23.243771 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dace67-65eb-48f0-85b4-3ad1943898e8 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:23.254715 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dace67-65eb-48f0-85b4-3ad1943898e8 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:23.259634 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b38918-67a4-4303-87e3-fec45ccc6703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:23.260523 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b38918-67a4-4303-87e3-fec45ccc6703 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:23.260843 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b38918-67a4-4303-87e3-fec45ccc6703 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:23.261117 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b38918-67a4-4303-87e3-fec45ccc6703 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:23.262107 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b38918-67a4-4303-87e3-fec45ccc6703 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:11:23.262420 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b38918-67a4-4303-87e3-fec45ccc6703 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:23.264881 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b38918-67a4-4303-87e3-fec45ccc6703 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:23.286491 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 630/1261] 10.222.0.15 () {56 vars in 1164 bytes} [Mon Nov 29 20:11:23 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:11:23.293839 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a1011-61b1-48e8-a188-40eb9d9646c3 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:23.304758 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a1011-61b1-48e8-a188-40eb9d9646c3 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:23.310472 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790cf5e-2918-4d94-8547-c9d71042f304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:23.311345 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790cf5e-2918-4d94-8547-c9d71042f304 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:23.311651 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790cf5e-2918-4d94-8547-c9d71042f304 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:23.311952 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790cf5e-2918-4d94-8547-c9d71042f304 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:23.321013 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5790cf5e-2918-4d94-8547-c9d71042f304 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:23.323128 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5790cf5e-2918-4d94-8547-c9d71042f304 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:23.339328 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 632/1262] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:11:23 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:11:23.340435 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b38918-67a4-4303-87e3-fec45ccc6703 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:23.350431 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b38918-67a4-4303-87e3-fec45ccc6703 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:23.356166 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66123b-7843-4134-a8fd-cc4bc14610e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:23.356913 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66123b-7843-4134-a8fd-cc4bc14610e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:23.357177 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66123b-7843-4134-a8fd-cc4bc14610e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:23.357442 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c66123b-7843-4134-a8fd-cc4bc14610e1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:23.368753 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66123b-7843-4134-a8fd-cc4bc14610e1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:23.370621 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c66123b-7843-4134-a8fd-cc4bc14610e1 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:23.391582 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-0c66123b-7843-4134-a8fd-cc4bc14610e1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:11:23.392772 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 631/1263] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:11:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:11:23.400136 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790cf5e-2918-4d94-8547-c9d71042f304 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:23.411156 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790cf5e-2918-4d94-8547-c9d71042f304 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:23.417186 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797eed6-418c-4eec-bbd9-ed108483b697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:23.417853 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797eed6-418c-4eec-bbd9-ed108483b697 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:23.418128 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797eed6-418c-4eec-bbd9-ed108483b697 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:23.418401 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797eed6-418c-4eec-bbd9-ed108483b697 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:23.419153 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0797eed6-418c-4eec-bbd9-ed108483b697 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:11:23.419448 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0797eed6-418c-4eec-bbd9-ed108483b697 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:23.421057 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0797eed6-418c-4eec-bbd9-ed108483b697 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:23.433160 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 633/1264] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:11:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:11:23.439974 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66123b-7843-4134-a8fd-cc4bc14610e1 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:23.451237 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c66123b-7843-4134-a8fd-cc4bc14610e1 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:23.457465 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69057af-040c-49d7-8ea3-bf1efe26056c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:23.458466 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69057af-040c-49d7-8ea3-bf1efe26056c admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:23.458748 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69057af-040c-49d7-8ea3-bf1efe26056c admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:23.459115 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69057af-040c-49d7-8ea3-bf1efe26056c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:23.467425 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69057af-040c-49d7-8ea3-bf1efe26056c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:23.470211 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69057af-040c-49d7-8ea3-bf1efe26056c admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:23.486063 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-a69057af-040c-49d7-8ea3-bf1efe26056c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 29 20:11:23.487464 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 632/1265] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:11:23 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:11:23.493952 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797eed6-418c-4eec-bbd9-ed108483b697 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:23.504352 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797eed6-418c-4eec-bbd9-ed108483b697 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:23.509780 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2311e9a-767a-4bd4-85cc-9b9d3cc6acf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:23.510432 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2311e9a-767a-4bd4-85cc-9b9d3cc6acf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:23.510711 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2311e9a-767a-4bd4-85cc-9b9d3cc6acf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:23.511025 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2311e9a-767a-4bd4-85cc-9b9d3cc6acf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:23.511823 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2311e9a-767a-4bd4-85cc-9b9d3cc6acf3 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:11:23.512135 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2311e9a-767a-4bd4-85cc-9b9d3cc6acf3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:23.513987 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2311e9a-767a-4bd4-85cc-9b9d3cc6acf3 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:23.528872 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 634/1266] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Nov 29 20:11:23 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:11:23.535786 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69057af-040c-49d7-8ea3-bf1efe26056c admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:23.547114 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69057af-040c-49d7-8ea3-bf1efe26056c admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:23.552209 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc7ba37-fe5d-4eca-970e-fa92d9281a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:23.552864 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7ba37-fe5d-4eca-970e-fa92d9281a17 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:23.553146 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7ba37-fe5d-4eca-970e-fa92d9281a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:23.553418 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc7ba37-fe5d-4eca-970e-fa92d9281a17 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:23.554272 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7ba37-fe5d-4eca-970e-fa92d9281a17 admin admin] RBAC: Adding query filter params (role.id=4851b1a48d8a4188b335219acbede502, scope.project.id=6f4cba10fe824640b2ed37aab02346ac, user.id=b954c18d7e9349e899f4c1cd42b89166) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:11:23.554771 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7ba37-fe5d-4eca-970e-fa92d9281a17 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:23.556555 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc7ba37-fe5d-4eca-970e-fa92d9281a17 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:23.562947 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 633/1267] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:11:23 2021] GET /identity/v3/role_assignments?user.id=b954c18d7e9349e899f4c1cd42b89166&scope.project.id=6f4cba10fe824640b2ed37aab02346ac&role.id=4851b1a48d8a4188b335219acbede502 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:11:26.057652 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe81beb-6844-4bfa-8ee6-19e7c283bf33 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:26.058205 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe81beb-6844-4bfa-8ee6-19e7c283bf33 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:26.058296 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe81beb-6844-4bfa-8ee6-19e7c283bf33 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:26.060469 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 635/1268] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:11:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:11:26.066876 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642c857-460c-431a-a11b-78e5d1ee4064 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:26.067325 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642c857-460c-431a-a11b-78e5d1ee4064 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:26.067456 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642c857-460c-431a-a11b-78e5d1ee4064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:26.086154 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-5642c857-460c-431a-a11b-78e5d1ee4064 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:11:26.087314 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-5642c857-460c-431a-a11b-78e5d1ee4064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:11:26.095469 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 634/1269] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:11:26 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:11:26.121780 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe81beb-6844-4bfa-8ee6-19e7c283bf33 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:26.137299 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe81beb-6844-4bfa-8ee6-19e7c283bf33 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:26.145172 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b727c-9104-46ac-b692-56f3aedb10c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:26.145961 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b727c-9104-46ac-b692-56f3aedb10c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:26.146239 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b727c-9104-46ac-b692-56f3aedb10c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:26.146504 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b727c-9104-46ac-b692-56f3aedb10c7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:26.159664 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64b727c-9104-46ac-b692-56f3aedb10c7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:11:26.169626 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-e64b727c-9104-46ac-b692-56f3aedb10c7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 29 20:11:26.171027 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 636/1270] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Nov 29 20:11:26 2021] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:11:26.177733 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642c857-460c-431a-a11b-78e5d1ee4064 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:26.187716 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642c857-460c-431a-a11b-78e5d1ee4064 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:26.193293 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a2204-4f59-4e9e-847d-950af96c3b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:26.194201 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a2204-4f59-4e9e-847d-950af96c3b7b admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:26.194657 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a2204-4f59-4e9e-847d-950af96c3b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:26.195195 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a2204-4f59-4e9e-847d-950af96c3b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:26.196171 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a2204-4f59-4e9e-847d-950af96c3b7b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:11:26.196504 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a2204-4f59-4e9e-847d-950af96c3b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:26.198082 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a2204-4f59-4e9e-847d-950af96c3b7b admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:26.213708 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b727c-9104-46ac-b692-56f3aedb10c7 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:26.214140 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 635/1271] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:11:26 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:11:26.225602 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b727c-9104-46ac-b692-56f3aedb10c7 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:26.230203 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8358f18-6bda-40ed-9449-32bfb7df384e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:26.231016 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8358f18-6bda-40ed-9449-32bfb7df384e admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:26.231299 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8358f18-6bda-40ed-9449-32bfb7df384e admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:26.231573 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8358f18-6bda-40ed-9449-32bfb7df384e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:26.241862 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8358f18-6bda-40ed-9449-32bfb7df384e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:26.243872 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8358f18-6bda-40ed-9449-32bfb7df384e admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:26.261679 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-d8358f18-6bda-40ed-9449-32bfb7df384e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:11:26.263102 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 637/1272] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:11:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:11:26.269619 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a2204-4f59-4e9e-847d-950af96c3b7b admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:26.281132 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a2204-4f59-4e9e-847d-950af96c3b7b admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:26.285646 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00578c-bfa4-4bdd-853c-06ea19e27a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:26.286657 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00578c-bfa4-4bdd-853c-06ea19e27a69 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:26.287042 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00578c-bfa4-4bdd-853c-06ea19e27a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:26.287503 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00578c-bfa4-4bdd-853c-06ea19e27a69 admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:26.288376 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac00578c-bfa4-4bdd-853c-06ea19e27a69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:11:26.288704 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac00578c-bfa4-4bdd-853c-06ea19e27a69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:26.290776 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac00578c-bfa4-4bdd-853c-06ea19e27a69 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:26.304010 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 636/1273] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:11:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:11:26.310754 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8358f18-6bda-40ed-9449-32bfb7df384e admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:26.321686 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8358f18-6bda-40ed-9449-32bfb7df384e admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:26.326598 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d71fb-b6da-4ff3-96f6-476f95382b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:26.327514 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d71fb-b6da-4ff3-96f6-476f95382b83 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:26.327795 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d71fb-b6da-4ff3-96f6-476f95382b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:26.328071 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d71fb-b6da-4ff3-96f6-476f95382b83 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:26.338358 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544d71fb-b6da-4ff3-96f6-476f95382b83 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:26.340401 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544d71fb-b6da-4ff3-96f6-476f95382b83 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:26.361580 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-544d71fb-b6da-4ff3-96f6-476f95382b83 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 29 20:11:26.363034 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 638/1274] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:11:26 2021] GET /identity/v3/users/placement => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:11:26.369930 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00578c-bfa4-4bdd-853c-06ea19e27a69 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:26.381147 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00578c-bfa4-4bdd-853c-06ea19e27a69 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:26.386877 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f63e4a1-09e0-4c9f-a57c-0e9243c1e564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:26.387637 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63e4a1-09e0-4c9f-a57c-0e9243c1e564 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:26.387959 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63e4a1-09e0-4c9f-a57c-0e9243c1e564 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:26.388265 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63e4a1-09e0-4c9f-a57c-0e9243c1e564 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:26.389302 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f63e4a1-09e0-4c9f-a57c-0e9243c1e564 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:11:26.389717 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f63e4a1-09e0-4c9f-a57c-0e9243c1e564 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:26.392356 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f63e4a1-09e0-4c9f-a57c-0e9243c1e564 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:26.414904 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 637/1275] 10.222.0.15 () {56 vars in 1164 bytes} [Mon Nov 29 20:11:26 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:11:26.419808 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d71fb-b6da-4ff3-96f6-476f95382b83 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:26.431002 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544d71fb-b6da-4ff3-96f6-476f95382b83 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:26.436533 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e4dd8-2678-46c4-a166-f3585b6794fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:26.437312 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e4dd8-2678-46c4-a166-f3585b6794fe admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:26.437629 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e4dd8-2678-46c4-a166-f3585b6794fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:26.437997 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e4dd8-2678-46c4-a166-f3585b6794fe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:26.450872 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e4dd8-2678-46c4-a166-f3585b6794fe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:26.450872 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e4dd8-2678-46c4-a166-f3585b6794fe admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:26.458725 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 639/1276] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:11:26 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 29 20:11:26.465306 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f63e4a1-09e0-4c9f-a57c-0e9243c1e564 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:26.478085 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f63e4a1-09e0-4c9f-a57c-0e9243c1e564 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:26.483481 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0be36f-f3c9-4d97-bc81-a400837d2430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:26.484324 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0be36f-f3c9-4d97-bc81-a400837d2430 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:26.484600 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0be36f-f3c9-4d97-bc81-a400837d2430 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:26.484869 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0be36f-f3c9-4d97-bc81-a400837d2430 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:26.496416 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0be36f-f3c9-4d97-bc81-a400837d2430 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:26.498823 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0be36f-f3c9-4d97-bc81-a400837d2430 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:26.518497 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-ba0be36f-f3c9-4d97-bc81-a400837d2430 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:11:26.519904 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 638/1277] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:11:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:11:26.526603 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e4dd8-2678-46c4-a166-f3585b6794fe admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:26.538029 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e4dd8-2678-46c4-a166-f3585b6794fe admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:26.543716 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad112eef-9782-4ec9-a448-b919d360b6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:26.544420 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad112eef-9782-4ec9-a448-b919d360b6bd admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:26.544726 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad112eef-9782-4ec9-a448-b919d360b6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:26.545078 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad112eef-9782-4ec9-a448-b919d360b6bd admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:26.545897 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad112eef-9782-4ec9-a448-b919d360b6bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:11:26.546281 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad112eef-9782-4ec9-a448-b919d360b6bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:26.548188 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad112eef-9782-4ec9-a448-b919d360b6bd admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:26.563143 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 640/1278] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:11:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:11:26.570101 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0be36f-f3c9-4d97-bc81-a400837d2430 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:26.581380 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0be36f-f3c9-4d97-bc81-a400837d2430 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:26.587047 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599a7ed-292a-4764-90ca-8a3edee2e89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:26.587882 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599a7ed-292a-4764-90ca-8a3edee2e89d admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:26.588196 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599a7ed-292a-4764-90ca-8a3edee2e89d admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:26.588521 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599a7ed-292a-4764-90ca-8a3edee2e89d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:26.596467 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d599a7ed-292a-4764-90ca-8a3edee2e89d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:26.598496 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d599a7ed-292a-4764-90ca-8a3edee2e89d admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:26.611729 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-d599a7ed-292a-4764-90ca-8a3edee2e89d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 29 20:11:26.618744 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 639/1279] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:11:26 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:11:26.620073 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad112eef-9782-4ec9-a448-b919d360b6bd admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:26.629867 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad112eef-9782-4ec9-a448-b919d360b6bd admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:26.634759 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2babd6ed-c770-47e4-b587-84138bbae271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:26.635437 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babd6ed-c770-47e4-b587-84138bbae271 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:26.635718 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babd6ed-c770-47e4-b587-84138bbae271 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:26.635991 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babd6ed-c770-47e4-b587-84138bbae271 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:26.636789 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2babd6ed-c770-47e4-b587-84138bbae271 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:11:26.637095 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2babd6ed-c770-47e4-b587-84138bbae271 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:26.639168 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2babd6ed-c770-47e4-b587-84138bbae271 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:26.653084 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 641/1280] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Nov 29 20:11:26 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:11:26.659966 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599a7ed-292a-4764-90ca-8a3edee2e89d admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:26.670896 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599a7ed-292a-4764-90ca-8a3edee2e89d admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:26.676225 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f52f8c-23e1-40aa-8130-6d04e2a2d65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:26.676976 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f52f8c-23e1-40aa-8130-6d04e2a2d65a admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:26.677261 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f52f8c-23e1-40aa-8130-6d04e2a2d65a admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:26.677533 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f52f8c-23e1-40aa-8130-6d04e2a2d65a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:26.678387 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f52f8c-23e1-40aa-8130-6d04e2a2d65a admin admin] RBAC: Adding query filter params (role.id=33d95c7861b64f1a95af8a333bd626ea, scope.project.id=6f4cba10fe824640b2ed37aab02346ac, user.id=b954c18d7e9349e899f4c1cd42b89166) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:11:26.678693 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f52f8c-23e1-40aa-8130-6d04e2a2d65a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:26.680713 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f52f8c-23e1-40aa-8130-6d04e2a2d65a admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:26.696840 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 640/1281] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:11:26 2021] GET /identity/v3/role_assignments?user.id=b954c18d7e9349e899f4c1cd42b89166&scope.project.id=6f4cba10fe824640b2ed37aab02346ac&role.id=33d95c7861b64f1a95af8a333bd626ea => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:11:29.217822 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fa9b7-3636-4559-900d-bdf2f8031701 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:29.218470 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fa9b7-3636-4559-900d-bdf2f8031701 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:29.218470 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683fa9b7-3636-4559-900d-bdf2f8031701 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:29.220324 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 642/1282] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:11:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:11:29.227003 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336cb756-888e-44d4-957f-ec684ffeead0 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:29.227937 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336cb756-888e-44d4-957f-ec684ffeead0 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:29.227937 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336cb756-888e-44d4-957f-ec684ffeead0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:29.246414 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-336cb756-888e-44d4-957f-ec684ffeead0 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:11:29.247666 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-336cb756-888e-44d4-957f-ec684ffeead0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:11:29.257169 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 641/1283] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:11:29 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:11:29.283316 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683fa9b7-3636-4559-900d-bdf2f8031701 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:29.297504 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683fa9b7-3636-4559-900d-bdf2f8031701 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:29.302224 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24934cdb-900f-4adb-a280-446b7efb06b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:29.303042 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24934cdb-900f-4adb-a280-446b7efb06b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:29.303323 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24934cdb-900f-4adb-a280-446b7efb06b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:29.303595 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24934cdb-900f-4adb-a280-446b7efb06b3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:29.316246 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24934cdb-900f-4adb-a280-446b7efb06b3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:11:29.323647 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-24934cdb-900f-4adb-a280-446b7efb06b3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 29 20:11:29.324852 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 643/1284] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Nov 29 20:11:29 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:11:29.332534 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336cb756-888e-44d4-957f-ec684ffeead0 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:29.342600 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336cb756-888e-44d4-957f-ec684ffeead0 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:29.348182 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f5e8e-13da-4aac-b5d5-b609968f597a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:29.348842 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f5e8e-13da-4aac-b5d5-b609968f597a admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:29.349117 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f5e8e-13da-4aac-b5d5-b609968f597a admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:29.349389 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f5e8e-13da-4aac-b5d5-b609968f597a admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:29.350145 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85f5e8e-13da-4aac-b5d5-b609968f597a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:11:29.350438 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85f5e8e-13da-4aac-b5d5-b609968f597a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:29.352043 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85f5e8e-13da-4aac-b5d5-b609968f597a admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:29.360665 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 642/1285] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:11:29 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:11:29.367934 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24934cdb-900f-4adb-a280-446b7efb06b3 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:29.378656 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24934cdb-900f-4adb-a280-446b7efb06b3 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:29.384012 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563e4b1-abe8-405c-bc1e-b76074bcde56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:29.384869 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563e4b1-abe8-405c-bc1e-b76074bcde56 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:29.385183 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563e4b1-abe8-405c-bc1e-b76074bcde56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:29.385524 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c563e4b1-abe8-405c-bc1e-b76074bcde56 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:29.398641 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563e4b1-abe8-405c-bc1e-b76074bcde56 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:29.400682 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c563e4b1-abe8-405c-bc1e-b76074bcde56 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:29.418723 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-c563e4b1-abe8-405c-bc1e-b76074bcde56 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:11:29.420044 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 644/1286] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:11:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:11:29.427442 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f5e8e-13da-4aac-b5d5-b609968f597a admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:29.437888 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f5e8e-13da-4aac-b5d5-b609968f597a admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:29.443233 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05985a6-709e-465f-b562-ff5d1fb5a45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:29.444064 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05985a6-709e-465f-b562-ff5d1fb5a45d admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:29.444449 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05985a6-709e-465f-b562-ff5d1fb5a45d admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:29.444775 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05985a6-709e-465f-b562-ff5d1fb5a45d admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:29.445508 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05985a6-709e-465f-b562-ff5d1fb5a45d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:11:29.445964 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05985a6-709e-465f-b562-ff5d1fb5a45d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:29.447915 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05985a6-709e-465f-b562-ff5d1fb5a45d admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:29.462323 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 643/1287] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:11:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:11:29.468700 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563e4b1-abe8-405c-bc1e-b76074bcde56 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:29.479444 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c563e4b1-abe8-405c-bc1e-b76074bcde56 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:29.485619 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd70f4c-fbb6-4a14-9ddc-131449c203c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:29.486588 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd70f4c-fbb6-4a14-9ddc-131449c203c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:29.486977 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd70f4c-fbb6-4a14-9ddc-131449c203c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:29.487310 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd70f4c-fbb6-4a14-9ddc-131449c203c8 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:29.496612 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd70f4c-fbb6-4a14-9ddc-131449c203c8 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:29.498878 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd70f4c-fbb6-4a14-9ddc-131449c203c8 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:29.514695 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-6dd70f4c-fbb6-4a14-9ddc-131449c203c8 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 29 20:11:29.516358 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 645/1288] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:11:29 2021] GET /identity/v3/users/placement => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:11:29.522774 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05985a6-709e-465f-b562-ff5d1fb5a45d admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:29.536089 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05985a6-709e-465f-b562-ff5d1fb5a45d admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:29.543597 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888d20d-6cea-4402-895c-f4de0cd81331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:29.544273 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888d20d-6cea-4402-895c-f4de0cd81331 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:29.546499 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888d20d-6cea-4402-895c-f4de0cd81331 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:29.546499 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888d20d-6cea-4402-895c-f4de0cd81331 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:29.546499 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5888d20d-6cea-4402-895c-f4de0cd81331 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:11:29.546778 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5888d20d-6cea-4402-895c-f4de0cd81331 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:29.548678 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5888d20d-6cea-4402-895c-f4de0cd81331 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:29.574263 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 644/1289] 10.222.0.15 () {56 vars in 1164 bytes} [Mon Nov 29 20:11:29 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:11:29.581007 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd70f4c-fbb6-4a14-9ddc-131449c203c8 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:29.591932 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd70f4c-fbb6-4a14-9ddc-131449c203c8 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:29.597647 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e922c-60e1-4020-8bfd-c00282eb0798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:29.598510 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e922c-60e1-4020-8bfd-c00282eb0798 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:29.598789 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e922c-60e1-4020-8bfd-c00282eb0798 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:29.599120 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246e922c-60e1-4020-8bfd-c00282eb0798 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:29.611739 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246e922c-60e1-4020-8bfd-c00282eb0798 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:29.613649 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246e922c-60e1-4020-8bfd-c00282eb0798 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:29.631502 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-246e922c-60e1-4020-8bfd-c00282eb0798 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:11:29.632715 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 646/1290] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:11:29 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:11:29.640054 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888d20d-6cea-4402-895c-f4de0cd81331 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:29.651289 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888d20d-6cea-4402-895c-f4de0cd81331 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:29.656931 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1d0fc-6ed3-4d50-85ef-280681990d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:29.658366 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1d0fc-6ed3-4d50-85ef-280681990d70 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:29.658713 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1d0fc-6ed3-4d50-85ef-280681990d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:29.659128 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb1d0fc-6ed3-4d50-85ef-280681990d70 admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:29.660058 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb1d0fc-6ed3-4d50-85ef-280681990d70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:11:29.660359 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb1d0fc-6ed3-4d50-85ef-280681990d70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:29.662248 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb1d0fc-6ed3-4d50-85ef-280681990d70 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:29.674575 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 645/1291] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:11:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:11:29.681927 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e922c-60e1-4020-8bfd-c00282eb0798 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:29.692534 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246e922c-60e1-4020-8bfd-c00282eb0798 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:29.697645 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b39876-29d9-4113-b03c-00b87ca9b8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:29.698495 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b39876-29d9-4113-b03c-00b87ca9b8ab admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:29.698785 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b39876-29d9-4113-b03c-00b87ca9b8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:29.699091 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b39876-29d9-4113-b03c-00b87ca9b8ab admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:29.706657 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b39876-29d9-4113-b03c-00b87ca9b8ab admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:29.708654 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b39876-29d9-4113-b03c-00b87ca9b8ab admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:29.723629 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-b7b39876-29d9-4113-b03c-00b87ca9b8ab admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 29 20:11:29.725063 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 647/1292] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:11:29 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:11:29.732008 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1d0fc-6ed3-4d50-85ef-280681990d70 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:29.745765 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb1d0fc-6ed3-4d50-85ef-280681990d70 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:29.751033 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050a130-59a2-48a6-9453-816abe2fd39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:29.751697 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050a130-59a2-48a6-9453-816abe2fd39c admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:29.751980 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050a130-59a2-48a6-9453-816abe2fd39c admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:29.752256 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050a130-59a2-48a6-9453-816abe2fd39c admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:29.753061 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050a130-59a2-48a6-9453-816abe2fd39c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:11:29.753381 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050a130-59a2-48a6-9453-816abe2fd39c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:29.755288 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050a130-59a2-48a6-9453-816abe2fd39c admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:29.774611 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 646/1293] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Nov 29 20:11:29 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:11:29.775772 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b39876-29d9-4113-b03c-00b87ca9b8ab admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:29.786166 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b39876-29d9-4113-b03c-00b87ca9b8ab admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:29.791503 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd75233-0a52-4a10-9ec7-e9f3d4807736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:29.792404 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd75233-0a52-4a10-9ec7-e9f3d4807736 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:29.792676 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd75233-0a52-4a10-9ec7-e9f3d4807736 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:29.792942 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd75233-0a52-4a10-9ec7-e9f3d4807736 admin admin] PATH_INFO: `/v3/projects/6f4cba10fe824640b2ed37aab02346ac/users/b954c18d7e9349e899f4c1cd42b89166/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:29.795125 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd75233-0a52-4a10-9ec7-e9f3d4807736 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f4cba10fe824640b2ed37aab02346ac, user_id=b954c18d7e9349e899f4c1cd42b89166, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:29.797799 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd75233-0a52-4a10-9ec7-e9f3d4807736 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:29.812038 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 648/1294] 10.222.0.15 () {58 vars in 1460 bytes} [Mon Nov 29 20:11:29 2021] PUT /identity/v3/projects/6f4cba10fe824640b2ed37aab02346ac/users/b954c18d7e9349e899f4c1cd42b89166/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:11:32.240687 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c3d92-d035-4f4e-9fef-c50c22356c90 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:32.241576 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c3d92-d035-4f4e-9fef-c50c22356c90 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:32.241576 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c3d92-d035-4f4e-9fef-c50c22356c90 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:32.244526 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 647/1295] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:11:32 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:11:32.250394 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c454372-f5bf-405a-9898-22f18577a171 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:32.250828 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c454372-f5bf-405a-9898-22f18577a171 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:32.250955 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c454372-f5bf-405a-9898-22f18577a171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:32.270433 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-1c454372-f5bf-405a-9898-22f18577a171 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:11:32.271650 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-1c454372-f5bf-405a-9898-22f18577a171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:11:32.333569 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 649/1296] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:11:32 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:11:32.358121 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c3d92-d035-4f4e-9fef-c50c22356c90 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:32.382313 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c3d92-d035-4f4e-9fef-c50c22356c90 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:32.390267 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4295508-6715-4da9-895e-84d19242fdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:32.391408 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4295508-6715-4da9-895e-84d19242fdfb admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:32.391698 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4295508-6715-4da9-895e-84d19242fdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:32.391960 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4295508-6715-4da9-895e-84d19242fdfb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:32.403093 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4295508-6715-4da9-895e-84d19242fdfb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Nov 29 20:11:32.409905 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-d4295508-6715-4da9-895e-84d19242fdfb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Nov 29 20:11:32.411065 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 648/1297] 10.222.0.15 () {56 vars in 1117 bytes} [Mon Nov 29 20:11:32 2021] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:11:32.420161 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c454372-f5bf-405a-9898-22f18577a171 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:32.429609 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c454372-f5bf-405a-9898-22f18577a171 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:32.435388 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97ffd4-5998-4edb-b8cf-9d4eee9c6bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:32.436038 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97ffd4-5998-4edb-b8cf-9d4eee9c6bde admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:32.436314 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97ffd4-5998-4edb-b8cf-9d4eee9c6bde admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:32.436625 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97ffd4-5998-4edb-b8cf-9d4eee9c6bde admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:32.437372 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d97ffd4-5998-4edb-b8cf-9d4eee9c6bde admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:11:32.437672 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d97ffd4-5998-4edb-b8cf-9d4eee9c6bde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:32.439283 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d97ffd4-5998-4edb-b8cf-9d4eee9c6bde admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:32.447579 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 650/1298] 10.222.0.15 () {56 vars in 1120 bytes} [Mon Nov 29 20:11:32 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:11:32.454117 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4295508-6715-4da9-895e-84d19242fdfb admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:32.469766 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4295508-6715-4da9-895e-84d19242fdfb admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:32.475850 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a8f8c-1f52-44f2-9fec-768e69f2334d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:32.476596 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a8f8c-1f52-44f2-9fec-768e69f2334d admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:32.476870 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a8f8c-1f52-44f2-9fec-768e69f2334d admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:32.477132 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a8f8c-1f52-44f2-9fec-768e69f2334d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:32.489372 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a8f8c-1f52-44f2-9fec-768e69f2334d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:32.492333 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110a8f8c-1f52-44f2-9fec-768e69f2334d admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:32.512127 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-110a8f8c-1f52-44f2-9fec-768e69f2334d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:11:32.513271 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 649/1299] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:11:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:11:32.520566 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97ffd4-5998-4edb-b8cf-9d4eee9c6bde admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:32.535983 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97ffd4-5998-4edb-b8cf-9d4eee9c6bde admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:32.543217 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31701374-cba9-45ce-aeff-d07d312f7f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:32.544226 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31701374-cba9-45ce-aeff-d07d312f7f97 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:32.544634 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31701374-cba9-45ce-aeff-d07d312f7f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:32.545024 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31701374-cba9-45ce-aeff-d07d312f7f97 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:32.546246 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31701374-cba9-45ce-aeff-d07d312f7f97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:11:32.546766 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31701374-cba9-45ce-aeff-d07d312f7f97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:32.549243 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31701374-cba9-45ce-aeff-d07d312f7f97 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:32.565880 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 651/1300] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:11:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:11:32.572649 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a8f8c-1f52-44f2-9fec-768e69f2334d admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:32.584533 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a8f8c-1f52-44f2-9fec-768e69f2334d admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:32.590690 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626e701-70cb-48dc-abee-3bff24621d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:32.591722 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626e701-70cb-48dc-abee-3bff24621d0a admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:32.592080 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626e701-70cb-48dc-abee-3bff24621d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:32.592383 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626e701-70cb-48dc-abee-3bff24621d0a admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:32.600306 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626e701-70cb-48dc-abee-3bff24621d0a admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:32.602356 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626e701-70cb-48dc-abee-3bff24621d0a admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:32.616606 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-b626e701-70cb-48dc-abee-3bff24621d0a admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Nov 29 20:11:32.617737 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 650/1301] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:11:32 2021] GET /identity/v3/users/placement => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:11:32.624586 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31701374-cba9-45ce-aeff-d07d312f7f97 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:32.641469 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31701374-cba9-45ce-aeff-d07d312f7f97 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:32.650777 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5d735-acf4-43aa-a895-9eff885917bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:32.651784 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5d735-acf4-43aa-a895-9eff885917bd admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:32.652190 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5d735-acf4-43aa-a895-9eff885917bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:32.652585 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5d735-acf4-43aa-a895-9eff885917bd admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:32.653892 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f5d735-acf4-43aa-a895-9eff885917bd admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:11:32.654353 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f5d735-acf4-43aa-a895-9eff885917bd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:32.656641 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f5d735-acf4-43aa-a895-9eff885917bd admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:32.676272 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 652/1302] 10.222.0.15 () {56 vars in 1164 bytes} [Mon Nov 29 20:11:32 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:11:32.685634 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626e701-70cb-48dc-abee-3bff24621d0a admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:32.696669 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626e701-70cb-48dc-abee-3bff24621d0a admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:32.702458 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1d8736-c3b2-4271-83a9-c3d3d8f2e447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:32.703120 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d8736-c3b2-4271-83a9-c3d3d8f2e447 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:32.703397 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d8736-c3b2-4271-83a9-c3d3d8f2e447 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:32.703667 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d8736-c3b2-4271-83a9-c3d3d8f2e447 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:32.712583 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1d8736-c3b2-4271-83a9-c3d3d8f2e447 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:32.714326 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1d8736-c3b2-4271-83a9-c3d3d8f2e447 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:32.723396 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 651/1303] 10.222.0.15 () {58 vars in 1324 bytes} [Mon Nov 29 20:11:32 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:11:32.729839 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5d735-acf4-43aa-a895-9eff885917bd admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:32.745412 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5d735-acf4-43aa-a895-9eff885917bd admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:32.752939 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45a2df-52c8-48ca-930a-a6cef5f5d904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:32.753707 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45a2df-52c8-48ca-930a-a6cef5f5d904 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:32.753990 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45a2df-52c8-48ca-930a-a6cef5f5d904 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:32.754294 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45a2df-52c8-48ca-930a-a6cef5f5d904 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:32.765461 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45a2df-52c8-48ca-930a-a6cef5f5d904 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:32.767641 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45a2df-52c8-48ca-930a-a6cef5f5d904 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:32.785017 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-db45a2df-52c8-48ca-930a-a6cef5f5d904 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Nov 29 20:11:32.786128 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 653/1304] 10.222.0.15 () {56 vars in 1129 bytes} [Mon Nov 29 20:11:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Nov 29 20:11:32.792063 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1d8736-c3b2-4271-83a9-c3d3d8f2e447 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:32.801597 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1d8736-c3b2-4271-83a9-c3d3d8f2e447 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:32.808020 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31a856-34b4-4f93-829c-f0a554075f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:32.808615 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31a856-34b4-4f93-829c-f0a554075f15 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:32.808884 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31a856-34b4-4f93-829c-f0a554075f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:32.809149 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31a856-34b4-4f93-829c-f0a554075f15 admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:32.809863 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31a856-34b4-4f93-829c-f0a554075f15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:11:32.810159 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31a856-34b4-4f93-829c-f0a554075f15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:32.811854 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31a856-34b4-4f93-829c-f0a554075f15 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:32.824693 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 652/1305] 10.222.0.15 () {56 vars in 1130 bytes} [Mon Nov 29 20:11:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:11:32.830749 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45a2df-52c8-48ca-930a-a6cef5f5d904 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:32.840602 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45a2df-52c8-48ca-930a-a6cef5f5d904 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:32.846505 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee52518-fce1-436a-b88d-636d399557a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:32.847328 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee52518-fce1-436a-b88d-636d399557a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:32.847605 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee52518-fce1-436a-b88d-636d399557a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:32.847877 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee52518-fce1-436a-b88d-636d399557a7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:32.855337 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee52518-fce1-436a-b88d-636d399557a7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:32.857295 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee52518-fce1-436a-b88d-636d399557a7 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:32.870834 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING keystone.server.flask.application [None req-2ee52518-fce1-436a-b88d-636d399557a7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Nov 29 20:11:32.871973 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 654/1306] 10.222.0.15 () {56 vars in 1132 bytes} [Mon Nov 29 20:11:32 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:11:32.878042 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31a856-34b4-4f93-829c-f0a554075f15 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:32.888014 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31a856-34b4-4f93-829c-f0a554075f15 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:32.894577 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d526ea-f498-4cc0-a721-9b417bec9e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:32.895245 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d526ea-f498-4cc0-a721-9b417bec9e15 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:32.895520 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d526ea-f498-4cc0-a721-9b417bec9e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:32.895781 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d526ea-f498-4cc0-a721-9b417bec9e15 admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:32.896536 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d526ea-f498-4cc0-a721-9b417bec9e15 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:11:32.896837 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d526ea-f498-4cc0-a721-9b417bec9e15 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:32.898640 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d526ea-f498-4cc0-a721-9b417bec9e15 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:32.911822 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 653/1307] 10.222.0.15 () {56 vars in 1169 bytes} [Mon Nov 29 20:11:32 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:11:32.918154 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee52518-fce1-436a-b88d-636d399557a7 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:32.929158 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee52518-fce1-436a-b88d-636d399557a7 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:32.935045 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef89ca-aacc-46ac-9a60-2fbabad785e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:32.935665 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef89ca-aacc-46ac-9a60-2fbabad785e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:32.935940 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef89ca-aacc-46ac-9a60-2fbabad785e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:32.936205 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef89ca-aacc-46ac-9a60-2fbabad785e1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:32.937028 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef89ca-aacc-46ac-9a60-2fbabad785e1 admin admin] RBAC: Adding query filter params (role.id=33d95c7861b64f1a95af8a333bd626ea, scope.project.id=6f4cba10fe824640b2ed37aab02346ac, user.id=b954c18d7e9349e899f4c1cd42b89166) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:11:32.937330 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef89ca-aacc-46ac-9a60-2fbabad785e1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:32.939171 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ef89ca-aacc-46ac-9a60-2fbabad785e1 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:32.944995 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 655/1308] 10.222.0.15 () {56 vars in 1395 bytes} [Mon Nov 29 20:11:32 2021] GET /identity/v3/role_assignments?user.id=b954c18d7e9349e899f4c1cd42b89166&scope.project.id=6f4cba10fe824640b2ed37aab02346ac&role.id=33d95c7861b64f1a95af8a333bd626ea => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:11:35.295762 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a721a-4570-44af-9222-8f6463314695 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:35.296611 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a721a-4570-44af-9222-8f6463314695 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:35.296777 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a721a-4570-44af-9222-8f6463314695 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:35.299815 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 654/1309] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:11:35 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:11:35.306895 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6ed26-3347-4381-a8a3-2a02364d883c None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:35.307323 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6ed26-3347-4381-a8a3-2a02364d883c None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:35.307455 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c6ed26-3347-4381-a8a3-2a02364d883c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:35.334424 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-94c6ed26-3347-4381-a8a3-2a02364d883c None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:11:35.335660 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-94c6ed26-3347-4381-a8a3-2a02364d883c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:11:35.344113 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 656/1310] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:11:35 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:11:35.367017 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a721a-4570-44af-9222-8f6463314695 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:35.381646 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a721a-4570-44af-9222-8f6463314695 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:35.387193 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ac01c-55ee-4fc3-b989-7cc5c1c75750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:35.387962 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ac01c-55ee-4fc3-b989-7cc5c1c75750 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:35.388228 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ac01c-55ee-4fc3-b989-7cc5c1c75750 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:35.388486 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477ac01c-55ee-4fc3-b989-7cc5c1c75750 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:35.389140 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ac01c-55ee-4fc3-b989-7cc5c1c75750 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:35.390802 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477ac01c-55ee-4fc3-b989-7cc5c1c75750 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:35.402502 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-477ac01c-55ee-4fc3-b989-7cc5c1c75750 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 29 20:11:35.403629 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 655/1311] 10.222.0.15 () {56 vars in 1138 bytes} [Mon Nov 29 20:11:35 2021] GET /identity/v3/services/placement => generated 90 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:11:35.409952 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6ed26-3347-4381-a8a3-2a02364d883c None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:35.419750 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c6ed26-3347-4381-a8a3-2a02364d883c None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:35.426263 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b3767-8348-4ee4-8f07-edb414eff2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:35.426908 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b3767-8348-4ee4-8f07-edb414eff2fa admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:35.427213 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b3767-8348-4ee4-8f07-edb414eff2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:35.427482 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b3767-8348-4ee4-8f07-edb414eff2fa admin admin] PATH_INFO: `/v3/services` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:35.428188 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b3767-8348-4ee4-8f07-edb414eff2fa admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:11:35.428494 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b3767-8348-4ee4-8f07-edb414eff2fa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:35.430080 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b3767-8348-4ee4-8f07-edb414eff2fa admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:35.435744 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 657/1312] 10.222.0.15 () {56 vars in 1137 bytes} [Mon Nov 29 20:11:35 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:11:35.441590 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ac01c-55ee-4fc3-b989-7cc5c1c75750 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:35.451102 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477ac01c-55ee-4fc3-b989-7cc5c1c75750 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:35.456071 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05cb98-e3e5-4d78-afde-a9a313ad5c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:35.456681 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05cb98-e3e5-4d78-afde-a9a313ad5c8c admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:35.456950 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05cb98-e3e5-4d78-afde-a9a313ad5c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:35.457217 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05cb98-e3e5-4d78-afde-a9a313ad5c8c admin admin] PATH_INFO: `/v3/services` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:35.457913 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d05cb98-e3e5-4d78-afde-a9a313ad5c8c admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:11:35.458197 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d05cb98-e3e5-4d78-afde-a9a313ad5c8c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:35.459789 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d05cb98-e3e5-4d78-afde-a9a313ad5c8c admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:35.464178 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 656/1313] 10.222.0.15 () {56 vars in 1137 bytes} [Mon Nov 29 20:11:35 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:11:37.773825 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b103d0-94bd-4f3a-bbfb-83369306acca None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:37.774710 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b103d0-94bd-4f3a-bbfb-83369306acca None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:37.774710 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b103d0-94bd-4f3a-bbfb-83369306acca None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:37.777599 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 658/1314] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:11:37 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:11:37.783568 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0f8a4-5cf5-40de-8d05-747f7a617f28 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:37.783986 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0f8a4-5cf5-40de-8d05-747f7a617f28 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:37.784076 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0f8a4-5cf5-40de-8d05-747f7a617f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:37.802369 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-51a0f8a4-5cf5-40de-8d05-747f7a617f28 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:11:37.803567 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-51a0f8a4-5cf5-40de-8d05-747f7a617f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:11:37.812509 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 657/1315] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:11:37 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:11:37.835896 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b103d0-94bd-4f3a-bbfb-83369306acca None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:37.851116 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b103d0-94bd-4f3a-bbfb-83369306acca None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:37.857238 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f59cf3-56ae-4b14-aa7f-d28f64d7b087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:37.857895 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f59cf3-56ae-4b14-aa7f-d28f64d7b087 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:37.858174 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f59cf3-56ae-4b14-aa7f-d28f64d7b087 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:37.858461 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f59cf3-56ae-4b14-aa7f-d28f64d7b087 admin admin] PATH_INFO: `/v3/services` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:37.859239 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f59cf3-56ae-4b14-aa7f-d28f64d7b087 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:37.860821 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f59cf3-56ae-4b14-aa7f-d28f64d7b087 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:37.877515 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 659/1316] 10.222.0.15 () {60 vars in 1162 bytes} [Mon Nov 29 20:11:37 2021] POST /identity/v3/services => generated 246 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:11:40.193415 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdc99c-769c-485a-887f-00e71869bcbd None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:40.194275 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdc99c-769c-485a-887f-00e71869bcbd None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:40.194275 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbdc99c-769c-485a-887f-00e71869bcbd None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:40.197159 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 658/1317] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:11:40 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:11:40.205839 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3febf3-727b-47fd-b98d-04c480bb9053 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:40.206269 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3febf3-727b-47fd-b98d-04c480bb9053 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:40.206378 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3febf3-727b-47fd-b98d-04c480bb9053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:40.225272 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-ad3febf3-727b-47fd-b98d-04c480bb9053 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:11:40.226446 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-ad3febf3-727b-47fd-b98d-04c480bb9053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:11:40.243741 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 660/1318] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:11:40 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:11:40.267620 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbdc99c-769c-485a-887f-00e71869bcbd None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:40.282578 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbdc99c-769c-485a-887f-00e71869bcbd None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:40.288590 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd69af-ec80-43a6-9a7b-c5f23e67a4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:40.289360 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd69af-ec80-43a6-9a7b-c5f23e67a4d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:40.289637 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd69af-ec80-43a6-9a7b-c5f23e67a4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:40.289903 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd69af-ec80-43a6-9a7b-c5f23e67a4d0 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:40.290575 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd69af-ec80-43a6-9a7b-c5f23e67a4d0 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:40.292195 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd69af-ec80-43a6-9a7b-c5f23e67a4d0 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:40.303878 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-d3bd69af-ec80-43a6-9a7b-c5f23e67a4d0 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 29 20:11:40.304991 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 659/1319] 10.222.0.15 () {56 vars in 1138 bytes} [Mon Nov 29 20:11:40 2021] GET /identity/v3/services/placement => generated 90 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:11:40.311287 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3febf3-727b-47fd-b98d-04c480bb9053 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:40.320916 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3febf3-727b-47fd-b98d-04c480bb9053 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:40.327581 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992aac9-a520-4c69-a1d6-9908ee328e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:40.328226 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992aac9-a520-4c69-a1d6-9908ee328e89 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:40.328504 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992aac9-a520-4c69-a1d6-9908ee328e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:40.328769 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992aac9-a520-4c69-a1d6-9908ee328e89 admin admin] PATH_INFO: `/v3/services` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:40.329483 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b992aac9-a520-4c69-a1d6-9908ee328e89 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:11:40.329785 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b992aac9-a520-4c69-a1d6-9908ee328e89 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:40.331431 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b992aac9-a520-4c69-a1d6-9908ee328e89 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:40.337384 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 661/1320] 10.222.0.15 () {56 vars in 1137 bytes} [Mon Nov 29 20:11:40 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:11:40.343503 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd69af-ec80-43a6-9a7b-c5f23e67a4d0 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:40.353652 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd69af-ec80-43a6-9a7b-c5f23e67a4d0 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:40.359175 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9c6cde-4dc2-4b46-9fb3-bd8465c62d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:40.359781 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c6cde-4dc2-4b46-9fb3-bd8465c62d29 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:40.360058 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c6cde-4dc2-4b46-9fb3-bd8465c62d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:40.360326 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9c6cde-4dc2-4b46-9fb3-bd8465c62d29 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:40.361107 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c6cde-4dc2-4b46-9fb3-bd8465c62d29 admin admin] RBAC: Adding query filter params (interface=public, service_id=77b077b90aaa482fb1123b14b68af539, region_id=RegionOne) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:11:40.361414 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c6cde-4dc2-4b46-9fb3-bd8465c62d29 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:40.362960 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9c6cde-4dc2-4b46-9fb3-bd8465c62d29 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:40.367982 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 660/1321] 10.222.0.15 () {56 vars in 1272 bytes} [Mon Nov 29 20:11:40 2021] GET /identity/v3/endpoints?service_id=77b077b90aaa482fb1123b14b68af539&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:11:40.373559 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992aac9-a520-4c69-a1d6-9908ee328e89 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:40.383285 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992aac9-a520-4c69-a1d6-9908ee328e89 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:40.389063 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e95d12-418b-4bfb-b005-58908c6a7efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:40.389711 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e95d12-418b-4bfb-b005-58908c6a7efc admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:40.389986 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e95d12-418b-4bfb-b005-58908c6a7efc admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:40.390247 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e95d12-418b-4bfb-b005-58908c6a7efc admin admin] PATH_INFO: `/v3/services` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:40.390959 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e95d12-418b-4bfb-b005-58908c6a7efc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:40.392792 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e95d12-418b-4bfb-b005-58908c6a7efc admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:40.400272 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 662/1322] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Nov 29 20:11:40 2021] GET /identity/v3/services => generated 2191 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:11:42.698594 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c0c32-f424-4af4-90d4-7e7debff64c9 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:42.699477 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c0c32-f424-4af4-90d4-7e7debff64c9 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:42.699477 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c0c32-f424-4af4-90d4-7e7debff64c9 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:42.702287 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 661/1323] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:11:42 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:11:42.708293 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e1a0a-6229-4de6-90a1-430173a91d4e None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:42.708710 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e1a0a-6229-4de6-90a1-430173a91d4e None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:42.708821 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e1a0a-6229-4de6-90a1-430173a91d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:42.727915 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-ef1e1a0a-6229-4de6-90a1-430173a91d4e None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:11:42.729105 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-ef1e1a0a-6229-4de6-90a1-430173a91d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:11:42.739119 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 663/1324] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:11:42 2021] POST /identity/v3/auth/tokens => generated 3076 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:11:42.773309 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c0c32-f424-4af4-90d4-7e7debff64c9 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:42.788007 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c0c32-f424-4af4-90d4-7e7debff64c9 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:42.793863 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84252a78-d4fc-4e53-bca5-a132201028f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:42.794633 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84252a78-d4fc-4e53-bca5-a132201028f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:42.794903 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84252a78-d4fc-4e53-bca5-a132201028f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:42.795190 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84252a78-d4fc-4e53-bca5-a132201028f1 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:42.795885 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84252a78-d4fc-4e53-bca5-a132201028f1 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:42.797442 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84252a78-d4fc-4e53-bca5-a132201028f1 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:42.808844 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING keystone.server.flask.application [None req-84252a78-d4fc-4e53-bca5-a132201028f1 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Nov 29 20:11:42.809937 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 662/1325] 10.222.0.15 () {56 vars in 1138 bytes} [Mon Nov 29 20:11:42 2021] GET /identity/v3/services/placement => generated 90 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Nov 29 20:11:42.816761 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e1a0a-6229-4de6-90a1-430173a91d4e None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:42.825810 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e1a0a-6229-4de6-90a1-430173a91d4e None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:42.831256 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658d67c-8ac6-48f9-88c9-00835d857453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:42.831928 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658d67c-8ac6-48f9-88c9-00835d857453 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:42.832208 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658d67c-8ac6-48f9-88c9-00835d857453 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:42.832481 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658d67c-8ac6-48f9-88c9-00835d857453 admin admin] PATH_INFO: `/v3/services` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:42.833208 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d658d67c-8ac6-48f9-88c9-00835d857453 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:11:42.833514 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d658d67c-8ac6-48f9-88c9-00835d857453 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:42.835148 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d658d67c-8ac6-48f9-88c9-00835d857453 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:42.845174 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 664/1326] 10.222.0.15 () {56 vars in 1137 bytes} [Mon Nov 29 20:11:42 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:11:42.854656 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84252a78-d4fc-4e53-bca5-a132201028f1 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:11:42.866372 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84252a78-d4fc-4e53-bca5-a132201028f1 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:11:42.872510 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4a31e-2730-420e-b436-738419701ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:11:42.873150 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4a31e-2730-420e-b436-738419701ce0 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:11:42.873427 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4a31e-2730-420e-b436-738419701ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:11:42.873699 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4a31e-2730-420e-b436-738419701ce0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:11:42.874440 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba4a31e-2730-420e-b436-738419701ce0 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:11:42.876050 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba4a31e-2730-420e-b436-738419701ce0 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:11:42.903541 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 663/1327] 10.222.0.15 () {60 vars in 1165 bytes} [Mon Nov 29 20:11:42 2021] POST /identity/v3/endpoints => generated 331 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:12:45.168105 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f029382-c62e-4eb3-b3ad-c3f1a5800413 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:12:45.168615 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f029382-c62e-4eb3-b3ad-c3f1a5800413 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:12:45.168615 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f029382-c62e-4eb3-b3ad-c3f1a5800413 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:12:45.170397 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 665/1328] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:12:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:12:45.177096 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ce834-36ff-4ec3-8bdd-3dfa470380d5 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:12:45.177535 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ce834-36ff-4ec3-8bdd-3dfa470380d5 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:12:45.177906 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ce834-36ff-4ec3-8bdd-3dfa470380d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:12:45.278362 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-967ce834-36ff-4ec3-8bdd-3dfa470380d5 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:12:45.279995 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-967ce834-36ff-4ec3-8bdd-3dfa470380d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:12:45.408715 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 664/1329] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:12:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:12:45.425609 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f029382-c62e-4eb3-b3ad-c3f1a5800413 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:12:45.427474 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-7f029382-c62e-4eb3-b3ad-c3f1a5800413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:12:45.558456 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f029382-c62e-4eb3-b3ad-c3f1a5800413 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:12:45.653271 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e0a58-b32f-4f87-bd6c-02baa614ded8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:12:45.654210 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e0a58-b32f-4f87-bd6c-02baa614ded8 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:12:45.654489 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e0a58-b32f-4f87-bd6c-02baa614ded8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:12:45.654757 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e0a58-b32f-4f87-bd6c-02baa614ded8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:12:45.655547 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e0a58-b32f-4f87-bd6c-02baa614ded8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:12:45.657423 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e0a58-b32f-4f87-bd6c-02baa614ded8 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:12:45.676129 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 666/1330] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Nov 29 20:12:45 2021] GET /identity/v3/projects => generated 2553 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:12:48.054395 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01bd98-0131-4925-8282-af9e67b34052 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:12:48.054940 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01bd98-0131-4925-8282-af9e67b34052 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:12:48.054940 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01bd98-0131-4925-8282-af9e67b34052 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:12:48.059211 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 665/1331] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:12:48 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:12:48.063166 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f39db-9cc0-492c-9718-950e5e01d7d4 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:12:48.063630 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f39db-9cc0-492c-9718-950e5e01d7d4 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:12:48.063893 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f39db-9cc0-492c-9718-950e5e01d7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:12:48.138918 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-ed6f39db-9cc0-492c-9718-950e5e01d7d4 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:12:48.140605 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-ed6f39db-9cc0-492c-9718-950e5e01d7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:12:48.236298 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 667/1332] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:12:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:12:48.286437 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1207c69-d197-4add-a9c7-6f9fde9dfacf None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:12:48.286784 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1207c69-d197-4add-a9c7-6f9fde9dfacf None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:12:48.287304 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1207c69-d197-4add-a9c7-6f9fde9dfacf None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:12:48.289198 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 666/1333] 10.222.0.15 () {54 vars in 964 bytes} [Mon Nov 29 20:12:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:12:48.295431 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b28383-8662-4368-b70d-0d27c23c1cd7 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:12:48.295718 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b28383-8662-4368-b70d-0d27c23c1cd7 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:12:48.295991 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b28383-8662-4368-b70d-0d27c23c1cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:12:48.367250 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-69b28383-8662-4368-b70d-0d27c23c1cd7 None None] MFA Rules not processed for user `821fb4ce82de47ca873fc22d29d4f957`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:12:48.368787 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-69b28383-8662-4368-b70d-0d27c23c1cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:12:48.446513 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 668/1334] 10.222.0.15 () {58 vars in 1061 bytes} [Mon Nov 29 20:12:48 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:12:48.455536 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1207c69-d197-4add-a9c7-6f9fde9dfacf None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:12:48.457133 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-e1207c69-d197-4add-a9c7-6f9fde9dfacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:12:48.567950 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1207c69-d197-4add-a9c7-6f9fde9dfacf None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:12:48.642251 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d448a80e-f35d-4e01-a2c1-e6c523613798 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:12:48.642782 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448a80e-f35d-4e01-a2c1-e6c523613798 service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:12:48.643111 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448a80e-f35d-4e01-a2c1-e6c523613798 service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:12:48.643379 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d448a80e-f35d-4e01-a2c1-e6c523613798 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:12:48.645015 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-d448a80e-f35d-4e01-a2c1-e6c523613798 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:12:48.753590 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d448a80e-f35d-4e01-a2c1-e6c523613798 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:12:48.755097 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d448a80e-f35d-4e01-a2c1-e6c523613798 service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:12:48.774682 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 667/1335] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:12:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:12:51.389249 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e3e15-3abe-42ad-ac49-539840f6fd50 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:12:51.389810 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e3e15-3abe-42ad-ac49-539840f6fd50 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:12:51.389810 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e3e15-3abe-42ad-ac49-539840f6fd50 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:12:51.391929 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 669/1336] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:12:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:12:51.398922 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10808fe8-509e-4f96-ab94-63168c7025c1 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:12:51.399330 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10808fe8-509e-4f96-ab94-63168c7025c1 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:12:51.399503 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10808fe8-509e-4f96-ab94-63168c7025c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:12:51.468931 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-10808fe8-509e-4f96-ab94-63168c7025c1 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:12:51.470117 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-10808fe8-509e-4f96-ab94-63168c7025c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:12:51.566687 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 668/1337] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:12:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:12:51.605606 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e3e15-3abe-42ad-ac49-539840f6fd50 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:12:51.607215 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-f97e3e15-3abe-42ad-ac49-539840f6fd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:12:51.710739 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e3e15-3abe-42ad-ac49-539840f6fd50 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:12:51.781591 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01332d6-ad9d-4c4a-b709-508696653aaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:12:51.782223 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01332d6-ad9d-4c4a-b709-508696653aaa service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:12:51.782495 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01332d6-ad9d-4c4a-b709-508696653aaa service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:12:51.782760 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01332d6-ad9d-4c4a-b709-508696653aaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:12:51.784407 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-e01332d6-ad9d-4c4a-b709-508696653aaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:12:51.909232 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01332d6-ad9d-4c4a-b709-508696653aaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:12:51.911585 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01332d6-ad9d-4c4a-b709-508696653aaa service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:12:51.939330 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 670/1338] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:12:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 29 20:12:54.600075 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272eb37-5037-47ca-b55d-e3120503dff8 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:12:54.600928 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272eb37-5037-47ca-b55d-e3120503dff8 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:12:54.600928 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272eb37-5037-47ca-b55d-e3120503dff8 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:12:54.603793 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 669/1339] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:12:54 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:12:54.609818 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44810da-417d-4a01-931f-be3c6fae51ee None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:12:54.610263 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44810da-417d-4a01-931f-be3c6fae51ee None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:12:54.610357 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44810da-417d-4a01-931f-be3c6fae51ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:12:54.676353 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-d44810da-417d-4a01-931f-be3c6fae51ee None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:12:54.677527 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-d44810da-417d-4a01-931f-be3c6fae51ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:12:54.770446 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 671/1340] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:12:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:12:54.806378 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272eb37-5037-47ca-b55d-e3120503dff8 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:12:54.808866 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-6272eb37-5037-47ca-b55d-e3120503dff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:12:54.939402 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272eb37-5037-47ca-b55d-e3120503dff8 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:12:55.049609 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e47945-721b-495c-83b1-9a685c31258d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:12:55.050825 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e47945-721b-495c-83b1-9a685c31258d admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:12:55.051204 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e47945-721b-495c-83b1-9a685c31258d admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:12:55.051471 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e47945-721b-495c-83b1-9a685c31258d admin admin] PATH_INFO: `/v3/projects/4facf8265b034e41b65929b2699eb944` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:12:55.065023 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e47945-721b-495c-83b1-9a685c31258d admin admin] RBAC: Authorizing `identity:get_project(project_id=4facf8265b034e41b65929b2699eb944)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:12:55.067115 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e47945-721b-495c-83b1-9a685c31258d admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:12:55.068814 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 670/1341] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:12:54 2021] GET /identity/v3/projects/4facf8265b034e41b65929b2699eb944 => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:12:55.081675 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44810da-417d-4a01-931f-be3c6fae51ee None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:12:55.082906 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-d44810da-417d-4a01-931f-be3c6fae51ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:12:55.175404 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44810da-417d-4a01-931f-be3c6fae51ee None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:12:55.249033 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae8866-41c2-4d6c-afe6-520f5100ef37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:12:55.249666 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae8866-41c2-4d6c-afe6-520f5100ef37 service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:12:55.249944 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae8866-41c2-4d6c-afe6-520f5100ef37 service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:12:55.250225 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae8866-41c2-4d6c-afe6-520f5100ef37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:12:55.251860 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-3eae8866-41c2-4d6c-afe6-520f5100ef37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:12:55.357995 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae8866-41c2-4d6c-afe6-520f5100ef37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:12:55.359467 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae8866-41c2-4d6c-afe6-520f5100ef37 service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:12:55.376991 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 672/1342] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:12:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:12:58.193026 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3932b-bc5a-4069-bdc1-1d73207e6cda None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:12:58.193878 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3932b-bc5a-4069-bdc1-1d73207e6cda None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:12:58.193878 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3932b-bc5a-4069-bdc1-1d73207e6cda None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:12:58.196836 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 671/1343] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:12:58 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:12:58.202786 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc8e15-f403-442d-a753-dd225f858a70 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:12:58.203269 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc8e15-f403-442d-a753-dd225f858a70 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:12:58.203364 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc8e15-f403-442d-a753-dd225f858a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:12:58.267221 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-86fc8e15-f403-442d-a753-dd225f858a70 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:12:58.268399 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-86fc8e15-f403-442d-a753-dd225f858a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:12:58.364294 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 673/1344] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:12:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:12:58.399903 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3932b-bc5a-4069-bdc1-1d73207e6cda None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:12:58.402343 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-7aa3932b-bc5a-4069-bdc1-1d73207e6cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:12:58.530699 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3932b-bc5a-4069-bdc1-1d73207e6cda None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:12:58.624172 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8586a-6d9f-40d3-9bf3-decf3cdce622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:12:58.625012 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8586a-6d9f-40d3-9bf3-decf3cdce622 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:12:58.625282 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8586a-6d9f-40d3-9bf3-decf3cdce622 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:12:58.625544 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8586a-6d9f-40d3-9bf3-decf3cdce622 admin admin] PATH_INFO: `/v3/projects/4facf8265b034e41b65929b2699eb944` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:12:58.635277 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8586a-6d9f-40d3-9bf3-decf3cdce622 admin admin] RBAC: Authorizing `identity:get_project(project_id=4facf8265b034e41b65929b2699eb944)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:12:58.637314 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8586a-6d9f-40d3-9bf3-decf3cdce622 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:12:58.639019 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 672/1345] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:12:58 2021] GET /identity/v3/projects/4facf8265b034e41b65929b2699eb944 => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:12:58.655171 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc8e15-f403-442d-a753-dd225f858a70 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:12:58.656367 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-86fc8e15-f403-442d-a753-dd225f858a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:12:58.745238 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc8e15-f403-442d-a753-dd225f858a70 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:12:58.818380 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec911664-698b-4153-9ffe-346e905e496f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:12:58.819231 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec911664-698b-4153-9ffe-346e905e496f service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:12:58.819596 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec911664-698b-4153-9ffe-346e905e496f service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:12:58.819953 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec911664-698b-4153-9ffe-346e905e496f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:12:58.822602 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-ec911664-698b-4153-9ffe-346e905e496f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:12:58.947830 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec911664-698b-4153-9ffe-346e905e496f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:12:58.949272 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec911664-698b-4153-9ffe-346e905e496f service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:12:58.967082 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 674/1346] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:12:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:13:02.104808 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad119deb-6bf1-4070-8eee-1654a2b5cf02 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:02.105437 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad119deb-6bf1-4070-8eee-1654a2b5cf02 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:02.105437 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad119deb-6bf1-4070-8eee-1654a2b5cf02 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:02.107153 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 673/1347] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:13:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:13:02.113239 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3a1a3-cefe-4665-898a-efa8e12457f3 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:02.113717 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3a1a3-cefe-4665-898a-efa8e12457f3 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:02.113816 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f3a1a3-cefe-4665-898a-efa8e12457f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:02.177713 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-77f3a1a3-cefe-4665-898a-efa8e12457f3 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:13:02.178912 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-77f3a1a3-cefe-4665-898a-efa8e12457f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:13:02.274056 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 675/1348] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:13:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:13:02.326713 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c48c86-358d-4575-8ec8-7523fa264877 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:02.327137 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c48c86-358d-4575-8ec8-7523fa264877 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:02.327493 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c48c86-358d-4575-8ec8-7523fa264877 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:02.329393 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 674/1349] 10.222.0.15 () {54 vars in 964 bytes} [Mon Nov 29 20:13:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:13:02.336239 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c45a1-cb11-4a50-9ecc-d727f913e4ef None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:02.336522 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c45a1-cb11-4a50-9ecc-d727f913e4ef None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:02.336794 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c45a1-cb11-4a50-9ecc-d727f913e4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:02.415489 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-c21c45a1-cb11-4a50-9ecc-d727f913e4ef None None] MFA Rules not processed for user `821fb4ce82de47ca873fc22d29d4f957`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:13:02.416757 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-c21c45a1-cb11-4a50-9ecc-d727f913e4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:13:02.491266 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 676/1350] 10.222.0.15 () {58 vars in 1061 bytes} [Mon Nov 29 20:13:02 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:13:02.500426 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c48c86-358d-4575-8ec8-7523fa264877 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:13:02.501938 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-b8c48c86-358d-4575-8ec8-7523fa264877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:13:02.606769 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c48c86-358d-4575-8ec8-7523fa264877 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:13:02.687354 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0b5a3-7342-41ca-877a-a991c1dc0c9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:13:02.687995 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0b5a3-7342-41ca-877a-a991c1dc0c9f service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:02.688273 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0b5a3-7342-41ca-877a-a991c1dc0c9f service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:02.688546 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0b5a3-7342-41ca-877a-a991c1dc0c9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:02.690556 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-2ce0b5a3-7342-41ca-877a-a991c1dc0c9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:13:02.802672 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0b5a3-7342-41ca-877a-a991c1dc0c9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:13:02.804174 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0b5a3-7342-41ca-877a-a991c1dc0c9f service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:13:02.822163 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 675/1351] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:13:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 29 20:13:05.433031 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2982f-9017-49df-b2bf-60356a884d1b None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:05.433599 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2982f-9017-49df-b2bf-60356a884d1b None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:05.433599 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2982f-9017-49df-b2bf-60356a884d1b None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:05.435458 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 677/1352] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:13:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:13:05.441679 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5626b46-306d-4670-af20-ef42b6b2e5a0 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:05.442086 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5626b46-306d-4670-af20-ef42b6b2e5a0 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:05.442223 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5626b46-306d-4670-af20-ef42b6b2e5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:05.508636 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-f5626b46-306d-4670-af20-ef42b6b2e5a0 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:13:05.509840 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-f5626b46-306d-4670-af20-ef42b6b2e5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:13:05.612993 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 676/1353] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:13:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:13:05.650761 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2982f-9017-49df-b2bf-60356a884d1b None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:13:05.652416 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-9ac2982f-9017-49df-b2bf-60356a884d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:13:05.758944 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2982f-9017-49df-b2bf-60356a884d1b None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:13:05.833580 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a31274e-5cad-4f25-9a8c-55561cca36c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:13:05.834234 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31274e-5cad-4f25-9a8c-55561cca36c9 service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:05.834506 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31274e-5cad-4f25-9a8c-55561cca36c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:05.834771 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31274e-5cad-4f25-9a8c-55561cca36c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:05.836460 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-2a31274e-5cad-4f25-9a8c-55561cca36c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:13:05.945093 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a31274e-5cad-4f25-9a8c-55561cca36c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:13:05.946495 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a31274e-5cad-4f25-9a8c-55561cca36c9 service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:13:05.964741 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 678/1354] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:13:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:13:08.333425 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544de1c-f64c-4387-a908-5c7aa360c48f None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:08.333951 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544de1c-f64c-4387-a908-5c7aa360c48f None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:08.333951 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544de1c-f64c-4387-a908-5c7aa360c48f None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:08.335781 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 677/1355] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:13:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:13:08.341723 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb51ff-71db-43c0-bfb8-0e8903fd5344 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:08.342144 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb51ff-71db-43c0-bfb8-0e8903fd5344 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:08.342338 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb51ff-71db-43c0-bfb8-0e8903fd5344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:08.412840 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-c7fb51ff-71db-43c0-bfb8-0e8903fd5344 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:13:08.414506 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-c7fb51ff-71db-43c0-bfb8-0e8903fd5344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:13:08.513562 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 679/1356] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:13:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:13:08.547210 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544de1c-f64c-4387-a908-5c7aa360c48f None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:13:08.548732 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-d544de1c-f64c-4387-a908-5c7aa360c48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:13:08.670610 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544de1c-f64c-4387-a908-5c7aa360c48f None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:13:08.770321 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8897417-af84-4682-9e48-53b4cce77cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:13:08.771231 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8897417-af84-4682-9e48-53b4cce77cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:08.771503 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8897417-af84-4682-9e48-53b4cce77cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:08.771807 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8897417-af84-4682-9e48-53b4cce77cb0 admin admin] PATH_INFO: `/v3/projects/4facf8265b034e41b65929b2699eb944` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:08.782274 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8897417-af84-4682-9e48-53b4cce77cb0 admin admin] RBAC: Authorizing `identity:get_project(project_id=4facf8265b034e41b65929b2699eb944)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:13:08.784410 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8897417-af84-4682-9e48-53b4cce77cb0 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:13:08.786156 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 678/1357] 10.222.0.15 () {56 vars in 1207 bytes} [Mon Nov 29 20:13:08 2021] GET /identity/v3/projects/4facf8265b034e41b65929b2699eb944 => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:13:08.798802 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb51ff-71db-43c0-bfb8-0e8903fd5344 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:13:08.800158 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-c7fb51ff-71db-43c0-bfb8-0e8903fd5344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:13:08.890639 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb51ff-71db-43c0-bfb8-0e8903fd5344 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:13:08.965493 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3840ddf1-e1de-44fb-aef9-95aef802fb9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:13:08.966411 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840ddf1-e1de-44fb-aef9-95aef802fb9b service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:08.966773 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840ddf1-e1de-44fb-aef9-95aef802fb9b service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:08.967180 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3840ddf1-e1de-44fb-aef9-95aef802fb9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:08.968872 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-3840ddf1-e1de-44fb-aef9-95aef802fb9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:13:09.083729 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3840ddf1-e1de-44fb-aef9-95aef802fb9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:13:09.085422 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3840ddf1-e1de-44fb-aef9-95aef802fb9b service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:13:09.104172 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 680/1358] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:13:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:13:11.831568 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d90ac-6310-4248-89e4-b2f958bed242 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:11.831998 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d90ac-6310-4248-89e4-b2f958bed242 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:11.832103 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d90ac-6310-4248-89e4-b2f958bed242 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:11.833885 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 679/1359] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:13:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:13:11.839799 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9436cba-3c03-4f61-8e5f-852d586414ba None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:11.840263 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9436cba-3c03-4f61-8e5f-852d586414ba None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:11.840367 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9436cba-3c03-4f61-8e5f-852d586414ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:11.906308 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-e9436cba-3c03-4f61-8e5f-852d586414ba None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:13:11.907575 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-e9436cba-3c03-4f61-8e5f-852d586414ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:13:12.019252 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 681/1360] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:13:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:13:12.060039 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d90ac-6310-4248-89e4-b2f958bed242 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:13:12.062343 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-6a4d90ac-6310-4248-89e4-b2f958bed242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:13:12.176915 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d90ac-6310-4248-89e4-b2f958bed242 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:13:12.255963 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f8543-55d4-44ff-80c6-c7d9ffac30f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:13:12.256612 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f8543-55d4-44ff-80c6-c7d9ffac30f4 service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:12.256894 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f8543-55d4-44ff-80c6-c7d9ffac30f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:12.257169 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f8543-55d4-44ff-80c6-c7d9ffac30f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:12.258807 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-326f8543-55d4-44ff-80c6-c7d9ffac30f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:13:12.380788 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f8543-55d4-44ff-80c6-c7d9ffac30f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:13:12.382148 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f8543-55d4-44ff-80c6-c7d9ffac30f4 service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:13:12.400274 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 680/1361] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:13:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:13:14.761431 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258edf6a-ee09-455e-be4a-fee560fa38a4 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:14.762317 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258edf6a-ee09-455e-be4a-fee560fa38a4 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:14.762317 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258edf6a-ee09-455e-be4a-fee560fa38a4 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:14.764718 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 682/1362] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:13:14 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:13:14.771085 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cdb03d-40c0-40b3-9431-ddd166c27063 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:14.771513 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cdb03d-40c0-40b3-9431-ddd166c27063 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:14.771643 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cdb03d-40c0-40b3-9431-ddd166c27063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:14.834614 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-49cdb03d-40c0-40b3-9431-ddd166c27063 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:13:14.835855 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-49cdb03d-40c0-40b3-9431-ddd166c27063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:13:14.929721 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 681/1363] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:13:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:13:14.973844 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258edf6a-ee09-455e-be4a-fee560fa38a4 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:13:14.976263 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-258edf6a-ee09-455e-be4a-fee560fa38a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:13:15.084399 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258edf6a-ee09-455e-be4a-fee560fa38a4 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:13:15.155615 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0c6ce-cd69-4382-b394-c6fb4e4d0aa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:13:15.156263 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0c6ce-cd69-4382-b394-c6fb4e4d0aa0 service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:15.156544 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0c6ce-cd69-4382-b394-c6fb4e4d0aa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:15.156814 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0c6ce-cd69-4382-b394-c6fb4e4d0aa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:15.158491 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-29f0c6ce-cd69-4382-b394-c6fb4e4d0aa0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:13:15.275498 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0c6ce-cd69-4382-b394-c6fb4e4d0aa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:13:15.276954 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0c6ce-cd69-4382-b394-c6fb4e4d0aa0 service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:13:15.296317 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 683/1364] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:13:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:13:18.104095 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1707a3-db66-4ec8-b6d0-71ae2a8a0637 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:18.104628 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1707a3-db66-4ec8-b6d0-71ae2a8a0637 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:18.104628 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1707a3-db66-4ec8-b6d0-71ae2a8a0637 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:18.106322 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 682/1365] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:13:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:13:18.113215 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8939868-9037-49f4-bfce-fa26c2592115 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:18.113911 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8939868-9037-49f4-bfce-fa26c2592115 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:18.114088 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8939868-9037-49f4-bfce-fa26c2592115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:18.189224 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-c8939868-9037-49f4-bfce-fa26c2592115 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:13:18.190459 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-c8939868-9037-49f4-bfce-fa26c2592115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:13:18.306683 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 684/1366] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:13:18 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:13:18.350993 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1707a3-db66-4ec8-b6d0-71ae2a8a0637 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:13:18.354984 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-da1707a3-db66-4ec8-b6d0-71ae2a8a0637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:13:18.458126 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1707a3-db66-4ec8-b6d0-71ae2a8a0637 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:13:18.462569 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267190d4-df0b-49ad-8a61-5fc502801814 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:13:18.463240 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267190d4-df0b-49ad-8a61-5fc502801814 service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:18.463516 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267190d4-df0b-49ad-8a61-5fc502801814 service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:18.463789 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267190d4-df0b-49ad-8a61-5fc502801814 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:18.474573 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267190d4-df0b-49ad-8a61-5fc502801814 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:13:18.476038 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267190d4-df0b-49ad-8a61-5fc502801814 service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:13:18.485778 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 683/1367] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:13:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:13:22.802364 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6ab40-6d47-4c80-9384-67f3d9a2a988 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:22.802997 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6ab40-6d47-4c80-9384-67f3d9a2a988 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:22.802997 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6ab40-6d47-4c80-9384-67f3d9a2a988 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:22.804727 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 685/1368] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:13:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:13:22.810935 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e290b-51ce-4024-8c4c-9a5b51b4569e None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:22.811805 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e290b-51ce-4024-8c4c-9a5b51b4569e None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:22.812097 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e290b-51ce-4024-8c4c-9a5b51b4569e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:22.831365 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-e82e290b-51ce-4024-8c4c-9a5b51b4569e None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:13:22.832572 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-e82e290b-51ce-4024-8c4c-9a5b51b4569e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:13:22.841627 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 684/1369] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:13:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:13:22.881453 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df6ab40-6d47-4c80-9384-67f3d9a2a988 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:13:22.883408 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-4df6ab40-6d47-4c80-9384-67f3d9a2a988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:13:22.896972 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df6ab40-6d47-4c80-9384-67f3d9a2a988 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:13:22.900634 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae2a32-d815-401c-8641-d5caf7a06d66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:13:22.901264 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae2a32-d815-401c-8641-d5caf7a06d66 service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:22.901543 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae2a32-d815-401c-8641-d5caf7a06d66 service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:22.901815 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae2a32-d815-401c-8641-d5caf7a06d66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:22.910834 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae2a32-d815-401c-8641-d5caf7a06d66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:13:22.912279 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae2a32-d815-401c-8641-d5caf7a06d66 service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:13:22.921648 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 686/1370] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:13:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:13:26.024868 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69634da-e95a-430f-aa71-c1dd15f3de88 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:26.025401 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69634da-e95a-430f-aa71-c1dd15f3de88 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:26.025757 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69634da-e95a-430f-aa71-c1dd15f3de88 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:26.029399 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 685/1371] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:13:26 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:13:26.035404 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516eb1b-d794-43be-ad61-65cba04806bf None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:26.035908 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516eb1b-d794-43be-ad61-65cba04806bf None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:26.036188 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516eb1b-d794-43be-ad61-65cba04806bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:26.055005 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-b516eb1b-d794-43be-ad61-65cba04806bf None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:13:26.056219 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-b516eb1b-d794-43be-ad61-65cba04806bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:13:26.064858 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 687/1372] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:13:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:13:26.103705 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69634da-e95a-430f-aa71-c1dd15f3de88 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:13:26.116083 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69634da-e95a-430f-aa71-c1dd15f3de88 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:13:26.120057 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f57ccd-f791-4e91-a710-a33ebea03657 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:13:26.120715 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f57ccd-f791-4e91-a710-a33ebea03657 service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:26.120992 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f57ccd-f791-4e91-a710-a33ebea03657 service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:26.121261 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f57ccd-f791-4e91-a710-a33ebea03657 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:26.131377 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f57ccd-f791-4e91-a710-a33ebea03657 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:13:26.132839 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f57ccd-f791-4e91-a710-a33ebea03657 service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:13:26.143872 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 686/1373] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:13:26 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:13:30.644479 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458e6b5-94fd-4f95-b05d-fd9fd5f5b283 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:30.645294 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458e6b5-94fd-4f95-b05d-fd9fd5f5b283 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:30.645721 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458e6b5-94fd-4f95-b05d-fd9fd5f5b283 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:30.647767 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 688/1374] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:13:30 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:13:30.653949 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20206a-a449-42df-ac39-b89a1ba41fd5 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:30.654408 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20206a-a449-42df-ac39-b89a1ba41fd5 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:30.654619 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20206a-a449-42df-ac39-b89a1ba41fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:30.672576 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-1b20206a-a449-42df-ac39-b89a1ba41fd5 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:13:30.673766 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-1b20206a-a449-42df-ac39-b89a1ba41fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:13:30.681844 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 687/1375] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:13:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:13:30.720880 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2458e6b5-94fd-4f95-b05d-fd9fd5f5b283 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:13:30.731656 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2458e6b5-94fd-4f95-b05d-fd9fd5f5b283 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:13:30.735345 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95a173-ee40-4ab6-9cdb-140ab9eeaf44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:13:30.736135 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95a173-ee40-4ab6-9cdb-140ab9eeaf44 service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:30.736410 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95a173-ee40-4ab6-9cdb-140ab9eeaf44 service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:30.736671 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95a173-ee40-4ab6-9cdb-140ab9eeaf44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:30.746125 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e95a173-ee40-4ab6-9cdb-140ab9eeaf44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:13:30.747752 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e95a173-ee40-4ab6-9cdb-140ab9eeaf44 service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:13:30.757481 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 689/1376] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:13:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:13:35.705246 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215dc322-e318-4430-9f30-e0bf3886b5e2 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:35.705795 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215dc322-e318-4430-9f30-e0bf3886b5e2 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:35.705795 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215dc322-e318-4430-9f30-e0bf3886b5e2 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:35.707625 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 688/1377] 10.222.0.15 () {54 vars in 921 bytes} [Mon Nov 29 20:13:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:13:35.718541 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbfe7c4-2f43-4952-98a0-bd23202699f1 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:35.719618 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbfe7c4-2f43-4952-98a0-bd23202699f1 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:35.720061 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbfe7c4-2f43-4952-98a0-bd23202699f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:35.793017 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-8fbfe7c4-2f43-4952-98a0-bd23202699f1 None None] MFA Rules not processed for user `b954c18d7e9349e899f4c1cd42b89166`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:13:35.794763 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-8fbfe7c4-2f43-4952-98a0-bd23202699f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:13:35.886450 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 690/1378] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Nov 29 20:13:35 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:13:39.748018 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3f6ea-d002-4a36-9641-645ebb7fd1ba None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:39.748555 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3f6ea-d002-4a36-9641-645ebb7fd1ba None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:39.748555 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3f6ea-d002-4a36-9641-645ebb7fd1ba None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:39.750342 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 689/1379] 10.222.0.15 () {54 vars in 921 bytes} [Mon Nov 29 20:13:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:13:39.755915 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e24a0-dfa5-46be-8043-a09b53899b42 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:39.756667 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e24a0-dfa5-46be-8043-a09b53899b42 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:39.756943 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3e24a0-dfa5-46be-8043-a09b53899b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:39.776030 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-2f3e24a0-dfa5-46be-8043-a09b53899b42 None None] MFA Rules not processed for user `b954c18d7e9349e899f4c1cd42b89166`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:13:39.777223 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-2f3e24a0-dfa5-46be-8043-a09b53899b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:13:39.786249 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 691/1380] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Nov 29 20:13:39 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:13:41.398488 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd8113-d8b0-4c06-9430-51525abff509 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:41.399064 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd8113-d8b0-4c06-9430-51525abff509 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:41.399064 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd8113-d8b0-4c06-9430-51525abff509 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:41.400864 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 690/1381] 10.222.0.15 () {54 vars in 921 bytes} [Mon Nov 29 20:13:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:13:41.407342 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e730d7-0963-4061-a7a9-be7f962123fc None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:41.407773 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e730d7-0963-4061-a7a9-be7f962123fc None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:41.408018 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e730d7-0963-4061-a7a9-be7f962123fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:41.427103 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-62e730d7-0963-4061-a7a9-be7f962123fc None None] MFA Rules not processed for user `b954c18d7e9349e899f4c1cd42b89166`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:13:41.428376 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-62e730d7-0963-4061-a7a9-be7f962123fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:13:41.438066 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 692/1382] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Nov 29 20:13:41 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:13:45.320227 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67846b34-2610-431a-866e-202c4e4d8c53 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:45.320810 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67846b34-2610-431a-866e-202c4e4d8c53 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:45.320810 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67846b34-2610-431a-866e-202c4e4d8c53 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:45.322708 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 691/1383] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:13:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:13:45.328491 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199c555-5889-4586-ba22-9760779b8b31 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:45.328909 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199c555-5889-4586-ba22-9760779b8b31 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:45.329024 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199c555-5889-4586-ba22-9760779b8b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:45.347437 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-9199c555-5889-4586-ba22-9760779b8b31 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:13:45.348622 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-9199c555-5889-4586-ba22-9760779b8b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:13:45.362586 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 693/1384] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:13:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:13:45.411099 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884ee9e-320d-4446-9a20-745c131f52d9 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:45.411493 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884ee9e-320d-4446-9a20-745c131f52d9 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:45.411687 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884ee9e-320d-4446-9a20-745c131f52d9 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:45.413460 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 692/1385] 10.222.0.15 () {54 vars in 961 bytes} [Mon Nov 29 20:13:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:13:45.419720 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864be917-31c3-41f3-9a78-ff00a04c6b03 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:45.420402 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864be917-31c3-41f3-9a78-ff00a04c6b03 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:45.420782 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864be917-31c3-41f3-9a78-ff00a04c6b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:45.472095 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-864be917-31c3-41f3-9a78-ff00a04c6b03 None None] MFA Rules not processed for user `5f76a8c3d04e440b92d12ced18d97941`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:13:45.473430 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-864be917-31c3-41f3-9a78-ff00a04c6b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:13:45.557276 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 694/1386] 10.222.0.15 () {58 vars in 1058 bytes} [Mon Nov 29 20:13:45 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:13:45.566303 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884ee9e-320d-4446-9a20-745c131f52d9 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:13:45.581306 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884ee9e-320d-4446-9a20-745c131f52d9 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:13:45.587557 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9222dfef-f5b6-4b58-a0e0-4e81301e19c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:13:45.588194 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222dfef-f5b6-4b58-a0e0-4e81301e19c8 service nova] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:45.588476 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222dfef-f5b6-4b58-a0e0-4e81301e19c8 service nova] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:45.588748 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9222dfef-f5b6-4b58-a0e0-4e81301e19c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:45.596676 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9222dfef-f5b6-4b58-a0e0-4e81301e19c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:13:45.598245 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9222dfef-f5b6-4b58-a0e0-4e81301e19c8 service nova] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:13:45.607680 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 693/1387] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:13:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:13:48.157188 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d59f29-4695-4fcc-8acb-5e5c7db29e44 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:48.157724 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d59f29-4695-4fcc-8acb-5e5c7db29e44 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:48.157967 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d59f29-4695-4fcc-8acb-5e5c7db29e44 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:48.159995 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 695/1388] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:13:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:13:48.165825 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e339a48-f9cf-47ea-8677-94d2abd5cf53 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:48.166242 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e339a48-f9cf-47ea-8677-94d2abd5cf53 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:48.166344 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e339a48-f9cf-47ea-8677-94d2abd5cf53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:48.185592 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-0e339a48-f9cf-47ea-8677-94d2abd5cf53 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:13:48.186949 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-0e339a48-f9cf-47ea-8677-94d2abd5cf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:13:48.195886 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 694/1389] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:13:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:13:48.244059 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d59f29-4695-4fcc-8acb-5e5c7db29e44 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:13:48.259993 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d59f29-4695-4fcc-8acb-5e5c7db29e44 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:13:48.265487 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae711f5-eace-42b3-8553-294eeeca8931 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:13:48.266146 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae711f5-eace-42b3-8553-294eeeca8931 service nova] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:48.266429 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae711f5-eace-42b3-8553-294eeeca8931 service nova] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:48.266836 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae711f5-eace-42b3-8553-294eeeca8931 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:48.278786 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae711f5-eace-42b3-8553-294eeeca8931 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:13:48.280431 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae711f5-eace-42b3-8553-294eeeca8931 service nova] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:13:48.289988 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 696/1390] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:13:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:13:50.917313 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50266d2e-36e5-4da9-b8fa-7cf209bc57b8 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:50.917842 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50266d2e-36e5-4da9-b8fa-7cf209bc57b8 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:50.917842 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50266d2e-36e5-4da9-b8fa-7cf209bc57b8 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:50.919715 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 695/1391] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:13:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:13:50.925633 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dcc1f9-7bb4-4af7-b583-83c0a6916f92 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:50.926469 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dcc1f9-7bb4-4af7-b583-83c0a6916f92 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:50.926805 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dcc1f9-7bb4-4af7-b583-83c0a6916f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:50.945259 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-43dcc1f9-7bb4-4af7-b583-83c0a6916f92 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:13:50.946710 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-43dcc1f9-7bb4-4af7-b583-83c0a6916f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:13:50.957177 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 697/1392] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:13:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:13:51.005379 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a90bfb-f15d-44b3-8857-eec34ea7dbd8 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:51.005908 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a90bfb-f15d-44b3-8857-eec34ea7dbd8 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:51.006216 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a90bfb-f15d-44b3-8857-eec34ea7dbd8 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:51.008046 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 696/1393] 10.222.0.15 () {54 vars in 961 bytes} [Mon Nov 29 20:13:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:13:51.014639 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8f645-8f38-4eeb-b2e4-32bcce8c8c38 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:51.014956 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8f645-8f38-4eeb-b2e4-32bcce8c8c38 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:51.015444 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca8f645-8f38-4eeb-b2e4-32bcce8c8c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:51.036244 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-1ca8f645-8f38-4eeb-b2e4-32bcce8c8c38 None None] MFA Rules not processed for user `5f76a8c3d04e440b92d12ced18d97941`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:13:51.037523 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-1ca8f645-8f38-4eeb-b2e4-32bcce8c8c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:13:51.048112 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 698/1394] 10.222.0.15 () {58 vars in 1058 bytes} [Mon Nov 29 20:13:51 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:13:51.056384 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a90bfb-f15d-44b3-8857-eec34ea7dbd8 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:13:51.071266 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a90bfb-f15d-44b3-8857-eec34ea7dbd8 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:13:51.076691 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf791f-42ad-4565-a95e-db114811c620 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:13:51.077359 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf791f-42ad-4565-a95e-db114811c620 service nova] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:51.077632 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf791f-42ad-4565-a95e-db114811c620 service nova] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:51.078031 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf791f-42ad-4565-a95e-db114811c620 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:51.086656 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadf791f-42ad-4565-a95e-db114811c620 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:13:51.088423 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadf791f-42ad-4565-a95e-db114811c620 service nova] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:13:51.103038 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 697/1395] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:13:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:13:53.211526 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e9a08-9f7f-42f1-9a51-ebcdaab98a88 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:53.212429 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e9a08-9f7f-42f1-9a51-ebcdaab98a88 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:53.212667 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e9a08-9f7f-42f1-9a51-ebcdaab98a88 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:53.214653 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 699/1396] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:13:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:13:53.220621 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a229159-085e-4874-81a9-8b0a865235a3 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:53.221444 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a229159-085e-4874-81a9-8b0a865235a3 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:53.221701 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a229159-085e-4874-81a9-8b0a865235a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:53.239774 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-4a229159-085e-4874-81a9-8b0a865235a3 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:13:53.240920 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-4a229159-085e-4874-81a9-8b0a865235a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:13:53.249042 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 698/1397] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:13:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:13:53.301185 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e66c6-e977-4f00-8a2a-dc24ee8665cd None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:53.301637 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e66c6-e977-4f00-8a2a-dc24ee8665cd None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:53.302167 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e66c6-e977-4f00-8a2a-dc24ee8665cd None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:53.304255 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 700/1398] 10.222.0.15 () {54 vars in 963 bytes} [Mon Nov 29 20:13:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:13:53.309776 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbbfd8-2926-4d78-b5b3-fb2b647eb0d0 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:53.310101 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbbfd8-2926-4d78-b5b3-fb2b647eb0d0 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:53.310490 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bbbfd8-2926-4d78-b5b3-fb2b647eb0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:53.358862 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-24bbbfd8-2926-4d78-b5b3-fb2b647eb0d0 None None] MFA Rules not processed for user `9508e6f2ac414098872e2584f1ed7393`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:13:53.360079 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-24bbbfd8-2926-4d78-b5b3-fb2b647eb0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:13:53.418930 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 699/1399] 10.222.0.15 () {58 vars in 1060 bytes} [Mon Nov 29 20:13:53 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:13:53.429067 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e66c6-e977-4f00-8a2a-dc24ee8665cd None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:13:53.440561 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e66c6-e977-4f00-8a2a-dc24ee8665cd None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:13:53.444640 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43b4d9-d1be-4dd2-832b-d2e97f32764a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:13:53.445398 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43b4d9-d1be-4dd2-832b-d2e97f32764a service cinder] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:53.445781 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43b4d9-d1be-4dd2-832b-d2e97f32764a service cinder] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:53.446280 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43b4d9-d1be-4dd2-832b-d2e97f32764a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:53.456399 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb43b4d9-d1be-4dd2-832b-d2e97f32764a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:13:53.458229 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb43b4d9-d1be-4dd2-832b-d2e97f32764a service cinder] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:13:53.469580 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 701/1400] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:13:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:13:53.476361 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887ee14-4f59-476c-ae02-17897eb4fb50 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:53.476783 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887ee14-4f59-476c-ae02-17897eb4fb50 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:53.477158 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887ee14-4f59-476c-ae02-17897eb4fb50 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:53.479251 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 700/1401] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:13:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:13:53.485076 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c48ac9-4d4e-4c8e-82b9-1c5304729833 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:53.485437 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c48ac9-4d4e-4c8e-82b9-1c5304729833 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:53.485783 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c48ac9-4d4e-4c8e-82b9-1c5304729833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:53.515112 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-22c48ac9-4d4e-4c8e-82b9-1c5304729833 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:13:53.516429 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-22c48ac9-4d4e-4c8e-82b9-1c5304729833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:13:53.525001 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 702/1402] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:13:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:13:53.570179 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887ee14-4f59-476c-ae02-17897eb4fb50 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:13:53.586258 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887ee14-4f59-476c-ae02-17897eb4fb50 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:13:53.592248 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf8859-0ff9-4ac0-be82-60f347770bb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:13:53.592872 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf8859-0ff9-4ac0-be82-60f347770bb8 service nova] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:53.593149 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf8859-0ff9-4ac0-be82-60f347770bb8 service nova] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:53.593395 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf8859-0ff9-4ac0-be82-60f347770bb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:53.602075 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf8859-0ff9-4ac0-be82-60f347770bb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:13:53.603710 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf8859-0ff9-4ac0-be82-60f347770bb8 service nova] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:13:53.614215 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 701/1403] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:13:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:13:56.003715 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002f0c0-b56b-4a8b-b656-25c4dd5d4842 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:56.004221 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002f0c0-b56b-4a8b-b656-25c4dd5d4842 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:56.004221 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002f0c0-b56b-4a8b-b656-25c4dd5d4842 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:56.005964 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 703/1404] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:13:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:13:56.011620 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5487c0-1290-478f-b715-d36d38ed2d48 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:56.012003 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5487c0-1290-478f-b715-d36d38ed2d48 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:56.012178 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5487c0-1290-478f-b715-d36d38ed2d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:56.030889 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-fc5487c0-1290-478f-b715-d36d38ed2d48 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:13:56.032088 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-fc5487c0-1290-478f-b715-d36d38ed2d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:13:56.041127 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 702/1405] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:13:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:13:56.086707 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002f0c0-b56b-4a8b-b656-25c4dd5d4842 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:13:56.101708 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002f0c0-b56b-4a8b-b656-25c4dd5d4842 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:13:56.107784 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06285e21-fedd-4a5f-80b1-dc280832352d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:13:56.108423 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06285e21-fedd-4a5f-80b1-dc280832352d service nova] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:56.108704 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06285e21-fedd-4a5f-80b1-dc280832352d service nova] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:56.108967 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06285e21-fedd-4a5f-80b1-dc280832352d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:56.117255 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06285e21-fedd-4a5f-80b1-dc280832352d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:13:56.118834 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06285e21-fedd-4a5f-80b1-dc280832352d service nova] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:13:56.127902 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 704/1406] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:13:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:13:58.494052 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77b1f3-cc8f-40ce-ad17-bd42b0e4d768 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:58.494636 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77b1f3-cc8f-40ce-ad17-bd42b0e4d768 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:58.494636 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de77b1f3-cc8f-40ce-ad17-bd42b0e4d768 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:58.496441 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 703/1407] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:13:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:13:58.502534 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24851a-ec9b-47ff-8050-b1344c7ee071 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:58.503063 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24851a-ec9b-47ff-8050-b1344c7ee071 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:58.503063 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24851a-ec9b-47ff-8050-b1344c7ee071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:58.522598 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-5b24851a-ec9b-47ff-8050-b1344c7ee071 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:13:58.523839 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-5b24851a-ec9b-47ff-8050-b1344c7ee071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:13:58.532843 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 705/1408] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:13:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:13:58.578294 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de77b1f3-cc8f-40ce-ad17-bd42b0e4d768 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:13:58.593232 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de77b1f3-cc8f-40ce-ad17-bd42b0e4d768 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:13:58.600056 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9ed63-67fd-4d94-a466-4107487c4214 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:13:58.601080 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9ed63-67fd-4d94-a466-4107487c4214 service nova] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:13:58.601464 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9ed63-67fd-4d94-a466-4107487c4214 service nova] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:13:58.601831 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9ed63-67fd-4d94-a466-4107487c4214 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:13:58.611316 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9ed63-67fd-4d94-a466-4107487c4214 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:13:58.613137 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c9ed63-67fd-4d94-a466-4107487c4214 service nova] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:13:58.627066 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 704/1409] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:13:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:14:01.112230 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23baaa1f-b793-42a9-9072-1fafd97313bd None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:01.112888 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23baaa1f-b793-42a9-9072-1fafd97313bd None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:01.112888 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23baaa1f-b793-42a9-9072-1fafd97313bd None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:01.115594 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 706/1410] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:14:01 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:14:01.123214 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b933dfd5-fad2-4bc6-a7cd-97ac10b93b54 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:01.123658 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b933dfd5-fad2-4bc6-a7cd-97ac10b93b54 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:01.123754 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b933dfd5-fad2-4bc6-a7cd-97ac10b93b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:01.144018 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-b933dfd5-fad2-4bc6-a7cd-97ac10b93b54 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:14:01.145603 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-b933dfd5-fad2-4bc6-a7cd-97ac10b93b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:14:01.156290 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 705/1411] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:14:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:14:01.207284 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23baaa1f-b793-42a9-9072-1fafd97313bd None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:14:01.222951 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23baaa1f-b793-42a9-9072-1fafd97313bd None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:14:01.228463 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861d79f7-466f-49ec-9516-d8ac15c56d64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:14:01.229108 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d79f7-466f-49ec-9516-d8ac15c56d64 service nova] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:01.229439 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d79f7-466f-49ec-9516-d8ac15c56d64 service nova] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:01.229715 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861d79f7-466f-49ec-9516-d8ac15c56d64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:01.240198 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d79f7-466f-49ec-9516-d8ac15c56d64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:14:01.241806 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861d79f7-466f-49ec-9516-d8ac15c56d64 service nova] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:14:01.251884 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 707/1412] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:14:01 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:14:03.936572 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7459772-3074-4c48-a5b5-51689ea79775 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:03.937131 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7459772-3074-4c48-a5b5-51689ea79775 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:03.937282 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7459772-3074-4c48-a5b5-51689ea79775 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:03.939531 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 706/1413] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:14:03 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:14:03.945570 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13757ebd-ac8c-4b29-85e2-6320a6f5ef06 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:03.946035 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13757ebd-ac8c-4b29-85e2-6320a6f5ef06 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:03.946263 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13757ebd-ac8c-4b29-85e2-6320a6f5ef06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:03.965909 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-13757ebd-ac8c-4b29-85e2-6320a6f5ef06 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:14:03.967201 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-13757ebd-ac8c-4b29-85e2-6320a6f5ef06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:14:03.975113 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 708/1414] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:14:03 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:14:04.022580 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7459772-3074-4c48-a5b5-51689ea79775 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:14:04.038282 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7459772-3074-4c48-a5b5-51689ea79775 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:14:04.044819 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7a1d3-5e05-4637-a8b0-5c3b443a517a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:14:04.045456 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7a1d3-5e05-4637-a8b0-5c3b443a517a service nova] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:04.045732 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7a1d3-5e05-4637-a8b0-5c3b443a517a service nova] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:04.046004 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7a1d3-5e05-4637-a8b0-5c3b443a517a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:04.054260 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7a1d3-5e05-4637-a8b0-5c3b443a517a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:14:04.055905 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7a1d3-5e05-4637-a8b0-5c3b443a517a service nova] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:14:04.065392 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 707/1415] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:14:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:14:06.408595 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7e356-d50b-492c-ac7e-05ca70febedb None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:06.409177 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7e356-d50b-492c-ac7e-05ca70febedb None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:06.409177 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7e356-d50b-492c-ac7e-05ca70febedb None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:06.410942 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 709/1416] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:14:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 29 20:14:06.422265 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522aecf-56b7-45d9-928c-d2cf6d2a3f57 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:06.422791 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522aecf-56b7-45d9-928c-d2cf6d2a3f57 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:06.423072 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522aecf-56b7-45d9-928c-d2cf6d2a3f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:06.446212 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-2522aecf-56b7-45d9-928c-d2cf6d2a3f57 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:14:06.447814 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-2522aecf-56b7-45d9-928c-d2cf6d2a3f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:14:06.459480 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 708/1417] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:14:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:14:06.517738 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b7e356-d50b-492c-ac7e-05ca70febedb None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:14:06.534301 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b7e356-d50b-492c-ac7e-05ca70febedb None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:14:06.540523 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c0740-504f-4e4a-9382-5fb45d8f9c96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:14:06.541172 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c0740-504f-4e4a-9382-5fb45d8f9c96 service nova] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:06.541457 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c0740-504f-4e4a-9382-5fb45d8f9c96 service nova] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:06.541736 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c0740-504f-4e4a-9382-5fb45d8f9c96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:06.550318 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c0740-504f-4e4a-9382-5fb45d8f9c96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:14:06.551947 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c0740-504f-4e4a-9382-5fb45d8f9c96 service nova] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:14:06.561412 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 710/1418] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:14:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:14:09.080992 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f53198-af2c-47f1-a436-7db5ec473806 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:09.081524 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f53198-af2c-47f1-a436-7db5ec473806 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:09.081524 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f53198-af2c-47f1-a436-7db5ec473806 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:09.083386 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 709/1419] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:14:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:14:09.089175 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c00cd6-cf56-47a0-a3a6-ca41bb64b3ed None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:09.089660 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c00cd6-cf56-47a0-a3a6-ca41bb64b3ed None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:09.089769 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c00cd6-cf56-47a0-a3a6-ca41bb64b3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:09.107878 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-03c00cd6-cf56-47a0-a3a6-ca41bb64b3ed None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:14:09.109092 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-03c00cd6-cf56-47a0-a3a6-ca41bb64b3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:14:09.117465 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 711/1420] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:14:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:14:09.162893 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f53198-af2c-47f1-a436-7db5ec473806 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:14:09.177680 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f53198-af2c-47f1-a436-7db5ec473806 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:14:09.183718 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e9578-5693-4a39-89f2-4248a77d0f54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:14:09.184351 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e9578-5693-4a39-89f2-4248a77d0f54 service nova] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:09.184615 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e9578-5693-4a39-89f2-4248a77d0f54 service nova] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:09.184951 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e9578-5693-4a39-89f2-4248a77d0f54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:09.193440 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e9578-5693-4a39-89f2-4248a77d0f54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:14:09.195062 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e9578-5693-4a39-89f2-4248a77d0f54 service nova] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:14:09.205012 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 710/1421] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:14:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:14:09.662361 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6b8e6-2085-4956-b0fb-c76af00dab48 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:09.662632 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6b8e6-2085-4956-b0fb-c76af00dab48 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:09.662891 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6b8e6-2085-4956-b0fb-c76af00dab48 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:09.664732 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 712/1422] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:14:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:14:09.670873 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc0d7c-bb0c-4f8f-a821-8b024dca5a89 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:09.671185 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc0d7c-bb0c-4f8f-a821-8b024dca5a89 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:09.671459 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc0d7c-bb0c-4f8f-a821-8b024dca5a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:09.689356 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-1bdc0d7c-bb0c-4f8f-a821-8b024dca5a89 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:14:09.690547 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-1bdc0d7c-bb0c-4f8f-a821-8b024dca5a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:14:09.698822 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 711/1423] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:14:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:14:09.755338 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77547474-d5cd-4259-b51e-28a69aa750e4 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:09.755616 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77547474-d5cd-4259-b51e-28a69aa750e4 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:09.755886 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77547474-d5cd-4259-b51e-28a69aa750e4 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:09.757815 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 713/1424] 10.222.0.15 () {54 vars in 962 bytes} [Mon Nov 29 20:14:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:14:09.763652 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d0eb0-666c-4b8c-b38a-3246467c583a None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:09.764029 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d0eb0-666c-4b8c-b38a-3246467c583a None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:09.764364 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930d0eb0-666c-4b8c-b38a-3246467c583a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:09.815367 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-930d0eb0-666c-4b8c-b38a-3246467c583a None None] MFA Rules not processed for user `bcc415af1f5a42febbdbd187e066cf85`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:14:09.816568 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-930d0eb0-666c-4b8c-b38a-3246467c583a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:14:09.877609 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 712/1425] 10.222.0.15 () {58 vars in 1059 bytes} [Mon Nov 29 20:14:09 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:14:09.886103 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77547474-d5cd-4259-b51e-28a69aa750e4 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:14:09.897740 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77547474-d5cd-4259-b51e-28a69aa750e4 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:14:09.901581 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119194d-3ee0-4f5c-bbbe-a77b4658b1f6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcc415af1f5a42febbdbd187e066cf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:14:09.902509 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119194d-3ee0-4f5c-bbbe-a77b4658b1f6 service glance] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:09.902789 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119194d-3ee0-4f5c-bbbe-a77b4658b1f6 service glance] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:09.903104 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119194d-3ee0-4f5c-bbbe-a77b4658b1f6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:09.912464 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0119194d-3ee0-4f5c-bbbe-a77b4658b1f6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:14:09.913826 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0119194d-3ee0-4f5c-bbbe-a77b4658b1f6 service glance] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:14:09.923612 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 714/1426] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:14:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:14:10.366228 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500470a-e532-4b82-8663-0951a0ef6c6e None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:10.366810 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500470a-e532-4b82-8663-0951a0ef6c6e None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:10.366810 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3500470a-e532-4b82-8663-0951a0ef6c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:10.414436 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-3500470a-e532-4b82-8663-0951a0ef6c6e None None] MFA Rules not processed for user `19d72c913c2b4442836a991120eec243`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:14:10.415649 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-3500470a-e532-4b82-8663-0951a0ef6c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:14:10.484059 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 713/1427] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Nov 29 20:14:10 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:14:10.526659 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1018a-f635-4af9-9f64-ae4ff3dc2ee7 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:10.527208 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1018a-f635-4af9-9f64-ae4ff3dc2ee7 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:10.527321 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad1018a-f635-4af9-9f64-ae4ff3dc2ee7 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:10.529095 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 715/1428] 10.222.0.15 () {54 vars in 942 bytes} [Mon Nov 29 20:14:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:14:10.535936 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353bb06-92fa-4764-b9f2-df8c2822a7e4 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:10.536301 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353bb06-92fa-4764-b9f2-df8c2822a7e4 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:10.536644 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353bb06-92fa-4764-b9f2-df8c2822a7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:10.589605 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-f353bb06-92fa-4764-b9f2-df8c2822a7e4 None None] MFA Rules not processed for user `51fc6fd9b37447bba1759a702b86ce6c`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:14:10.590869 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-f353bb06-92fa-4764-b9f2-df8c2822a7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:14:10.663176 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 714/1429] 10.222.0.15 () {58 vars in 1039 bytes} [Mon Nov 29 20:14:10 2021] POST /identity/v3/auth/tokens => generated 3294 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:14:10.673034 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad1018a-f635-4af9-9f64-ae4ff3dc2ee7 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:14:10.687076 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad1018a-f635-4af9-9f64-ae4ff3dc2ee7 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:14:10.692734 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a94f04-6341-4634-8014-7c24d84032c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51fc6fd9b37447bba1759a702b86ce6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:14:10.693378 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a94f04-6341-4634-8014-7c24d84032c4 service swift] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:10.693746 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a94f04-6341-4634-8014-7c24d84032c4 service swift] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:10.694026 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a94f04-6341-4634-8014-7c24d84032c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:10.702875 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a94f04-6341-4634-8014-7c24d84032c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:14:10.704618 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a94f04-6341-4634-8014-7c24d84032c4 service swift] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:14:10.712901 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 716/1430] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Nov 29 20:14:10 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:14:11.571825 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7578bf-8928-4c54-a08a-fab8c5ca5edf None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:11.572495 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7578bf-8928-4c54-a08a-fab8c5ca5edf None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:11.572495 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7578bf-8928-4c54-a08a-fab8c5ca5edf None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:11.574153 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 715/1431] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:14:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:14:11.580313 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b5b47-bffe-4a99-822e-5f30ba2d953e None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:11.580780 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b5b47-bffe-4a99-822e-5f30ba2d953e None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:11.580881 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302b5b47-bffe-4a99-822e-5f30ba2d953e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:11.599976 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-302b5b47-bffe-4a99-822e-5f30ba2d953e None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:14:11.601174 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-302b5b47-bffe-4a99-822e-5f30ba2d953e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:14:11.609354 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 717/1432] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:14:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:14:11.656007 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7578bf-8928-4c54-a08a-fab8c5ca5edf None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:14:11.671551 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7578bf-8928-4c54-a08a-fab8c5ca5edf None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:14:11.677087 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b43990-a15a-49c6-9e79-a753f017b9a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:14:11.677812 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b43990-a15a-49c6-9e79-a753f017b9a4 service nova] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:11.678160 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b43990-a15a-49c6-9e79-a753f017b9a4 service nova] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:11.678500 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b43990-a15a-49c6-9e79-a753f017b9a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:11.687062 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b43990-a15a-49c6-9e79-a753f017b9a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:14:11.688722 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b43990-a15a-49c6-9e79-a753f017b9a4 service nova] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:14:11.700462 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 716/1433] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:14:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:14:14.067637 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3b39c-21f6-4f18-9d7b-4a228692e2bc None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:14.068991 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3b39c-21f6-4f18-9d7b-4a228692e2bc None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:14.069381 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3b39c-21f6-4f18-9d7b-4a228692e2bc None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:14.071298 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 718/1434] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:14:14 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:14:14.077740 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8a0ad-17bd-4f2f-9676-1d4198d9df6a None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:14.078193 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8a0ad-17bd-4f2f-9676-1d4198d9df6a None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:14.078306 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8a0ad-17bd-4f2f-9676-1d4198d9df6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:14.096229 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-ede8a0ad-17bd-4f2f-9676-1d4198d9df6a None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:14:14.097527 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-ede8a0ad-17bd-4f2f-9676-1d4198d9df6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:14:14.106713 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 717/1435] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:14:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:14:14.153503 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3b39c-21f6-4f18-9d7b-4a228692e2bc None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:14:14.169033 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3b39c-21f6-4f18-9d7b-4a228692e2bc None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:14:14.176925 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150b7fc-512a-490b-9c17-869f89a45c1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:14:14.177656 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150b7fc-512a-490b-9c17-869f89a45c1d service nova] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:14.177941 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150b7fc-512a-490b-9c17-869f89a45c1d service nova] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:14.178216 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150b7fc-512a-490b-9c17-869f89a45c1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:14.187240 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1150b7fc-512a-490b-9c17-869f89a45c1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:14:14.189130 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1150b7fc-512a-490b-9c17-869f89a45c1d service nova] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:14:14.198822 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 719/1436] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:14:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:14:33.167055 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db45618-2063-468a-94fc-4d7b5f35066f None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:33.167607 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db45618-2063-468a-94fc-4d7b5f35066f None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:33.167607 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db45618-2063-468a-94fc-4d7b5f35066f None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:33.169295 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 718/1437] 10.222.0.15 () {54 vars in 918 bytes} [Mon Nov 29 20:14:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:14:33.176241 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe68181-8340-4d76-8a33-5a2599b233b4 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:33.176681 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe68181-8340-4d76-8a33-5a2599b233b4 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:33.176797 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe68181-8340-4d76-8a33-5a2599b233b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:33.198608 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-4fe68181-8340-4d76-8a33-5a2599b233b4 None None] MFA Rules not processed for user `b954c18d7e9349e899f4c1cd42b89166`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:14:33.199832 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-4fe68181-8340-4d76-8a33-5a2599b233b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:14:33.209596 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 720/1438] 10.222.0.15 () {58 vars in 1015 bytes} [Mon Nov 29 20:14:33 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:14:33.229372 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fcfe7-89ca-4f69-8a7b-9e9d7209963e None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:33.229657 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fcfe7-89ca-4f69-8a7b-9e9d7209963e None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:33.229936 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fcfe7-89ca-4f69-8a7b-9e9d7209963e None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:33.232544 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 719/1439] 10.222.0.15 () {54 vars in 918 bytes} [Mon Nov 29 20:14:33 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:14:33.237758 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324466b-8f1e-41f3-b7e9-3ffa67320275 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:33.238040 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324466b-8f1e-41f3-b7e9-3ffa67320275 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:33.238326 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324466b-8f1e-41f3-b7e9-3ffa67320275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:33.258049 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-d324466b-8f1e-41f3-b7e9-3ffa67320275 None None] MFA Rules not processed for user `5f76a8c3d04e440b92d12ced18d97941`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:14:33.259268 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-d324466b-8f1e-41f3-b7e9-3ffa67320275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:14:33.270273 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 721/1440] 10.222.0.15 () {58 vars in 1015 bytes} [Mon Nov 29 20:14:33 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:14:35.998732 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7878b-1706-4986-aeda-b470c73f0785 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:35.999620 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7878b-1706-4986-aeda-b470c73f0785 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:35.999620 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7878b-1706-4986-aeda-b470c73f0785 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:36.001855 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 720/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Nov 29 20:14:35 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:14:36.008464 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249da08-5687-4700-83fd-8376eefea2be None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:36.008946 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249da08-5687-4700-83fd-8376eefea2be None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:36.009052 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249da08-5687-4700-83fd-8376eefea2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:36.030360 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-b249da08-5687-4700-83fd-8376eefea2be None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:14:36.031573 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-b249da08-5687-4700-83fd-8376eefea2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:14:36.040341 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 722/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Nov 29 20:14:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:14:36.088089 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7878b-1706-4986-aeda-b470c73f0785 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:14:36.104532 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7878b-1706-4986-aeda-b470c73f0785 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:14:36.110708 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e21a50-3bd1-42cc-9cbe-ffeafaf04bb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:14:36.111380 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e21a50-3bd1-42cc-9cbe-ffeafaf04bb2 service nova] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:36.111659 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e21a50-3bd1-42cc-9cbe-ffeafaf04bb2 service nova] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:36.111931 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e21a50-3bd1-42cc-9cbe-ffeafaf04bb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:36.121111 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e21a50-3bd1-42cc-9cbe-ffeafaf04bb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:14:36.122772 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e21a50-3bd1-42cc-9cbe-ffeafaf04bb2 service nova] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:14:36.132555 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 721/1443] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:14:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:14:37.673973 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8c8e6-b10d-447d-8114-af6a40cb220e None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:37.674585 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8c8e6-b10d-447d-8114-af6a40cb220e None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:37.674585 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8c8e6-b10d-447d-8114-af6a40cb220e None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:37.676315 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 723/1444] 127.0.0.1 () {54 vars in 901 bytes} [Mon Nov 29 20:14:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:14:37.681961 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db659f0-630d-4386-af8b-b5eb2be1d4b8 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:37.682604 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db659f0-630d-4386-af8b-b5eb2be1d4b8 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:37.682604 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db659f0-630d-4386-af8b-b5eb2be1d4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:37.702360 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-0db659f0-630d-4386-af8b-b5eb2be1d4b8 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:14:37.703602 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-0db659f0-630d-4386-af8b-b5eb2be1d4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:14:37.712061 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 722/1445] 127.0.0.1 () {58 vars in 998 bytes} [Mon Nov 29 20:14:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:14:37.867670 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8c8e6-b10d-447d-8114-af6a40cb220e None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:14:37.883170 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8c8e6-b10d-447d-8114-af6a40cb220e None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:14:37.889539 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c28768c-ab0a-4f47-a9c0-738834d19836 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:14:37.890171 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c28768c-ab0a-4f47-a9c0-738834d19836 service nova] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:37.890444 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c28768c-ab0a-4f47-a9c0-738834d19836 service nova] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:37.890716 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c28768c-ab0a-4f47-a9c0-738834d19836 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:37.899367 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c28768c-ab0a-4f47-a9c0-738834d19836 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:14:37.900943 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c28768c-ab0a-4f47-a9c0-738834d19836 service nova] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:14:37.910182 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 724/1446] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:14:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:14:39.437853 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce0acb-bb17-4ee9-a9ea-c336e111fd82 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:39.438756 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce0acb-bb17-4ee9-a9ea-c336e111fd82 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:39.438756 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce0acb-bb17-4ee9-a9ea-c336e111fd82 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:39.441697 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 723/1447] 127.0.0.1 () {54 vars in 901 bytes} [Mon Nov 29 20:14:39 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:14:39.447434 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709bc52-4045-4090-84d4-3def3d4be298 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:39.447875 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709bc52-4045-4090-84d4-3def3d4be298 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:39.447984 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709bc52-4045-4090-84d4-3def3d4be298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:39.467850 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-f709bc52-4045-4090-84d4-3def3d4be298 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:14:39.469030 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-f709bc52-4045-4090-84d4-3def3d4be298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:14:39.478067 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 725/1448] 127.0.0.1 () {58 vars in 998 bytes} [Mon Nov 29 20:14:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:14:39.638046 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce0acb-bb17-4ee9-a9ea-c336e111fd82 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:14:39.655485 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce0acb-bb17-4ee9-a9ea-c336e111fd82 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:14:39.661827 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd1cf5-a96d-419e-93cf-538ac28faea6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:14:39.662458 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd1cf5-a96d-419e-93cf-538ac28faea6 service nova] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:39.662747 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd1cf5-a96d-419e-93cf-538ac28faea6 service nova] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:39.663035 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd1cf5-a96d-419e-93cf-538ac28faea6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:39.671322 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fd1cf5-a96d-419e-93cf-538ac28faea6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:14:39.672943 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fd1cf5-a96d-419e-93cf-538ac28faea6 service nova] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:14:39.682272 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 724/1449] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:14:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 29 20:14:41.189040 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094af06-df11-4bb8-a867-35dc630c6ce6 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:41.189592 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094af06-df11-4bb8-a867-35dc630c6ce6 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:41.189592 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094af06-df11-4bb8-a867-35dc630c6ce6 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:41.191334 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 726/1450] 127.0.0.1 () {54 vars in 901 bytes} [Mon Nov 29 20:14:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:14:41.197898 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdcf30f-f2c1-4f14-9857-fcb43f5cfbcb None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:41.198611 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdcf30f-f2c1-4f14-9857-fcb43f5cfbcb None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:41.198756 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdcf30f-f2c1-4f14-9857-fcb43f5cfbcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:41.220058 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-dbdcf30f-f2c1-4f14-9857-fcb43f5cfbcb None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:14:41.221253 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-dbdcf30f-f2c1-4f14-9857-fcb43f5cfbcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:14:41.231209 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 725/1451] 127.0.0.1 () {58 vars in 998 bytes} [Mon Nov 29 20:14:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:14:41.391887 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094af06-df11-4bb8-a867-35dc630c6ce6 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:14:41.408675 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094af06-df11-4bb8-a867-35dc630c6ce6 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:14:41.415053 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31fa30b-256b-4294-af9c-b80a8b846183 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:14:41.415693 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fa30b-256b-4294-af9c-b80a8b846183 service nova] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:41.415970 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fa30b-256b-4294-af9c-b80a8b846183 service nova] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:41.416242 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fa30b-256b-4294-af9c-b80a8b846183 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:41.425227 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31fa30b-256b-4294-af9c-b80a8b846183 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:14:41.426838 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31fa30b-256b-4294-af9c-b80a8b846183 service nova] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:14:41.436594 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 727/1452] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:14:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 29 20:14:42.937100 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f0a63-16f7-43e5-aa9c-319c8e852065 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:42.937992 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f0a63-16f7-43e5-aa9c-319c8e852065 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:42.937992 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f0a63-16f7-43e5-aa9c-319c8e852065 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:42.941026 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 726/1453] 127.0.0.1 () {54 vars in 901 bytes} [Mon Nov 29 20:14:42 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:14:42.947872 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b0226-7529-413f-9fdc-51440022c242 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:42.948604 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b0226-7529-413f-9fdc-51440022c242 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:42.948780 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b0226-7529-413f-9fdc-51440022c242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:42.970125 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-117b0226-7529-413f-9fdc-51440022c242 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:14:42.971409 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-117b0226-7529-413f-9fdc-51440022c242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:14:42.979822 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 728/1454] 127.0.0.1 () {58 vars in 998 bytes} [Mon Nov 29 20:14:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:14:43.131488 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f0a63-16f7-43e5-aa9c-319c8e852065 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:14:43.150174 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f0a63-16f7-43e5-aa9c-319c8e852065 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:14:43.156509 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cedae3d-f5ae-4214-aca1-b4ec2ca072d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:14:43.157147 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cedae3d-f5ae-4214-aca1-b4ec2ca072d4 service nova] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:43.157422 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cedae3d-f5ae-4214-aca1-b4ec2ca072d4 service nova] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:43.157694 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cedae3d-f5ae-4214-aca1-b4ec2ca072d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:43.165799 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cedae3d-f5ae-4214-aca1-b4ec2ca072d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:14:43.167403 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cedae3d-f5ae-4214-aca1-b4ec2ca072d4 service nova] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:14:43.176556 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 727/1455] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:14:43 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:14:44.638886 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45b370-181a-43b2-887a-79436173ec11 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:44.639517 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45b370-181a-43b2-887a-79436173ec11 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:44.639517 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea45b370-181a-43b2-887a-79436173ec11 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:44.641276 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 729/1456] 127.0.0.1 () {54 vars in 901 bytes} [Mon Nov 29 20:14:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:14:44.648197 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac920385-2b13-4115-a047-c2ff099423d3 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:44.648975 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac920385-2b13-4115-a047-c2ff099423d3 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:44.649154 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac920385-2b13-4115-a047-c2ff099423d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:44.669839 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-ac920385-2b13-4115-a047-c2ff099423d3 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:14:44.671108 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-ac920385-2b13-4115-a047-c2ff099423d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:14:44.680266 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 728/1457] 127.0.0.1 () {58 vars in 998 bytes} [Mon Nov 29 20:14:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:14:44.833583 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45b370-181a-43b2-887a-79436173ec11 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:14:44.848749 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea45b370-181a-43b2-887a-79436173ec11 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:14:44.854453 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6e480-0697-4a16-b5b5-13f1b57cd474 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:14:44.855126 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6e480-0697-4a16-b5b5-13f1b57cd474 service nova] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:44.855405 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6e480-0697-4a16-b5b5-13f1b57cd474 service nova] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:44.855673 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6e480-0697-4a16-b5b5-13f1b57cd474 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:44.864359 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6e480-0697-4a16-b5b5-13f1b57cd474 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:14:44.865994 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6e480-0697-4a16-b5b5-13f1b57cd474 service nova] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:14:44.875965 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 730/1458] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:14:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:14:46.346321 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f89dc2-039c-4128-acaa-9229797752d4 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:46.346943 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f89dc2-039c-4128-acaa-9229797752d4 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:46.346943 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f89dc2-039c-4128-acaa-9229797752d4 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:46.349663 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 729/1459] 127.0.0.1 () {54 vars in 901 bytes} [Mon Nov 29 20:14:46 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:14:46.358057 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c1051-158f-4229-891e-e1a11f8e5e21 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:46.358461 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c1051-158f-4229-891e-e1a11f8e5e21 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:46.358609 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c1051-158f-4229-891e-e1a11f8e5e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:46.377538 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-fa8c1051-158f-4229-891e-e1a11f8e5e21 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:14:46.378747 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-fa8c1051-158f-4229-891e-e1a11f8e5e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:14:46.387050 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 731/1460] 127.0.0.1 () {58 vars in 998 bytes} [Mon Nov 29 20:14:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:14:46.544052 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f89dc2-039c-4128-acaa-9229797752d4 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:14:46.562075 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f89dc2-039c-4128-acaa-9229797752d4 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:14:46.569597 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e31e3a-043d-49ce-8029-89d7944ce391 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:14:46.570230 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e31e3a-043d-49ce-8029-89d7944ce391 service nova] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:46.570512 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e31e3a-043d-49ce-8029-89d7944ce391 service nova] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:46.570786 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e31e3a-043d-49ce-8029-89d7944ce391 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:46.579236 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e31e3a-043d-49ce-8029-89d7944ce391 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:14:46.580838 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e31e3a-043d-49ce-8029-89d7944ce391 service nova] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:14:46.590197 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 730/1461] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:14:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:14:48.044118 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52aacc4-54d2-4c1d-a95b-a7304d90ddb3 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:48.044717 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52aacc4-54d2-4c1d-a95b-a7304d90ddb3 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:48.044717 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52aacc4-54d2-4c1d-a95b-a7304d90ddb3 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:48.046362 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 732/1462] 127.0.0.1 () {54 vars in 901 bytes} [Mon Nov 29 20:14:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:14:48.053108 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f81757-50e3-4d2e-8c1b-81a6e84814ad None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:48.053728 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f81757-50e3-4d2e-8c1b-81a6e84814ad None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:48.053832 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f81757-50e3-4d2e-8c1b-81a6e84814ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:48.080420 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-63f81757-50e3-4d2e-8c1b-81a6e84814ad None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:14:48.081633 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-63f81757-50e3-4d2e-8c1b-81a6e84814ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:14:48.091179 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 731/1463] 127.0.0.1 () {58 vars in 998 bytes} [Mon Nov 29 20:14:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:14:48.249203 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52aacc4-54d2-4c1d-a95b-a7304d90ddb3 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:14:48.268397 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52aacc4-54d2-4c1d-a95b-a7304d90ddb3 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:14:48.275235 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4608866-b7f8-4885-8348-126bd8481cf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:14:48.275875 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4608866-b7f8-4885-8348-126bd8481cf5 service nova] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:48.276152 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4608866-b7f8-4885-8348-126bd8481cf5 service nova] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:48.276427 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4608866-b7f8-4885-8348-126bd8481cf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:48.284707 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4608866-b7f8-4885-8348-126bd8481cf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:14:48.286324 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4608866-b7f8-4885-8348-126bd8481cf5 service nova] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:14:48.295741 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 733/1464] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:14:48 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:14:49.752585 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421232b-f353-4b69-8b3a-543642450e07 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:49.753505 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421232b-f353-4b69-8b3a-543642450e07 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:49.753505 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421232b-f353-4b69-8b3a-543642450e07 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:49.756224 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 732/1465] 127.0.0.1 () {54 vars in 901 bytes} [Mon Nov 29 20:14:49 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:14:49.765186 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1cad70-c5a3-4fa5-91d2-7a4ba0e984e2 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:49.765876 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1cad70-c5a3-4fa5-91d2-7a4ba0e984e2 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:49.766059 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1cad70-c5a3-4fa5-91d2-7a4ba0e984e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:49.791004 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-4d1cad70-c5a3-4fa5-91d2-7a4ba0e984e2 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:14:49.792232 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-4d1cad70-c5a3-4fa5-91d2-7a4ba0e984e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:14:49.802838 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 734/1466] 127.0.0.1 () {58 vars in 998 bytes} [Mon Nov 29 20:14:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:14:49.958439 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421232b-f353-4b69-8b3a-543642450e07 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:14:49.977284 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421232b-f353-4b69-8b3a-543642450e07 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:14:49.983746 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae054f6-3201-41fa-a91a-11d4703f2744 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:14:49.984376 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae054f6-3201-41fa-a91a-11d4703f2744 service nova] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:49.984656 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae054f6-3201-41fa-a91a-11d4703f2744 service nova] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:49.984908 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae054f6-3201-41fa-a91a-11d4703f2744 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:49.993125 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae054f6-3201-41fa-a91a-11d4703f2744 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:14:49.994690 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae054f6-3201-41fa-a91a-11d4703f2744 service nova] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:14:50.004100 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 733/1467] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:14:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:14:52.222495 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d390d-cf00-4b40-bfd9-42fe5d9f622f None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:52.223417 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d390d-cf00-4b40-bfd9-42fe5d9f622f None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:52.223417 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d390d-cf00-4b40-bfd9-42fe5d9f622f None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:52.226251 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 735/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Nov 29 20:14:52 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:14:52.232462 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3f5c6-fd77-4470-ab1f-e46ea92cb727 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:52.232886 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3f5c6-fd77-4470-ab1f-e46ea92cb727 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:52.233003 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3f5c6-fd77-4470-ab1f-e46ea92cb727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:52.252016 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-0ba3f5c6-fd77-4470-ab1f-e46ea92cb727 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:14:52.253181 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-0ba3f5c6-fd77-4470-ab1f-e46ea92cb727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:14:52.261265 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 734/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Nov 29 20:14:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:14:52.304047 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d390d-cf00-4b40-bfd9-42fe5d9f622f None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:14:52.316267 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d390d-cf00-4b40-bfd9-42fe5d9f622f None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:14:52.320492 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be83bf-8671-44c8-8a2b-c687d438598b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:14:52.321121 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be83bf-8671-44c8-8a2b-c687d438598b service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:52.321391 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be83bf-8671-44c8-8a2b-c687d438598b service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:52.321657 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be83bf-8671-44c8-8a2b-c687d438598b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:52.331113 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09be83bf-8671-44c8-8a2b-c687d438598b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:14:52.332515 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09be83bf-8671-44c8-8a2b-c687d438598b service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:14:52.341721 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 736/1470] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:14:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 29 20:14:54.784205 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca76cf-5e36-4b1b-af99-89809e360bde None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:54.784778 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca76cf-5e36-4b1b-af99-89809e360bde None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:54.784778 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca76cf-5e36-4b1b-af99-89809e360bde None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:54.787399 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 735/1471] 127.0.0.1 () {54 vars in 916 bytes} [Mon Nov 29 20:14:54 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:14:54.796389 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1fdbd-8020-4acb-a90e-2a4c6ae27080 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:54.796877 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1fdbd-8020-4acb-a90e-2a4c6ae27080 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:54.796877 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1fdbd-8020-4acb-a90e-2a4c6ae27080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:54.816200 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-76d1fdbd-8020-4acb-a90e-2a4c6ae27080 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:14:54.817380 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-76d1fdbd-8020-4acb-a90e-2a4c6ae27080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:14:54.828200 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 737/1472] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Nov 29 20:14:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:14:54.874889 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca76cf-5e36-4b1b-af99-89809e360bde None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:14:54.893493 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca76cf-5e36-4b1b-af99-89809e360bde None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:14:54.899821 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e4d75-55a1-4f8f-bf81-1d11e8cfed97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:14:54.900463 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e4d75-55a1-4f8f-bf81-1d11e8cfed97 service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:54.900714 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e4d75-55a1-4f8f-bf81-1d11e8cfed97 service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:54.901011 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e4d75-55a1-4f8f-bf81-1d11e8cfed97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:54.911404 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e4d75-55a1-4f8f-bf81-1d11e8cfed97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:14:54.912839 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e4d75-55a1-4f8f-bf81-1d11e8cfed97 service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:14:54.922548 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 736/1473] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:14:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:14:57.674007 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742efb6-3129-4d55-a588-1a0e7ad51443 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:57.674616 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742efb6-3129-4d55-a588-1a0e7ad51443 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:57.674616 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742efb6-3129-4d55-a588-1a0e7ad51443 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:57.676815 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 738/1474] 127.0.0.1 () {54 vars in 916 bytes} [Mon Nov 29 20:14:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:14:57.684706 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58194c64-0b15-4a9f-80fa-efd2669c10da None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:57.685409 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58194c64-0b15-4a9f-80fa-efd2669c10da None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:57.685610 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58194c64-0b15-4a9f-80fa-efd2669c10da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:57.710530 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-58194c64-0b15-4a9f-80fa-efd2669c10da None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:14:57.711767 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-58194c64-0b15-4a9f-80fa-efd2669c10da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:14:57.721277 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 737/1475] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Nov 29 20:14:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:14:57.764753 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6742efb6-3129-4d55-a588-1a0e7ad51443 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:14:57.777703 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6742efb6-3129-4d55-a588-1a0e7ad51443 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:14:57.782084 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a342c55-29c6-42f3-8139-f8d52ea9dcab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:14:57.782732 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a342c55-29c6-42f3-8139-f8d52ea9dcab service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:14:57.783109 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a342c55-29c6-42f3-8139-f8d52ea9dcab service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:14:57.783389 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a342c55-29c6-42f3-8139-f8d52ea9dcab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:14:57.792813 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a342c55-29c6-42f3-8139-f8d52ea9dcab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:14:57.794343 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a342c55-29c6-42f3-8139-f8d52ea9dcab service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:14:57.804016 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 739/1476] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:14:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:15:00.280368 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b9f6f-c155-447d-b8bd-7c14e3de8201 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:15:00.281315 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b9f6f-c155-447d-b8bd-7c14e3de8201 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:15:00.281315 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b9f6f-c155-447d-b8bd-7c14e3de8201 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:15:00.284175 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 738/1477] 127.0.0.1 () {54 vars in 916 bytes} [Mon Nov 29 20:15:00 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:15:00.291433 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57c3d4-f90a-4af3-ad7e-7e46107d5672 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:15:00.292159 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57c3d4-f90a-4af3-ad7e-7e46107d5672 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:15:00.292325 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd57c3d4-f90a-4af3-ad7e-7e46107d5672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:15:00.316656 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-cd57c3d4-f90a-4af3-ad7e-7e46107d5672 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:15:00.317863 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-cd57c3d4-f90a-4af3-ad7e-7e46107d5672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:15:00.326947 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 740/1478] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Nov 29 20:15:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:15:00.370550 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b9f6f-c155-447d-b8bd-7c14e3de8201 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:15:00.383375 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b9f6f-c155-447d-b8bd-7c14e3de8201 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:15:00.388174 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aca37d-3e70-43e6-b868-e234006d8938 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:15:00.388805 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aca37d-3e70-43e6-b868-e234006d8938 service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:15:00.389080 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aca37d-3e70-43e6-b868-e234006d8938 service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:15:00.389344 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aca37d-3e70-43e6-b868-e234006d8938 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:15:00.399245 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aca37d-3e70-43e6-b868-e234006d8938 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:15:00.400673 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aca37d-3e70-43e6-b868-e234006d8938 service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:15:00.410091 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 739/1479] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:15:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:15:02.761336 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5948b-033b-42b0-88bc-c3d183c3f314 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:15:02.762258 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5948b-033b-42b0-88bc-c3d183c3f314 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:15:02.762258 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5948b-033b-42b0-88bc-c3d183c3f314 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:15:02.764412 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 741/1480] 127.0.0.1 () {54 vars in 916 bytes} [Mon Nov 29 20:15:02 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:15:02.771524 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb78d3a-74be-478a-81b4-30c05da7019f None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:15:02.771947 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb78d3a-74be-478a-81b4-30c05da7019f None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:15:02.772094 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb78d3a-74be-478a-81b4-30c05da7019f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:15:02.797858 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-9bb78d3a-74be-478a-81b4-30c05da7019f None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:15:02.799099 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-9bb78d3a-74be-478a-81b4-30c05da7019f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:15:02.808335 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 740/1481] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Nov 29 20:15:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:15:02.849996 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5948b-033b-42b0-88bc-c3d183c3f314 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:15:02.863912 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5948b-033b-42b0-88bc-c3d183c3f314 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:15:02.867933 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60042df-d0b8-42f0-8aca-2ea0ef323b81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:15:02.868604 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60042df-d0b8-42f0-8aca-2ea0ef323b81 service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:15:02.868884 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60042df-d0b8-42f0-8aca-2ea0ef323b81 service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:15:02.869162 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60042df-d0b8-42f0-8aca-2ea0ef323b81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:15:02.882393 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60042df-d0b8-42f0-8aca-2ea0ef323b81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:15:02.884559 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60042df-d0b8-42f0-8aca-2ea0ef323b81 service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:15:02.895798 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 742/1482] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:15:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:15:05.260424 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a0f06-193c-41b0-9a9c-7d24cd05d593 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:15:05.261010 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a0f06-193c-41b0-9a9c-7d24cd05d593 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:15:05.261010 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1a0f06-193c-41b0-9a9c-7d24cd05d593 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:15:05.263590 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 741/1483] 127.0.0.1 () {54 vars in 916 bytes} [Mon Nov 29 20:15:05 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:15:05.271266 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680bdb3-27c4-4462-a32d-b976821d18c9 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:15:05.271707 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680bdb3-27c4-4462-a32d-b976821d18c9 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:15:05.271826 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3680bdb3-27c4-4462-a32d-b976821d18c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:15:05.294071 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-3680bdb3-27c4-4462-a32d-b976821d18c9 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:15:05.295306 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-3680bdb3-27c4-4462-a32d-b976821d18c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:15:05.304536 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 743/1484] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Nov 29 20:15:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:15:05.346064 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a0f06-193c-41b0-9a9c-7d24cd05d593 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:15:05.361788 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1a0f06-193c-41b0-9a9c-7d24cd05d593 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:15:05.366632 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9403ce2-51c0-4de1-a7d3-c627dd6b780c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:15:05.367382 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9403ce2-51c0-4de1-a7d3-c627dd6b780c service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:15:05.367665 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9403ce2-51c0-4de1-a7d3-c627dd6b780c service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:15:05.367937 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9403ce2-51c0-4de1-a7d3-c627dd6b780c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:15:05.377910 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9403ce2-51c0-4de1-a7d3-c627dd6b780c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:15:05.379453 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9403ce2-51c0-4de1-a7d3-c627dd6b780c service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:15:05.390943 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 742/1485] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:15:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 29 20:15:07.797932 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c16d3-7098-438d-87fd-623a2b29f118 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:15:07.798454 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c16d3-7098-438d-87fd-623a2b29f118 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:15:07.798454 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c16d3-7098-438d-87fd-623a2b29f118 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:15:07.800348 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 744/1486] 127.0.0.1 () {54 vars in 916 bytes} [Mon Nov 29 20:15:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:15:07.806551 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3336103-b0cc-4816-912d-26d6091fbd50 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:15:07.807026 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3336103-b0cc-4816-912d-26d6091fbd50 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:15:07.807125 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3336103-b0cc-4816-912d-26d6091fbd50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:15:07.826117 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-a3336103-b0cc-4816-912d-26d6091fbd50 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:15:07.827359 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-a3336103-b0cc-4816-912d-26d6091fbd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:15:07.836242 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 743/1487] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Nov 29 20:15:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:15:07.874792 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c16d3-7098-438d-87fd-623a2b29f118 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:15:07.886122 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c16d3-7098-438d-87fd-623a2b29f118 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:15:07.890069 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170fd6e-be73-4910-a73c-d73fcf9aa6f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:15:07.890694 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170fd6e-be73-4910-a73c-d73fcf9aa6f1 service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:15:07.891001 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170fd6e-be73-4910-a73c-d73fcf9aa6f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:15:07.891267 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170fd6e-be73-4910-a73c-d73fcf9aa6f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:15:07.901232 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3170fd6e-be73-4910-a73c-d73fcf9aa6f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:15:07.902642 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3170fd6e-be73-4910-a73c-d73fcf9aa6f1 service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:15:07.911765 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 745/1488] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:15:07 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 29 20:15:10.265802 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd36b1-2911-47ff-a010-7f16f23e9a59 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:15:10.266669 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd36b1-2911-47ff-a010-7f16f23e9a59 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:15:10.266669 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd36b1-2911-47ff-a010-7f16f23e9a59 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:15:10.269829 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 744/1489] 127.0.0.1 () {54 vars in 916 bytes} [Mon Nov 29 20:15:10 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:15:10.279788 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16062ee9-fff8-4b76-8cd8-97fb44fbcfe4 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:15:10.280243 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16062ee9-fff8-4b76-8cd8-97fb44fbcfe4 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:15:10.280354 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16062ee9-fff8-4b76-8cd8-97fb44fbcfe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:15:10.303739 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-16062ee9-fff8-4b76-8cd8-97fb44fbcfe4 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:15:10.304927 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-16062ee9-fff8-4b76-8cd8-97fb44fbcfe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:15:10.314169 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 746/1490] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Nov 29 20:15:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:15:10.357052 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd36b1-2911-47ff-a010-7f16f23e9a59 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:15:10.374562 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd36b1-2911-47ff-a010-7f16f23e9a59 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:15:10.380293 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450bf41-e648-4bec-b694-9b35ddfb2606 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:15:10.380986 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450bf41-e648-4bec-b694-9b35ddfb2606 service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:15:10.381243 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450bf41-e648-4bec-b694-9b35ddfb2606 service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:15:10.381511 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450bf41-e648-4bec-b694-9b35ddfb2606 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:15:10.391448 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450bf41-e648-4bec-b694-9b35ddfb2606 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:15:10.392947 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450bf41-e648-4bec-b694-9b35ddfb2606 service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:15:10.403055 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 745/1491] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:15:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:15:12.748862 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bffc7-8f35-4908-9b78-8e09c288fd2e None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:15:12.749809 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bffc7-8f35-4908-9b78-8e09c288fd2e None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:15:12.749809 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bffc7-8f35-4908-9b78-8e09c288fd2e None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:15:12.752650 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 747/1492] 127.0.0.1 () {54 vars in 916 bytes} [Mon Nov 29 20:15:12 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:15:12.760449 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21315453-7973-4e81-8b8e-32938dd39a86 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:15:12.761195 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21315453-7973-4e81-8b8e-32938dd39a86 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:15:12.761321 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21315453-7973-4e81-8b8e-32938dd39a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:15:12.781948 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-21315453-7973-4e81-8b8e-32938dd39a86 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:15:12.783183 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-21315453-7973-4e81-8b8e-32938dd39a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:15:12.791603 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 746/1493] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Nov 29 20:15:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:15:12.829142 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91bffc7-8f35-4908-9b78-8e09c288fd2e None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:15:12.841170 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91bffc7-8f35-4908-9b78-8e09c288fd2e None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:15:12.845378 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c7a16-8174-4dfb-9951-4cc6593a6f9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:15:12.846007 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c7a16-8174-4dfb-9951-4cc6593a6f9b service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:15:12.846283 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c7a16-8174-4dfb-9951-4cc6593a6f9b service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:15:12.846555 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c7a16-8174-4dfb-9951-4cc6593a6f9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:15:12.856234 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c7a16-8174-4dfb-9951-4cc6593a6f9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:15:12.857703 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c7a16-8174-4dfb-9951-4cc6593a6f9b service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:15:12.866983 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 748/1494] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:15:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:15:15.199543 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c016b1c-6d57-4887-a2e2-8422f4406197 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:15:15.200554 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c016b1c-6d57-4887-a2e2-8422f4406197 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:15:15.200554 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c016b1c-6d57-4887-a2e2-8422f4406197 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:15:15.203336 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 747/1495] 127.0.0.1 () {54 vars in 916 bytes} [Mon Nov 29 20:15:15 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:15:15.213136 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b680c-aff8-4cc2-8f4d-4cd2d51998db None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:15:15.213590 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b680c-aff8-4cc2-8f4d-4cd2d51998db None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:15:15.213723 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b680c-aff8-4cc2-8f4d-4cd2d51998db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:15:15.233124 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-408b680c-aff8-4cc2-8f4d-4cd2d51998db None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:15:15.234325 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-408b680c-aff8-4cc2-8f4d-4cd2d51998db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:15:15.242827 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 749/1496] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Nov 29 20:15:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:15:15.282614 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c016b1c-6d57-4887-a2e2-8422f4406197 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:15:15.295176 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c016b1c-6d57-4887-a2e2-8422f4406197 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:15:15.299923 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07b7a7e-23a8-4ec1-8c28-ec4852e03624 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:15:15.300741 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b7a7e-23a8-4ec1-8c28-ec4852e03624 service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:15:15.301003 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b7a7e-23a8-4ec1-8c28-ec4852e03624 service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:15:15.301285 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07b7a7e-23a8-4ec1-8c28-ec4852e03624 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:15:15.313015 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b7a7e-23a8-4ec1-8c28-ec4852e03624 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:15:15.314502 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07b7a7e-23a8-4ec1-8c28-ec4852e03624 service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:15:15.323807 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 748/1497] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:15:15 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 29 20:15:32.127392 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bf1dd-be40-4c1e-a640-4fdfe0b31adb None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:15:32.128235 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bf1dd-be40-4c1e-a640-4fdfe0b31adb None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:15:32.128235 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6bf1dd-be40-4c1e-a640-4fdfe0b31adb None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:15:32.131094 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 750/1498] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:15:32 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:15:32.137978 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63666066-e6c4-4427-a15b-a2e99b73e1d2 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:15:32.138434 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63666066-e6c4-4427-a15b-a2e99b73e1d2 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:15:32.138566 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63666066-e6c4-4427-a15b-a2e99b73e1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:15:32.168958 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-63666066-e6c4-4427-a15b-a2e99b73e1d2 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:15:32.170143 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-63666066-e6c4-4427-a15b-a2e99b73e1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:15:32.178831 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 749/1499] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:15:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:15:32.231487 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db81ff2-6e6f-44a6-a9a0-8a0c6a4cf925 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:15:32.231778 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db81ff2-6e6f-44a6-a9a0-8a0c6a4cf925 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:15:32.232053 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db81ff2-6e6f-44a6-a9a0-8a0c6a4cf925 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:15:32.233839 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 751/1500] 10.222.0.15 () {54 vars in 962 bytes} [Mon Nov 29 20:15:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:15:32.239210 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8bef1-e091-4ae5-a5e4-e82ed54e54ee None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:15:32.239509 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8bef1-e091-4ae5-a5e4-e82ed54e54ee None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:15:32.239778 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8bef1-e091-4ae5-a5e4-e82ed54e54ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:15:32.258265 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-a1c8bef1-e091-4ae5-a5e4-e82ed54e54ee None None] MFA Rules not processed for user `bcc415af1f5a42febbdbd187e066cf85`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:15:32.259465 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-a1c8bef1-e091-4ae5-a5e4-e82ed54e54ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:15:32.267107 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 750/1501] 10.222.0.15 () {58 vars in 1059 bytes} [Mon Nov 29 20:15:32 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:15:32.275415 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db81ff2-6e6f-44a6-a9a0-8a0c6a4cf925 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:15:32.286751 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db81ff2-6e6f-44a6-a9a0-8a0c6a4cf925 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:15:32.290435 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f456f57f-b9b6-4401-addf-96d723a779a4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcc415af1f5a42febbdbd187e066cf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:15:32.291093 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456f57f-b9b6-4401-addf-96d723a779a4 service glance] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:15:32.291373 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456f57f-b9b6-4401-addf-96d723a779a4 service glance] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:15:32.291643 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456f57f-b9b6-4401-addf-96d723a779a4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:15:32.301345 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f456f57f-b9b6-4401-addf-96d723a779a4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:15:32.302767 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f456f57f-b9b6-4401-addf-96d723a779a4 service glance] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:15:32.312489 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 752/1502] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:15:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:15:34.720769 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31f9bd-c59f-461b-b409-5b26e1c14af3 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:15:34.721349 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31f9bd-c59f-461b-b409-5b26e1c14af3 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:15:34.721349 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c31f9bd-c59f-461b-b409-5b26e1c14af3 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:15:34.723172 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 751/1503] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:15:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:15:34.730053 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c58df8-e2c6-456f-a487-5b000f266506 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:15:34.730820 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c58df8-e2c6-456f-a487-5b000f266506 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:15:34.731003 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c58df8-e2c6-456f-a487-5b000f266506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:15:34.756402 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-11c58df8-e2c6-456f-a487-5b000f266506 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:15:34.757628 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-11c58df8-e2c6-456f-a487-5b000f266506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:15:34.767168 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 753/1504] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:15:34 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:15:34.792171 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31f9bd-c59f-461b-b409-5b26e1c14af3 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:15:34.811651 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c31f9bd-c59f-461b-b409-5b26e1c14af3 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:15:34.817253 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9348b96-3d5c-43a2-8137-5327bb9d1ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:15:34.817908 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9348b96-3d5c-43a2-8137-5327bb9d1ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:15:34.818182 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9348b96-3d5c-43a2-8137-5327bb9d1ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:15:34.818445 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9348b96-3d5c-43a2-8137-5327bb9d1ba7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:15:34.819224 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9348b96-3d5c-43a2-8137-5327bb9d1ba7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:15:34.821080 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9348b96-3d5c-43a2-8137-5327bb9d1ba7 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:15:34.840661 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 752/1505] 10.222.0.15 () {56 vars in 1108 bytes} [Mon Nov 29 20:15:34 2021] GET /identity/v3/projects => generated 2553 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:15:37.206022 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfff26-2eb5-4857-ae39-cdd768f33baf None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:15:37.207041 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfff26-2eb5-4857-ae39-cdd768f33baf None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:15:37.207041 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfff26-2eb5-4857-ae39-cdd768f33baf None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:15:37.209972 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 754/1506] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:15:37 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:15:37.216649 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1258aae-f9ef-4a8d-9cf8-8dba1417351f None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:15:37.217139 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1258aae-f9ef-4a8d-9cf8-8dba1417351f None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:15:37.217256 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1258aae-f9ef-4a8d-9cf8-8dba1417351f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:15:37.240929 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-e1258aae-f9ef-4a8d-9cf8-8dba1417351f None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:15:37.242693 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-e1258aae-f9ef-4a8d-9cf8-8dba1417351f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:15:37.254276 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 753/1507] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:15:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:15:37.300438 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bfff26-2eb5-4857-ae39-cdd768f33baf None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:15:37.325192 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bfff26-2eb5-4857-ae39-cdd768f33baf None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:15:37.337647 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ea74f-6ac2-4e69-a6ab-5e9ecee485bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:15:37.338331 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ea74f-6ac2-4e69-a6ab-5e9ecee485bd service nova] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:15:37.338609 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ea74f-6ac2-4e69-a6ab-5e9ecee485bd service nova] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:15:37.338907 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ea74f-6ac2-4e69-a6ab-5e9ecee485bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:15:37.349543 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ea74f-6ac2-4e69-a6ab-5e9ecee485bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:15:37.351221 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ea74f-6ac2-4e69-a6ab-5e9ecee485bd service nova] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:15:37.362241 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 755/1508] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:15:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:15:39.918609 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3eea3-622b-4d7d-8cdd-9956ed0cde94 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:15:39.919226 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3eea3-622b-4d7d-8cdd-9956ed0cde94 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:15:39.919226 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3eea3-622b-4d7d-8cdd-9956ed0cde94 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:15:39.920985 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 754/1509] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:15:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:15:39.928271 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6b041-00ed-4658-9fd6-56c1fbee4439 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:15:39.929001 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6b041-00ed-4658-9fd6-56c1fbee4439 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:15:39.929173 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a6b041-00ed-4658-9fd6-56c1fbee4439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:15:39.949935 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-e5a6b041-00ed-4658-9fd6-56c1fbee4439 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:15:39.951169 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-e5a6b041-00ed-4658-9fd6-56c1fbee4439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:15:39.960508 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 756/1510] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:15:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:15:40.000650 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3eea3-622b-4d7d-8cdd-9956ed0cde94 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:15:40.013009 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3eea3-622b-4d7d-8cdd-9956ed0cde94 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:15:40.017196 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd3d3a-3b8d-4fe8-901c-506314d7045e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:15:40.017831 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd3d3a-3b8d-4fe8-901c-506314d7045e service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:15:40.018115 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd3d3a-3b8d-4fe8-901c-506314d7045e service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:15:40.018677 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd3d3a-3b8d-4fe8-901c-506314d7045e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:15:40.028318 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dd3d3a-3b8d-4fe8-901c-506314d7045e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:15:40.029826 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dd3d3a-3b8d-4fe8-901c-506314d7045e service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:15:40.039198 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 755/1511] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:15:39 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:15:42.441465 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62950712-55af-458b-b2f5-0f5a1ad84c1b None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:15:42.442004 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62950712-55af-458b-b2f5-0f5a1ad84c1b None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:15:42.442004 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62950712-55af-458b-b2f5-0f5a1ad84c1b None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:15:42.443771 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 757/1512] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:15:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:15:42.450794 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ecfa0-cb25-4cc1-91ae-52605c5edb11 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:15:42.451313 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ecfa0-cb25-4cc1-91ae-52605c5edb11 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:15:42.451453 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6ecfa0-cb25-4cc1-91ae-52605c5edb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:15:42.470121 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-5c6ecfa0-cb25-4cc1-91ae-52605c5edb11 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:15:42.471391 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-5c6ecfa0-cb25-4cc1-91ae-52605c5edb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:15:42.479984 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 756/1513] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:15:42 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:15:42.522385 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62950712-55af-458b-b2f5-0f5a1ad84c1b None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:15:42.536948 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62950712-55af-458b-b2f5-0f5a1ad84c1b None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:15:42.541408 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3edb2a1-f8e3-4e41-8c15-ee5a1d8be57d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:15:42.542043 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edb2a1-f8e3-4e41-8c15-ee5a1d8be57d service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:15:42.542322 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edb2a1-f8e3-4e41-8c15-ee5a1d8be57d service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:15:42.542592 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3edb2a1-f8e3-4e41-8c15-ee5a1d8be57d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:15:42.551940 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3edb2a1-f8e3-4e41-8c15-ee5a1d8be57d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:15:42.553408 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3edb2a1-f8e3-4e41-8c15-ee5a1d8be57d service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:15:42.563804 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 758/1514] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:15:42 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:15:45.038281 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9d9ad-fecf-422a-a75a-87fc63317e30 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:15:45.038914 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9d9ad-fecf-422a-a75a-87fc63317e30 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:15:45.038914 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9d9ad-fecf-422a-a75a-87fc63317e30 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:15:45.041554 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 757/1515] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:15:45 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:15:45.051482 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd492f-715d-459a-89c1-63fb6e2a88a8 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:15:45.051912 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd492f-715d-459a-89c1-63fb6e2a88a8 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:15:45.052046 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd492f-715d-459a-89c1-63fb6e2a88a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:15:45.073583 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-8ffd492f-715d-459a-89c1-63fb6e2a88a8 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:15:45.074777 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-8ffd492f-715d-459a-89c1-63fb6e2a88a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:15:45.083743 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 759/1516] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:15:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:15:45.127119 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9d9ad-fecf-422a-a75a-87fc63317e30 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:15:45.137824 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9d9ad-fecf-422a-a75a-87fc63317e30 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:15:45.141949 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd678840-ec79-4b4f-a4ac-9f745f0668f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:15:45.142597 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd678840-ec79-4b4f-a4ac-9f745f0668f4 service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:15:45.142919 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd678840-ec79-4b4f-a4ac-9f745f0668f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:15:45.143194 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd678840-ec79-4b4f-a4ac-9f745f0668f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:15:45.152269 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd678840-ec79-4b4f-a4ac-9f745f0668f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:15:45.153697 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd678840-ec79-4b4f-a4ac-9f745f0668f4 service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:15:45.162873 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 758/1517] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:15:45 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:15:47.681118 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d671cf-86bd-4140-b805-d3551067ad6f None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:15:47.682207 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d671cf-86bd-4140-b805-d3551067ad6f None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:15:47.682207 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d671cf-86bd-4140-b805-d3551067ad6f None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:15:47.685064 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 760/1518] 10.222.0.15 () {54 vars in 926 bytes} [Mon Nov 29 20:15:47 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:15:47.692082 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092611d-97e3-4bc0-888a-faac188f74b8 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:15:47.692783 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092611d-97e3-4bc0-888a-faac188f74b8 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:15:47.692930 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092611d-97e3-4bc0-888a-faac188f74b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:15:47.715172 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-8092611d-97e3-4bc0-888a-faac188f74b8 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:15:47.716368 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-8092611d-97e3-4bc0-888a-faac188f74b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:15:47.725032 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 759/1519] 10.222.0.15 () {58 vars in 1023 bytes} [Mon Nov 29 20:15:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:15:47.774658 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d671cf-86bd-4140-b805-d3551067ad6f None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:15:47.786224 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d671cf-86bd-4140-b805-d3551067ad6f None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:15:47.792595 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89986f38-b121-4719-8c21-a1e2a5bc1a5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:15:47.793550 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89986f38-b121-4719-8c21-a1e2a5bc1a5d service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:15:47.794028 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89986f38-b121-4719-8c21-a1e2a5bc1a5d service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:15:47.794181 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89986f38-b121-4719-8c21-a1e2a5bc1a5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:15:47.809077 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89986f38-b121-4719-8c21-a1e2a5bc1a5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:15:47.810527 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89986f38-b121-4719-8c21-a1e2a5bc1a5d service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:15:47.820758 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 761/1520] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:15:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 29 20:16:59.986636 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe07a8b-264d-45cf-8c45-b827b47b20ea None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:16:59.987279 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe07a8b-264d-45cf-8c45-b827b47b20ea None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:16:59.987279 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe07a8b-264d-45cf-8c45-b827b47b20ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:17:00.006405 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-9fe07a8b-264d-45cf-8c45-b827b47b20ea None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:17:00.007641 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-9fe07a8b-264d-45cf-8c45-b827b47b20ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:17:00.016613 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 760/1521] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:16:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:17:00.024949 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780dad7-71f0-4bd7-a5b4-66995a38a97a None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:17:00.025454 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780dad7-71f0-4bd7-a5b4-66995a38a97a None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:17:00.025454 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780dad7-71f0-4bd7-a5b4-66995a38a97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:17:00.043418 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-8780dad7-71f0-4bd7-a5b4-66995a38a97a None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:17:00.044618 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-8780dad7-71f0-4bd7-a5b4-66995a38a97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:17:00.052868 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 762/1522] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:17:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:17:00.057313 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe07a8b-264d-45cf-8c45-b827b47b20ea None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:17:00.067239 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe07a8b-264d-45cf-8c45-b827b47b20ea None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:17:00.073176 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e44fa-9582-472d-8f94-e99189e14981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:17:00.073738 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e44fa-9582-472d-8f94-e99189e14981 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:17:00.074018 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e44fa-9582-472d-8f94-e99189e14981 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:17:00.074290 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e44fa-9582-472d-8f94-e99189e14981 admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:17:00.075067 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e44fa-9582-472d-8f94-e99189e14981 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:17:00.075376 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e44fa-9582-472d-8f94-e99189e14981 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:17:00.076966 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e44fa-9582-472d-8f94-e99189e14981 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:17:00.089332 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 761/1523] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:17:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:17:00.097624 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780dad7-71f0-4bd7-a5b4-66995a38a97a None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:17:00.110485 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780dad7-71f0-4bd7-a5b4-66995a38a97a None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:17:00.115465 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6746e0d-9f35-4258-9c59-1d8c99c03d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:17:00.116120 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6746e0d-9f35-4258-9c59-1d8c99c03d1b admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:17:00.116395 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6746e0d-9f35-4258-9c59-1d8c99c03d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:17:00.116664 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6746e0d-9f35-4258-9c59-1d8c99c03d1b admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:17:00.117353 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6746e0d-9f35-4258-9c59-1d8c99c03d1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:17:00.119271 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6746e0d-9f35-4258-9c59-1d8c99c03d1b admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:17:00.158718 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 763/1524] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:17:00 2021] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 29 20:17:00.163638 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e44fa-9582-472d-8f94-e99189e14981 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:17:00.176848 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e44fa-9582-472d-8f94-e99189e14981 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:17:00.235739 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7d6cb-6404-4235-8030-6c1210f66533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:17:00.236401 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7d6cb-6404-4235-8030-6c1210f66533 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:17:00.236687 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7d6cb-6404-4235-8030-6c1210f66533 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:17:00.236963 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7d6cb-6404-4235-8030-6c1210f66533 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:17:00.237659 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7d6cb-6404-4235-8030-6c1210f66533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:17:00.239613 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7d6cb-6404-4235-8030-6c1210f66533 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:17:00.260459 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 762/1525] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:17:00 2021] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:17:00.264753 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6746e0d-9f35-4258-9c59-1d8c99c03d1b admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:17:00.275206 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6746e0d-9f35-4258-9c59-1d8c99c03d1b admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:17:00.280128 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87272a-4bb2-405d-9106-f0c3c6eb1b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:17:00.280792 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87272a-4bb2-405d-9106-f0c3c6eb1b39 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:17:00.281084 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87272a-4bb2-405d-9106-f0c3c6eb1b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:17:00.281377 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87272a-4bb2-405d-9106-f0c3c6eb1b39 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:17:00.282111 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f87272a-4bb2-405d-9106-f0c3c6eb1b39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:17:00.283748 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f87272a-4bb2-405d-9106-f0c3c6eb1b39 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:17:00.296072 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 764/1526] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:17:00 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:17:00.300110 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7d6cb-6404-4235-8030-6c1210f66533 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:17:00.310887 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7d6cb-6404-4235-8030-6c1210f66533 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:17:00.316622 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d20b4e-d493-4e03-becb-4287e519a7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:17:00.317252 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d20b4e-d493-4e03-becb-4287e519a7be admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:17:00.317529 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d20b4e-d493-4e03-becb-4287e519a7be admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:17:00.317822 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d20b4e-d493-4e03-becb-4287e519a7be admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:17:00.318552 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d20b4e-d493-4e03-becb-4287e519a7be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:17:00.320185 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d20b4e-d493-4e03-becb-4287e519a7be admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:17:00.334347 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 763/1527] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:17:00 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:17:00.338689 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87272a-4bb2-405d-9106-f0c3c6eb1b39 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:17:00.348753 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87272a-4bb2-405d-9106-f0c3c6eb1b39 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:17:00.354505 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb4eec-2743-4149-9162-dc71fbf17ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:17:00.355412 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb4eec-2743-4149-9162-dc71fbf17ddf admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:17:00.355694 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb4eec-2743-4149-9162-dc71fbf17ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:17:00.355970 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb4eec-2743-4149-9162-dc71fbf17ddf admin admin] PATH_INFO: `/v3/projects/c195bb7f7cee489786b2751fb76567ce/users/242bd7731d1d411db34aea02cda1e318/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:17:00.371180 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cb4eec-2743-4149-9162-dc71fbf17ddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c195bb7f7cee489786b2751fb76567ce, user_id=242bd7731d1d411db34aea02cda1e318, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:17:00.373873 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cb4eec-2743-4149-9162-dc71fbf17ddf admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:17:00.388648 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 765/1528] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:17:00 2021] PUT /identity/v3/projects/c195bb7f7cee489786b2751fb76567ce/users/242bd7731d1d411db34aea02cda1e318/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:17:00.400314 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490d66d-f8ca-4e90-b947-fc6fe664eca7 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:17:00.400599 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490d66d-f8ca-4e90-b947-fc6fe664eca7 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:17:00.400876 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490d66d-f8ca-4e90-b947-fc6fe664eca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:17:00.427539 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-f490d66d-f8ca-4e90-b947-fc6fe664eca7 None None] MFA Rules not processed for user `242bd7731d1d411db34aea02cda1e318`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:17:00.428942 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-f490d66d-f8ca-4e90-b947-fc6fe664eca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:17:00.490914 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 764/1529] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:17:00 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:17:00.504426 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb4eec-2743-4149-9162-dc71fbf17ddf admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:17:00.582992 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb4eec-2743-4149-9162-dc71fbf17ddf admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:17:00.592968 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce974f-9fe1-42d2-bce9-10a9ff1431ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:17:00.593879 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce974f-9fe1-42d2-bce9-10a9ff1431ec service nova] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:17:00.594200 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce974f-9fe1-42d2-bce9-10a9ff1431ec service nova] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:17:00.594466 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce974f-9fe1-42d2-bce9-10a9ff1431ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:17:00.602778 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ce974f-9fe1-42d2-bce9-10a9ff1431ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:17:00.604416 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ce974f-9fe1-42d2-bce9-10a9ff1431ec service nova] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:17:00.612966 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 766/1530] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:17:00 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:17:00.690067 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9992b-f38b-4371-b41b-0af8890093bd None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:17:00.690357 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9992b-f38b-4371-b41b-0af8890093bd None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:17:00.690633 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb9992b-f38b-4371-b41b-0af8890093bd None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:17:00.692389 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 765/1531] 10.222.0.15 () {52 vars in 829 bytes} [Mon Nov 29 20:17:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:17:00.696353 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce974f-9fe1-42d2-bce9-10a9ff1431ec service nova] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:17:00.759184 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce974f-9fe1-42d2-bce9-10a9ff1431ec service nova] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:17:00.764897 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a1039-69f2-432f-820b-55b538def9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:17:00.765762 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a1039-69f2-432f-820b-55b538def9c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:17:00.766046 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a1039-69f2-432f-820b-55b538def9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:17:00.766322 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a1039-69f2-432f-820b-55b538def9c8 admin admin] PATH_INFO: `/v3/users/242bd7731d1d411db34aea02cda1e318` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:17:00.767763 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a1039-69f2-432f-820b-55b538def9c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=242bd7731d1d411db34aea02cda1e318)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:17:00.768798 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING py.warnings [None req-862a1039-69f2-432f-820b-55b538def9c8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 29 20:17:00.768798 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: warnings.warn(msg) Nov 29 20:17:00.768798 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: Nov 29 20:17:00.770385 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a1039-69f2-432f-820b-55b538def9c8 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:17:00.838827 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-862a1039-69f2-432f-820b-55b538def9c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '242bd7731d1d411db34aea02cda1e318'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:17:00.852081 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-862a1039-69f2-432f-820b-55b538def9c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '242bd7731d1d411db34aea02cda1e318'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:17:00.873687 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-862a1039-69f2-432f-820b-55b538def9c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '242bd7731d1d411db34aea02cda1e318'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:17:00.874810 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-862a1039-69f2-432f-820b-55b538def9c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '242bd7731d1d411db34aea02cda1e318'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:17:00.876198 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-862a1039-69f2-432f-820b-55b538def9c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '242bd7731d1d411db34aea02cda1e318'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:17:00.895375 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 767/1532] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:17:00 2021] DELETE /identity/v3/users/242bd7731d1d411db34aea02cda1e318 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:17:00.899957 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762f8b3-e35d-4592-a8e2-a389e992001b None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:17:00.900246 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762f8b3-e35d-4592-a8e2-a389e992001b None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:17:00.900551 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762f8b3-e35d-4592-a8e2-a389e992001b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:17:00.917729 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-5762f8b3-e35d-4592-a8e2-a389e992001b None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:17:00.918951 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-5762f8b3-e35d-4592-a8e2-a389e992001b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:17:00.982961 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 766/1533] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:17:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:17:00.993806 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a1039-69f2-432f-820b-55b538def9c8 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:17:00.995502 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-862a1039-69f2-432f-820b-55b538def9c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:17:01.055656 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a1039-69f2-432f-820b-55b538def9c8 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:17:01.059839 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb785a77-40ac-4d22-87eb-f9260ab7f849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:17:01.060470 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb785a77-40ac-4d22-87eb-f9260ab7f849 service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:17:01.060745 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb785a77-40ac-4d22-87eb-f9260ab7f849 service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:17:01.061018 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb785a77-40ac-4d22-87eb-f9260ab7f849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:17:01.070365 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb785a77-40ac-4d22-87eb-f9260ab7f849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:17:01.071819 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb785a77-40ac-4d22-87eb-f9260ab7f849 service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:17:01.081099 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 768/1534] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:17:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:17:01.419686 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762f8b3-e35d-4592-a8e2-a389e992001b None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:17:01.421130 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-5762f8b3-e35d-4592-a8e2-a389e992001b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:17:01.440800 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762f8b3-e35d-4592-a8e2-a389e992001b None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:17:01.447331 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f6047-0d62-4c1f-bea8-f071ac181dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:17:01.448240 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f6047-0d62-4c1f-bea8-f071ac181dcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:17:01.448469 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f6047-0d62-4c1f-bea8-f071ac181dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:17:01.448721 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f6047-0d62-4c1f-bea8-f071ac181dcd admin admin] PATH_INFO: `/v3/projects/c195bb7f7cee489786b2751fb76567ce` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:17:01.450016 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f6047-0d62-4c1f-bea8-f071ac181dcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c195bb7f7cee489786b2751fb76567ce)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:17:01.451164 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING py.warnings [None req-f73f6047-0d62-4c1f-bea8-f071ac181dcd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 29 20:17:01.451164 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: warnings.warn(msg) Nov 29 20:17:01.451164 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: Nov 29 20:17:01.452269 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f6047-0d62-4c1f-bea8-f071ac181dcd admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:17:01.513091 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-f73f6047-0d62-4c1f-bea8-f071ac181dcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c195bb7f7cee489786b2751fb76567ce', 'request_id': 'req-f73f6047-0d62-4c1f-bea8-f071ac181dcd'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:17:01.526707 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-f73f6047-0d62-4c1f-bea8-f071ac181dcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c195bb7f7cee489786b2751fb76567ce', 'request_id': 'req-f73f6047-0d62-4c1f-bea8-f071ac181dcd'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:17:01.537908 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-f73f6047-0d62-4c1f-bea8-f071ac181dcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c195bb7f7cee489786b2751fb76567ce', 'request_id': 'req-f73f6047-0d62-4c1f-bea8-f071ac181dcd'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:17:01.554695 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-f73f6047-0d62-4c1f-bea8-f071ac181dcd admin admin] The token cache is being invalidate because project c195bb7f7cee489786b2751fb76567ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:17:01.555084 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-f73f6047-0d62-4c1f-bea8-f071ac181dcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:17:01.556294 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-f73f6047-0d62-4c1f-bea8-f071ac181dcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:17:01.558730 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 767/1535] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:17:01 2021] DELETE /identity/v3/projects/c195bb7f7cee489786b2751fb76567ce => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:18:30.217900 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be4ee6-37d4-46eb-badf-3a6bde8d9cc7 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:18:30.218840 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be4ee6-37d4-46eb-badf-3a6bde8d9cc7 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:18:30.218840 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be4ee6-37d4-46eb-badf-3a6bde8d9cc7 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:18:30.221736 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 769/1536] 127.0.0.1 () {54 vars in 901 bytes} [Mon Nov 29 20:18:30 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:18:30.227355 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04469bee-d14b-4d6b-87c5-c4f71a0e3de3 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:18:30.227842 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04469bee-d14b-4d6b-87c5-c4f71a0e3de3 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:18:30.227947 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04469bee-d14b-4d6b-87c5-c4f71a0e3de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:18:30.246689 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-04469bee-d14b-4d6b-87c5-c4f71a0e3de3 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:18:30.247944 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-04469bee-d14b-4d6b-87c5-c4f71a0e3de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:18:30.315799 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 768/1537] 127.0.0.1 () {58 vars in 998 bytes} [Mon Nov 29 20:18:30 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:18:30.472606 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be4ee6-37d4-46eb-badf-3a6bde8d9cc7 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:18:30.474718 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-91be4ee6-37d4-46eb-badf-3a6bde8d9cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:18:30.555789 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be4ee6-37d4-46eb-badf-3a6bde8d9cc7 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:18:30.564101 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a3d78b-e6e6-4dd5-98eb-d75f94ff0123 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:18:30.564755 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3d78b-e6e6-4dd5-98eb-d75f94ff0123 service nova] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:18:30.565032 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3d78b-e6e6-4dd5-98eb-d75f94ff0123 service nova] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:18:30.565305 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a3d78b-e6e6-4dd5-98eb-d75f94ff0123 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:18:30.574637 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a3d78b-e6e6-4dd5-98eb-d75f94ff0123 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:18:30.576869 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a3d78b-e6e6-4dd5-98eb-d75f94ff0123 service nova] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:18:30.588172 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 770/1538] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:18:30 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:18:30.931036 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c14635-7650-4dcf-be7b-75f576406698 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:18:30.931302 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c14635-7650-4dcf-be7b-75f576406698 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:18:30.931598 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c14635-7650-4dcf-be7b-75f576406698 None None] PATH_INFO: `/v3` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:18:30.933101 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 769/1539] 10.222.0.58 () {54 vars in 925 bytes} [Mon Nov 29 20:18:30 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:18:30.942398 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26d1ca-efd4-4a06-98f4-f2c965cf71fc None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:18:30.942860 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26d1ca-efd4-4a06-98f4-f2c965cf71fc None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:18:30.943143 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26d1ca-efd4-4a06-98f4-f2c965cf71fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:18:30.962378 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-3b26d1ca-efd4-4a06-98f4-f2c965cf71fc None None] MFA Rules not processed for user `b954c18d7e9349e899f4c1cd42b89166`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:18:30.963729 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-3b26d1ca-efd4-4a06-98f4-f2c965cf71fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:18:31.029778 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 771/1540] 10.222.0.58 () {58 vars in 1015 bytes} [Mon Nov 29 20:18:30 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:18:32.103444 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcae7c-2789-40c5-9a86-de439e2c2cb1 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:18:32.104094 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcae7c-2789-40c5-9a86-de439e2c2cb1 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:18:32.104094 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fcae7c-2789-40c5-9a86-de439e2c2cb1 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:18:32.106224 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 770/1541] 127.0.0.1 () {54 vars in 901 bytes} [Mon Nov 29 20:18:32 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:18:32.113033 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbdde7-6c8d-49f2-9bde-c0dd0be75b81 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:18:32.113470 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbdde7-6c8d-49f2-9bde-c0dd0be75b81 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:18:32.113565 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dbdde7-6c8d-49f2-9bde-c0dd0be75b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:18:32.132582 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-00dbdde7-6c8d-49f2-9bde-c0dd0be75b81 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:18:32.133783 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-00dbdde7-6c8d-49f2-9bde-c0dd0be75b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:18:32.142588 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 772/1542] 127.0.0.1 () {58 vars in 998 bytes} [Mon Nov 29 20:18:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:18:32.299230 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fcae7c-2789-40c5-9a86-de439e2c2cb1 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:18:32.315153 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fcae7c-2789-40c5-9a86-de439e2c2cb1 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:18:32.320906 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd96a35a-5adb-4f48-8c4d-b35ba051735c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:18:32.321535 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96a35a-5adb-4f48-8c4d-b35ba051735c service nova] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:18:32.321812 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96a35a-5adb-4f48-8c4d-b35ba051735c service nova] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:18:32.322083 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96a35a-5adb-4f48-8c4d-b35ba051735c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:18:32.330137 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd96a35a-5adb-4f48-8c4d-b35ba051735c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:18:32.331780 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd96a35a-5adb-4f48-8c4d-b35ba051735c service nova] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:18:32.340988 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 771/1543] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:18:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:18:34.800166 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc037010-2a89-4b5a-9dec-4f158f861f0f None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:18:34.800690 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc037010-2a89-4b5a-9dec-4f158f861f0f None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:18:34.800690 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc037010-2a89-4b5a-9dec-4f158f861f0f None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:18:34.802489 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 773/1544] 10.222.0.15 () {54 vars in 960 bytes} [Mon Nov 29 20:18:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:18:34.808171 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af76011-29c5-40a8-8f92-97537f5ec18e None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:18:34.808632 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af76011-29c5-40a8-8f92-97537f5ec18e None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:18:34.808737 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af76011-29c5-40a8-8f92-97537f5ec18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:18:34.828357 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-6af76011-29c5-40a8-8f92-97537f5ec18e None None] MFA Rules not processed for user `b954c18d7e9349e899f4c1cd42b89166`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:18:34.829626 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-6af76011-29c5-40a8-8f92-97537f5ec18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:18:34.839975 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 772/1545] 10.222.0.15 () {58 vars in 1057 bytes} [Mon Nov 29 20:18:34 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:18:34.848063 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc037010-2a89-4b5a-9dec-4f158f861f0f None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:18:34.863900 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc037010-2a89-4b5a-9dec-4f158f861f0f None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:18:34.869201 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e185b0-c8ea-4c50-9ca7-40ee79b07523 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b954c18d7e9349e899f4c1cd42b89166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:18:34.869834 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e185b0-c8ea-4c50-9ca7-40ee79b07523 service placement] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:18:34.870111 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e185b0-c8ea-4c50-9ca7-40ee79b07523 service placement] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:18:34.870380 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e185b0-c8ea-4c50-9ca7-40ee79b07523 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:18:34.878364 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e185b0-c8ea-4c50-9ca7-40ee79b07523 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:18:34.879961 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e185b0-c8ea-4c50-9ca7-40ee79b07523 service placement] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:18:34.889308 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 774/1546] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:18:34 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:18:44.254302 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f51b8-38e2-4164-9857-cba86173790a None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:18:44.254895 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f51b8-38e2-4164-9857-cba86173790a None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:18:44.254895 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f51b8-38e2-4164-9857-cba86173790a None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:18:44.256689 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 773/1547] 127.0.0.1 () {54 vars in 901 bytes} [Mon Nov 29 20:18:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:18:44.262796 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f231d44-5a7b-448a-9c91-dc76d38b9330 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:18:44.263285 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f231d44-5a7b-448a-9c91-dc76d38b9330 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:18:44.263379 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f231d44-5a7b-448a-9c91-dc76d38b9330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:18:44.287439 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-3f231d44-5a7b-448a-9c91-dc76d38b9330 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:18:44.288684 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-3f231d44-5a7b-448a-9c91-dc76d38b9330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:18:44.298119 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 775/1548] 127.0.0.1 () {58 vars in 998 bytes} [Mon Nov 29 20:18:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:18:44.454744 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f51b8-38e2-4164-9857-cba86173790a None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:18:44.470991 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f51b8-38e2-4164-9857-cba86173790a None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:18:44.477786 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c059f-0499-4768-a53b-92e12b7f9ff0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:18:44.478436 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c059f-0499-4768-a53b-92e12b7f9ff0 service nova] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:18:44.478729 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c059f-0499-4768-a53b-92e12b7f9ff0 service nova] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:18:44.479015 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c059f-0499-4768-a53b-92e12b7f9ff0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:18:44.488040 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c059f-0499-4768-a53b-92e12b7f9ff0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:18:44.489631 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c059f-0499-4768-a53b-92e12b7f9ff0 service nova] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:18:44.498822 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 774/1549] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:18:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:18:46.005138 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76925ac6-ae14-4416-929d-f30900ce079a None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:18:46.005727 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76925ac6-ae14-4416-929d-f30900ce079a None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:18:46.005727 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76925ac6-ae14-4416-929d-f30900ce079a None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:18:46.007545 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 776/1550] 127.0.0.1 () {54 vars in 901 bytes} [Mon Nov 29 20:18:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:18:46.013677 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df063a8-f135-496a-a294-ec4f6847b0dc None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:18:46.014145 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df063a8-f135-496a-a294-ec4f6847b0dc None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:18:46.014251 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df063a8-f135-496a-a294-ec4f6847b0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:18:46.035712 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-5df063a8-f135-496a-a294-ec4f6847b0dc None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:18:46.036910 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-5df063a8-f135-496a-a294-ec4f6847b0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:18:46.046153 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 775/1551] 127.0.0.1 () {58 vars in 998 bytes} [Mon Nov 29 20:18:46 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:18:46.213995 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76925ac6-ae14-4416-929d-f30900ce079a None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:18:46.230799 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76925ac6-ae14-4416-929d-f30900ce079a None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:18:46.237339 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1aec4a-07f2-442c-9b74-ae19da4bc2d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:18:46.237967 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1aec4a-07f2-442c-9b74-ae19da4bc2d1 service nova] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:18:46.238242 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1aec4a-07f2-442c-9b74-ae19da4bc2d1 service nova] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:18:46.238507 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1aec4a-07f2-442c-9b74-ae19da4bc2d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:18:46.246866 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1aec4a-07f2-442c-9b74-ae19da4bc2d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:18:46.248461 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1aec4a-07f2-442c-9b74-ae19da4bc2d1 service nova] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:18:46.257905 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 777/1552] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:18:46 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:18:50.987441 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5eafd1-995a-4db3-be25-5857f655957d None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:18:50.988071 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5eafd1-995a-4db3-be25-5857f655957d None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:18:50.988071 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5eafd1-995a-4db3-be25-5857f655957d None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:18:50.989795 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 776/1553] 127.0.0.1 () {54 vars in 916 bytes} [Mon Nov 29 20:18:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:18:50.996726 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed7302-5fa2-4390-bc93-b5d51236665c None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:18:50.997248 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed7302-5fa2-4390-bc93-b5d51236665c None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:18:50.997347 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed7302-5fa2-4390-bc93-b5d51236665c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:18:51.016796 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-5aed7302-5fa2-4390-bc93-b5d51236665c None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:18:51.018017 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-5aed7302-5fa2-4390-bc93-b5d51236665c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:18:51.026908 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 778/1554] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Nov 29 20:18:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:18:51.069545 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5eafd1-995a-4db3-be25-5857f655957d None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:18:51.071965 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-0f5eafd1-995a-4db3-be25-5857f655957d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:18:51.139529 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5eafd1-995a-4db3-be25-5857f655957d None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:18:51.143111 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ad611-5ddd-4d50-ad28-0e47fecf216b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:18:51.143763 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ad611-5ddd-4d50-ad28-0e47fecf216b service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:18:51.144025 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ad611-5ddd-4d50-ad28-0e47fecf216b service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:18:51.144299 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ad611-5ddd-4d50-ad28-0e47fecf216b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:18:51.153637 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ad611-5ddd-4d50-ad28-0e47fecf216b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:18:51.155101 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ad611-5ddd-4d50-ad28-0e47fecf216b service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:18:51.164388 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 777/1555] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:18:51 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:18:53.445612 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a0210-69c1-438f-bde8-33fb138ad27c None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:18:53.446527 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a0210-69c1-438f-bde8-33fb138ad27c None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:18:53.446527 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a0210-69c1-438f-bde8-33fb138ad27c None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:18:53.449469 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 779/1556] 127.0.0.1 () {54 vars in 916 bytes} [Mon Nov 29 20:18:53 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:18:53.455484 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051ed18-3d6b-41a4-8028-004cda300328 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:18:53.455930 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051ed18-3d6b-41a4-8028-004cda300328 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:18:53.456036 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051ed18-3d6b-41a4-8028-004cda300328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:18:53.474220 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-f051ed18-3d6b-41a4-8028-004cda300328 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:18:53.475425 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-f051ed18-3d6b-41a4-8028-004cda300328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:18:53.483687 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 778/1557] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Nov 29 20:18:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:18:53.524548 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a0210-69c1-438f-bde8-33fb138ad27c None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:18:53.542330 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a0210-69c1-438f-bde8-33fb138ad27c None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:18:53.546824 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d565e31e-87b9-427c-9309-5cd4964ef957 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:18:53.547489 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565e31e-87b9-427c-9309-5cd4964ef957 service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:18:53.547773 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565e31e-87b9-427c-9309-5cd4964ef957 service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:18:53.548049 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565e31e-87b9-427c-9309-5cd4964ef957 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:18:53.557293 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d565e31e-87b9-427c-9309-5cd4964ef957 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:18:53.558693 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d565e31e-87b9-427c-9309-5cd4964ef957 service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:18:53.568183 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 780/1558] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:18:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:18:57.750475 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a5581-bd01-4682-ae1a-b9264b4f2ca3 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:18:57.751491 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a5581-bd01-4682-ae1a-b9264b4f2ca3 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:18:57.751491 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a5581-bd01-4682-ae1a-b9264b4f2ca3 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:18:57.754156 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 779/1559] 127.0.0.1 () {54 vars in 916 bytes} [Mon Nov 29 20:18:57 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:18:57.763822 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923321ac-f8dd-4d82-be24-7d82f8b8c27c None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:18:57.764253 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923321ac-f8dd-4d82-be24-7d82f8b8c27c None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:18:57.764384 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923321ac-f8dd-4d82-be24-7d82f8b8c27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:18:57.788734 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-923321ac-f8dd-4d82-be24-7d82f8b8c27c None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:18:57.789948 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-923321ac-f8dd-4d82-be24-7d82f8b8c27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:18:57.798295 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 781/1560] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Nov 29 20:18:57 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:18:57.858264 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a5581-bd01-4682-ae1a-b9264b4f2ca3 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:18:57.860100 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-ab6a5581-bd01-4682-ae1a-b9264b4f2ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:18:57.916080 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a5581-bd01-4682-ae1a-b9264b4f2ca3 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:18:57.920309 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca400fdf-f528-4e0e-8c4f-b2b27ec38cad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:18:57.920964 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca400fdf-f528-4e0e-8c4f-b2b27ec38cad service cinder] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:18:57.921247 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca400fdf-f528-4e0e-8c4f-b2b27ec38cad service cinder] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:18:57.921520 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca400fdf-f528-4e0e-8c4f-b2b27ec38cad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:18:57.931427 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca400fdf-f528-4e0e-8c4f-b2b27ec38cad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:18:57.932868 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca400fdf-f528-4e0e-8c4f-b2b27ec38cad service cinder] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:18:57.942517 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 780/1561] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:18:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:19:00.286084 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b135d-6c9a-4d48-bae6-e31e0960ab58 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:19:00.286705 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b135d-6c9a-4d48-bae6-e31e0960ab58 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:19:00.286705 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b135d-6c9a-4d48-bae6-e31e0960ab58 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:19:00.288449 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 782/1562] 127.0.0.1 () {54 vars in 916 bytes} [Mon Nov 29 20:19:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:19:00.295500 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd47547-d4cc-4bdf-8b64-f5601605a4e1 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:19:00.296250 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd47547-d4cc-4bdf-8b64-f5601605a4e1 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:19:00.296454 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd47547-d4cc-4bdf-8b64-f5601605a4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:19:00.326573 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-3dd47547-d4cc-4bdf-8b64-f5601605a4e1 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:19:00.327807 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-3dd47547-d4cc-4bdf-8b64-f5601605a4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:19:00.337248 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 781/1563] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Nov 29 20:19:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:19:00.388113 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50428d-d820-4484-bff9-d5eaa8a8eca3 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:19:00.388376 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50428d-d820-4484-bff9-d5eaa8a8eca3 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:19:00.388760 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50428d-d820-4484-bff9-d5eaa8a8eca3 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:19:00.391517 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 783/1564] 10.222.0.15 () {54 vars in 963 bytes} [Mon Nov 29 20:19:00 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:19:00.400355 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c4be5-e144-40cc-8c5b-9f2517ffe1d5 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:19:00.400728 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c4be5-e144-40cc-8c5b-9f2517ffe1d5 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:19:00.401127 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c4be5-e144-40cc-8c5b-9f2517ffe1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:19:00.428578 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-0c7c4be5-e144-40cc-8c5b-9f2517ffe1d5 None None] MFA Rules not processed for user `9508e6f2ac414098872e2584f1ed7393`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:19:00.429793 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-0c7c4be5-e144-40cc-8c5b-9f2517ffe1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:19:00.437749 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 782/1565] 10.222.0.15 () {58 vars in 1060 bytes} [Mon Nov 29 20:19:00 2021] POST /identity/v3/auth/tokens => generated 3110 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:19:00.445810 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50428d-d820-4484-bff9-d5eaa8a8eca3 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:19:00.458149 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b50428d-d820-4484-bff9-d5eaa8a8eca3 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:19:00.462560 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2dc7ab-0452-45f3-bec9-54476f564d49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:19:00.463225 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2dc7ab-0452-45f3-bec9-54476f564d49 service cinder] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:19:00.463503 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2dc7ab-0452-45f3-bec9-54476f564d49 service cinder] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:19:00.463774 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2dc7ab-0452-45f3-bec9-54476f564d49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:19:00.473702 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2dc7ab-0452-45f3-bec9-54476f564d49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:19:00.475155 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2dc7ab-0452-45f3-bec9-54476f564d49 service cinder] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:19:00.486231 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 784/1566] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:19:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:20:22.180071 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2994a-35f1-4a84-b143-91b1009e583e None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:22.183569 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2994a-35f1-4a84-b143-91b1009e583e None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:22.183569 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2994a-35f1-4a84-b143-91b1009e583e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:22.207485 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-58d2994a-35f1-4a84-b143-91b1009e583e None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:22.208703 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-58d2994a-35f1-4a84-b143-91b1009e583e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:22.223144 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 783/1567] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:22.233358 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e3c76-42fe-472a-9f65-de64bc31ab06 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:22.233968 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e3c76-42fe-472a-9f65-de64bc31ab06 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:22.233968 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e3c76-42fe-472a-9f65-de64bc31ab06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:22.257035 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-938e3c76-42fe-472a-9f65-de64bc31ab06 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:22.259194 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-938e3c76-42fe-472a-9f65-de64bc31ab06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:22.274132 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 785/1568] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:22.279616 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2994a-35f1-4a84-b143-91b1009e583e None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:22.292340 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2994a-35f1-4a84-b143-91b1009e583e None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:22.298907 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe013b3c-d02d-40fd-9747-5cc9fab2e5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:22.299792 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe013b3c-d02d-40fd-9747-5cc9fab2e5f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:22.300076 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe013b3c-d02d-40fd-9747-5cc9fab2e5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:22.300356 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe013b3c-d02d-40fd-9747-5cc9fab2e5f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:22.301101 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe013b3c-d02d-40fd-9747-5cc9fab2e5f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:20:22.301408 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe013b3c-d02d-40fd-9747-5cc9fab2e5f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:22.303065 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe013b3c-d02d-40fd-9747-5cc9fab2e5f8 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:22.315723 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 784/1569] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:20:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:20:22.324204 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e3c76-42fe-472a-9f65-de64bc31ab06 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:22.333890 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e3c76-42fe-472a-9f65-de64bc31ab06 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:22.343177 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd8534-0088-4c06-893c-2258b60be34c None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:22.343544 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd8534-0088-4c06-893c-2258b60be34c None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:22.343831 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd8534-0088-4c06-893c-2258b60be34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:22.348171 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f1891-cc3d-4f68-8601-04a4612ce307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:22.348852 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f1891-cc3d-4f68-8601-04a4612ce307 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:22.351385 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f1891-cc3d-4f68-8601-04a4612ce307 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:22.351670 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f1891-cc3d-4f68-8601-04a4612ce307 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:22.352394 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f1891-cc3d-4f68-8601-04a4612ce307 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:22.354335 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f1891-cc3d-4f68-8601-04a4612ce307 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:22.375489 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-b5dd8534-0088-4c06-893c-2258b60be34c None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:22.385836 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-b5dd8534-0088-4c06-893c-2258b60be34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:22.396409 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 785/1570] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:20:22.402045 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6882d-55ed-47ad-b312-081189d19f0e None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:22.405775 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6882d-55ed-47ad-b312-081189d19f0e None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:22.412078 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 786/1571] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:20:22 2021] POST /identity/v3/projects => generated 377 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:20:22.413655 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6882d-55ed-47ad-b312-081189d19f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:22.416013 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe8f3b-28bd-42ba-b0f3-839d4ab2f7e3 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:22.416921 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe8f3b-28bd-42ba-b0f3-839d4ab2f7e3 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:22.418092 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe8f3b-28bd-42ba-b0f3-839d4ab2f7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:22.452558 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-30c6882d-55ed-47ad-b312-081189d19f0e None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:22.454094 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-30c6882d-55ed-47ad-b312-081189d19f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:22.458382 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-41fe8f3b-28bd-42ba-b0f3-839d4ab2f7e3 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:22.459776 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-41fe8f3b-28bd-42ba-b0f3-839d4ab2f7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:22.537049 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 787/1572] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:22.542357 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe8f3b-28bd-42ba-b0f3-839d4ab2f7e3 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:22.555544 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe8f3b-28bd-42ba-b0f3-839d4ab2f7e3 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:22.565117 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 786/1573] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:22.566448 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143398a4-d6a0-4f18-b32b-516164833c51 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:22.568820 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143398a4-d6a0-4f18-b32b-516164833c51 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:22.569119 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143398a4-d6a0-4f18-b32b-516164833c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:22.570982 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81326d4-7f38-4195-a419-e6f09b29e93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:22.571663 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81326d4-7f38-4195-a419-e6f09b29e93a admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:22.571943 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81326d4-7f38-4195-a419-e6f09b29e93a admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:22.572217 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81326d4-7f38-4195-a419-e6f09b29e93a admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:22.573294 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81326d4-7f38-4195-a419-e6f09b29e93a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:22.575284 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81326d4-7f38-4195-a419-e6f09b29e93a admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:22.607780 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 788/1574] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:20:22 2021] POST /identity/v3/users => generated 289 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:20:22.608969 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74506b8b-06ef-429b-821b-3c34fa245ef1 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:22.609334 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74506b8b-06ef-429b-821b-3c34fa245ef1 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:22.609613 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74506b8b-06ef-429b-821b-3c34fa245ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:22.610517 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-143398a4-d6a0-4f18-b32b-516164833c51 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:22.612025 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-143398a4-d6a0-4f18-b32b-516164833c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:22.620694 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 787/1575] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:22.621592 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143398a4-d6a0-4f18-b32b-516164833c51 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:22.629294 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-74506b8b-06ef-429b-821b-3c34fa245ef1 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:22.630588 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-74506b8b-06ef-429b-821b-3c34fa245ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:22.631256 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143398a4-d6a0-4f18-b32b-516164833c51 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:22.636140 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e0d65-619a-4663-bdca-a3a6cf68dccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:22.636914 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e0d65-619a-4663-bdca-a3a6cf68dccb admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:22.637289 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e0d65-619a-4663-bdca-a3a6cf68dccb admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:22.638218 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e0d65-619a-4663-bdca-a3a6cf68dccb admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:22.639043 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e0d65-619a-4663-bdca-a3a6cf68dccb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:20:22.639498 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 789/1576] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:22.639711 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e0d65-619a-4663-bdca-a3a6cf68dccb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:22.640556 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f972c-3cbc-4225-8fe7-3a4e5609a05f None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:22.640842 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f972c-3cbc-4225-8fe7-3a4e5609a05f None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:22.643607 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e0d65-619a-4663-bdca-a3a6cf68dccb admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:22.643735 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33f972c-3cbc-4225-8fe7-3a4e5609a05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:22.653843 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 788/1577] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:20:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:20:22.655435 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f9772-71a8-41df-a68f-364b8bdd2c7c None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:22.655788 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f9772-71a8-41df-a68f-364b8bdd2c7c None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:22.656179 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f9772-71a8-41df-a68f-364b8bdd2c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:22.666675 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-d33f972c-3cbc-4225-8fe7-3a4e5609a05f None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:22.668136 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-d33f972c-3cbc-4225-8fe7-3a4e5609a05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:22.674878 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-473f9772-71a8-41df-a68f-364b8bdd2c7c None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:22.676147 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-473f9772-71a8-41df-a68f-364b8bdd2c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:22.676900 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 790/1578] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:22.678065 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f972c-3cbc-4225-8fe7-3a4e5609a05f None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:22.693553 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 789/1579] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:22.693553 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19e24a-a521-4c8d-8c9b-f40095399757 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:22.693553 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19e24a-a521-4c8d-8c9b-f40095399757 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:22.693553 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19e24a-a521-4c8d-8c9b-f40095399757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:22.697577 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33f972c-3cbc-4225-8fe7-3a4e5609a05f None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:22.712411 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d123d980-e29b-4bb1-9f4a-888c422b23ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:22.712411 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123d980-e29b-4bb1-9f4a-888c422b23ef admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:22.713008 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123d980-e29b-4bb1-9f4a-888c422b23ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:22.713378 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123d980-e29b-4bb1-9f4a-888c422b23ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:22.714213 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d123d980-e29b-4bb1-9f4a-888c422b23ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:22.715926 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d123d980-e29b-4bb1-9f4a-888c422b23ef admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:22.719681 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-8e19e24a-a521-4c8d-8c9b-f40095399757 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:22.721137 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-8e19e24a-a521-4c8d-8c9b-f40095399757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:22.727141 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 791/1580] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:20:22 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:20:22.728287 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5192e9-db49-4ccf-8ea5-4222ef2ac13b None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:22.728592 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5192e9-db49-4ccf-8ea5-4222ef2ac13b None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:22.728851 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5192e9-db49-4ccf-8ea5-4222ef2ac13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:22.729573 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 790/1581] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:22.730445 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19e24a-a521-4c8d-8c9b-f40095399757 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:22.740170 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19e24a-a521-4c8d-8c9b-f40095399757 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:22.744581 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a4aafa-5707-4442-b46a-b9df576b7f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:22.745238 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4aafa-5707-4442-b46a-b9df576b7f4a admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:22.745508 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4aafa-5707-4442-b46a-b9df576b7f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:22.745838 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a4aafa-5707-4442-b46a-b9df576b7f4a admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:22.746457 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4aafa-5707-4442-b46a-b9df576b7f4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:22.746701 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-4a5192e9-db49-4ccf-8ea5-4222ef2ac13b None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:22.747932 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-4a5192e9-db49-4ccf-8ea5-4222ef2ac13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:22.748382 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a4aafa-5707-4442-b46a-b9df576b7f4a admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:22.755808 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 792/1582] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:22.756747 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5192e9-db49-4ccf-8ea5-4222ef2ac13b None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:22.766186 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5192e9-db49-4ccf-8ea5-4222ef2ac13b None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:22.771195 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd14ed-2548-4db3-9071-be30cbce7efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:22.771843 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd14ed-2548-4db3-9071-be30cbce7efd admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:22.772122 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd14ed-2548-4db3-9071-be30cbce7efd admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:22.772395 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd14ed-2548-4db3-9071-be30cbce7efd admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:22.773119 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdd14ed-2548-4db3-9071-be30cbce7efd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:20:22.773419 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdd14ed-2548-4db3-9071-be30cbce7efd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:22.777217 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 791/1583] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:20:22 2021] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:20:22.777378 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdd14ed-2548-4db3-9071-be30cbce7efd admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:22.777479 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c698e-eaca-4782-a11d-6bb1f0c83ec5 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:22.777479 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c698e-eaca-4782-a11d-6bb1f0c83ec5 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:22.777479 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c698e-eaca-4782-a11d-6bb1f0c83ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:22.796033 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 793/1584] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:20:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:20:22.796033 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1841f5a-0e2b-4c55-ae52-35955bb51447 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:22.796033 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1841f5a-0e2b-4c55-ae52-35955bb51447 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:22.796033 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1841f5a-0e2b-4c55-ae52-35955bb51447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:22.796556 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-926c698e-eaca-4782-a11d-6bb1f0c83ec5 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:22.796556 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-926c698e-eaca-4782-a11d-6bb1f0c83ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:22.812725 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-b1841f5a-0e2b-4c55-ae52-35955bb51447 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:22.812725 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-b1841f5a-0e2b-4c55-ae52-35955bb51447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:22.851625 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 792/1585] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:22.855301 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c698e-eaca-4782-a11d-6bb1f0c83ec5 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:22.861397 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c698e-eaca-4782-a11d-6bb1f0c83ec5 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:22.866733 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d77da-fdde-4140-a45a-1d76f4797f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:22.867418 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d77da-fdde-4140-a45a-1d76f4797f8b admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:22.867696 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d77da-fdde-4140-a45a-1d76f4797f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:22.867972 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d77da-fdde-4140-a45a-1d76f4797f8b admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:22.868700 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d77da-fdde-4140-a45a-1d76f4797f8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:22.868817 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 794/1586] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:22.869547 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1841f5a-0e2b-4c55-ae52-35955bb51447 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:22.872565 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d77da-fdde-4140-a45a-1d76f4797f8b admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:22.878614 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1841f5a-0e2b-4c55-ae52-35955bb51447 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:22.883285 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eef1bb-6b6d-448f-9228-f90315a190f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:22.883933 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eef1bb-6b6d-448f-9228-f90315a190f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:22.884185 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 793/1587] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:20:22 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:20:22.884322 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eef1bb-6b6d-448f-9228-f90315a190f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:22.885239 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eef1bb-6b6d-448f-9228-f90315a190f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:22.885474 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b418b-968e-45da-987b-8d82c3427472 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:22.885761 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b418b-968e-45da-987b-8d82c3427472 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:22.886254 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970b418b-968e-45da-987b-8d82c3427472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:22.886367 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eef1bb-6b6d-448f-9228-f90315a190f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:20:22.886723 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eef1bb-6b6d-448f-9228-f90315a190f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:22.888474 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eef1bb-6b6d-448f-9228-f90315a190f6 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:22.900406 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 795/1588] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:20:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:20:22.901276 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eef1bb-6b6d-448f-9228-f90315a190f6 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:22.904403 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-970b418b-968e-45da-987b-8d82c3427472 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:22.905669 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-970b418b-968e-45da-987b-8d82c3427472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:22.910743 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eef1bb-6b6d-448f-9228-f90315a190f6 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:22.913660 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 794/1589] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:22.914481 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b418b-968e-45da-987b-8d82c3427472 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:22.915506 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfc8a1-791a-48d0-82d0-9c2ee8442810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:22.916217 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfc8a1-791a-48d0-82d0-9c2ee8442810 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:22.916563 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfc8a1-791a-48d0-82d0-9c2ee8442810 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:22.916906 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adfc8a1-791a-48d0-82d0-9c2ee8442810 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:22.917701 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adfc8a1-791a-48d0-82d0-9c2ee8442810 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:20:22.918078 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adfc8a1-791a-48d0-82d0-9c2ee8442810 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:22.919764 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adfc8a1-791a-48d0-82d0-9c2ee8442810 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:22.924318 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970b418b-968e-45da-987b-8d82c3427472 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:22.928756 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e030f32-9da7-4fdd-bd30-d7e8cefce3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:22.929401 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e030f32-9da7-4fdd-bd30-d7e8cefce3fd admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:22.929683 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e030f32-9da7-4fdd-bd30-d7e8cefce3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:22.929958 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e030f32-9da7-4fdd-bd30-d7e8cefce3fd admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:22.930649 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e030f32-9da7-4fdd-bd30-d7e8cefce3fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:22.931487 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 796/1590] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:20:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:20:22.932316 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfc8a1-791a-48d0-82d0-9c2ee8442810 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:22.932582 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e030f32-9da7-4fdd-bd30-d7e8cefce3fd admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:22.941873 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adfc8a1-791a-48d0-82d0-9c2ee8442810 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:22.946821 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f2a88f-0e7f-44d5-a45b-070b9cb4d787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:22.947498 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2a88f-0e7f-44d5-a45b-070b9cb4d787 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:22.947782 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2a88f-0e7f-44d5-a45b-070b9cb4d787 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:22.948059 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2a88f-0e7f-44d5-a45b-070b9cb4d787 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:22.948751 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f2a88f-0e7f-44d5-a45b-070b9cb4d787 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:22.950627 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f2a88f-0e7f-44d5-a45b-070b9cb4d787 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:22.954927 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 795/1591] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:20:22 2021] POST /identity/v3/users => generated 288 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:20:22.955886 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e030f32-9da7-4fdd-bd30-d7e8cefce3fd admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:22.965345 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e030f32-9da7-4fdd-bd30-d7e8cefce3fd admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:22.970396 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551eb09c-23a5-4486-8d5c-754e47012daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:22.971078 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551eb09c-23a5-4486-8d5c-754e47012daa admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:22.971340 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551eb09c-23a5-4486-8d5c-754e47012daa admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:22.971606 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551eb09c-23a5-4486-8d5c-754e47012daa admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:22.972327 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551eb09c-23a5-4486-8d5c-754e47012daa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:20:22.972623 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551eb09c-23a5-4486-8d5c-754e47012daa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:22.974195 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551eb09c-23a5-4486-8d5c-754e47012daa admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:22.976921 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 797/1592] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:20:22 2021] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:20:22.978316 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545412c-4b04-4447-b48c-c850fce056f3 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:22.978606 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545412c-4b04-4447-b48c-c850fce056f3 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:22.979096 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c545412c-4b04-4447-b48c-c850fce056f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:22.988722 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 796/1593] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:20:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:20:22.989543 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551eb09c-23a5-4486-8d5c-754e47012daa admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:22.997727 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-c545412c-4b04-4447-b48c-c850fce056f3 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:22.999043 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-c545412c-4b04-4447-b48c-c850fce056f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:23.005166 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551eb09c-23a5-4486-8d5c-754e47012daa admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:23.058494 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 798/1594] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:23.062920 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545412c-4b04-4447-b48c-c850fce056f3 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:23.063049 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc29413-68ce-427e-b234-660f97a6030b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:23.063049 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc29413-68ce-427e-b234-660f97a6030b admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:23.063049 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc29413-68ce-427e-b234-660f97a6030b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:23.063049 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc29413-68ce-427e-b234-660f97a6030b admin admin] PATH_INFO: `/v3/projects/a94c1f8840c045649f25ec35f9d69558/users/b7b0ec8500024b14802bd38b95e822c8/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:23.068820 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c545412c-4b04-4447-b48c-c850fce056f3 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:23.073508 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3e953-5886-4946-a430-e2a47752ac9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:23.074174 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3e953-5886-4946-a430-e2a47752ac9b admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:23.074451 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3e953-5886-4946-a430-e2a47752ac9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:23.074720 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3e953-5886-4946-a430-e2a47752ac9b admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:23.075456 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff3e953-5886-4946-a430-e2a47752ac9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:23.075690 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc29413-68ce-427e-b234-660f97a6030b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a94c1f8840c045649f25ec35f9d69558, user_id=b7b0ec8500024b14802bd38b95e822c8, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:23.077378 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff3e953-5886-4946-a430-e2a47752ac9b admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:23.078424 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc29413-68ce-427e-b234-660f97a6030b admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:23.092889 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 797/1595] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:20:22 2021] PUT /identity/v3/projects/a94c1f8840c045649f25ec35f9d69558/users/b7b0ec8500024b14802bd38b95e822c8/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:23.094362 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde77171-0839-49d6-ad7a-e7a8f9e43740 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:23.094652 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde77171-0839-49d6-ad7a-e7a8f9e43740 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:23.095036 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde77171-0839-49d6-ad7a-e7a8f9e43740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:23.113328 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 799/1596] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:20:23 2021] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:20:23.113328 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3e953-5886-4946-a430-e2a47752ac9b admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:23.113619 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-bde77171-0839-49d6-ad7a-e7a8f9e43740 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:23.114585 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-bde77171-0839-49d6-ad7a-e7a8f9e43740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:23.169711 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 798/1597] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:23.170441 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde77171-0839-49d6-ad7a-e7a8f9e43740 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:23.172094 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3e953-5886-4946-a430-e2a47752ac9b admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:23.176736 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb8c558-4914-4c6e-a5f0-880f14287f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:23.177396 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8c558-4914-4c6e-a5f0-880f14287f68 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:23.177714 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8c558-4914-4c6e-a5f0-880f14287f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:23.177985 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8c558-4914-4c6e-a5f0-880f14287f68 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:23.178678 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb8c558-4914-4c6e-a5f0-880f14287f68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:23.179753 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde77171-0839-49d6-ad7a-e7a8f9e43740 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:23.180664 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb8c558-4914-4c6e-a5f0-880f14287f68 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:23.185437 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406749f3-017d-4401-a2ab-e32f38b67313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:23.186083 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406749f3-017d-4401-a2ab-e32f38b67313 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:23.186356 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406749f3-017d-4401-a2ab-e32f38b67313 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:23.186626 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406749f3-017d-4401-a2ab-e32f38b67313 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:23.187449 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406749f3-017d-4401-a2ab-e32f38b67313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:23.189004 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406749f3-017d-4401-a2ab-e32f38b67313 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:23.199203 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 799/1598] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:20:23 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:20:23.200123 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406749f3-017d-4401-a2ab-e32f38b67313 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:23.207671 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 800/1599] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:20:23 2021] POST /identity/v3/projects => generated 391 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:20:23.208466 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb8c558-4914-4c6e-a5f0-880f14287f68 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:23.214410 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406749f3-017d-4401-a2ab-e32f38b67313 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:23.266605 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb8c558-4914-4c6e-a5f0-880f14287f68 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:23.267691 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7ac66-a5d3-4245-98d4-57f8ee3b38a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:23.268303 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7ac66-a5d3-4245-98d4-57f8ee3b38a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:23.268579 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7ac66-a5d3-4245-98d4-57f8ee3b38a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:23.268849 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7ac66-a5d3-4245-98d4-57f8ee3b38a2 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:23.269862 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7ac66-a5d3-4245-98d4-57f8ee3b38a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:23.271683 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f6eb0-a307-4caf-abee-b9e7354f8353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:23.271817 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7ac66-a5d3-4245-98d4-57f8ee3b38a2 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:23.272334 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f6eb0-a307-4caf-abee-b9e7354f8353 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:23.272615 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f6eb0-a307-4caf-abee-b9e7354f8353 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:23.273026 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f6eb0-a307-4caf-abee-b9e7354f8353 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:23.273750 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f6eb0-a307-4caf-abee-b9e7354f8353 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:23.275689 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f6eb0-a307-4caf-abee-b9e7354f8353 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:23.291861 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 800/1600] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:20:23 2021] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:20:23.292622 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7ac66-a5d3-4245-98d4-57f8ee3b38a2 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:23.302200 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7ac66-a5d3-4245-98d4-57f8ee3b38a2 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:23.306335 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 801/1601] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:20:23 2021] POST /identity/v3/projects => generated 389 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:20:23.307763 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507e300-50c0-47f0-9de6-8f035e2a4383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:23.308391 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9247fa-18a4-4060-9a1c-810d334e30ce None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:23.308857 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9247fa-18a4-4060-9a1c-810d334e30ce None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:23.309205 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507e300-50c0-47f0-9de6-8f035e2a4383 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:23.309329 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9247fa-18a4-4060-9a1c-810d334e30ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:23.309901 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507e300-50c0-47f0-9de6-8f035e2a4383 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:23.310334 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507e300-50c0-47f0-9de6-8f035e2a4383 admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:23.311627 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3507e300-50c0-47f0-9de6-8f035e2a4383 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:20:23.312166 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3507e300-50c0-47f0-9de6-8f035e2a4383 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:23.315016 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3507e300-50c0-47f0-9de6-8f035e2a4383 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:23.332493 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 801/1602] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:20:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:20:23.333263 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507e300-50c0-47f0-9de6-8f035e2a4383 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:23.334328 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-dd9247fa-18a4-4060-9a1c-810d334e30ce None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:23.335645 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-dd9247fa-18a4-4060-9a1c-810d334e30ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:23.342556 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507e300-50c0-47f0-9de6-8f035e2a4383 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:23.392812 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 802/1603] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:23.393797 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9247fa-18a4-4060-9a1c-810d334e30ce None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:23.401346 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811116c-09cf-415f-9092-b9cffb8be250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:23.402174 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811116c-09cf-415f-9092-b9cffb8be250 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:23.402461 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811116c-09cf-415f-9092-b9cffb8be250 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:23.402735 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811116c-09cf-415f-9092-b9cffb8be250 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:23.403075 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9247fa-18a4-4060-9a1c-810d334e30ce None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:23.403491 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0811116c-09cf-415f-9092-b9cffb8be250 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:23.405441 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0811116c-09cf-415f-9092-b9cffb8be250 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:23.407755 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eca1f5-b013-44ff-af2c-0b949947f9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:23.408652 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eca1f5-b013-44ff-af2c-0b949947f9f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:23.408930 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eca1f5-b013-44ff-af2c-0b949947f9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:23.409202 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eca1f5-b013-44ff-af2c-0b949947f9f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:23.409934 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eca1f5-b013-44ff-af2c-0b949947f9f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:20:23.410234 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eca1f5-b013-44ff-af2c-0b949947f9f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:23.411838 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eca1f5-b013-44ff-af2c-0b949947f9f2 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:23.430556 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 803/1604] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:20:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:20:23.430556 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eca1f5-b013-44ff-af2c-0b949947f9f2 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:23.433704 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eca1f5-b013-44ff-af2c-0b949947f9f2 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:23.437443 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 802/1605] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:20:23 2021] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:20:23.437443 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811116c-09cf-415f-9092-b9cffb8be250 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:23.441404 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97186996-75b5-4865-9427-5ca2a3673e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:23.442067 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97186996-75b5-4865-9427-5ca2a3673e88 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:23.442349 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97186996-75b5-4865-9427-5ca2a3673e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:23.442623 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97186996-75b5-4865-9427-5ca2a3673e88 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:23.443386 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97186996-75b5-4865-9427-5ca2a3673e88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:23.445039 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97186996-75b5-4865-9427-5ca2a3673e88 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:23.446323 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811116c-09cf-415f-9092-b9cffb8be250 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:23.451091 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee34272-189c-485e-8382-0542ba8578ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:23.451741 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee34272-189c-485e-8382-0542ba8578ec admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:23.452016 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee34272-189c-485e-8382-0542ba8578ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:23.452288 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee34272-189c-485e-8382-0542ba8578ec admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:23.453081 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee34272-189c-485e-8382-0542ba8578ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:23.454993 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee34272-189c-485e-8382-0542ba8578ec admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:23.455991 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 804/1606] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:20:23 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:20:23.456583 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97186996-75b5-4865-9427-5ca2a3673e88 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:23.468332 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97186996-75b5-4865-9427-5ca2a3673e88 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:23.473782 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895b40f-78f7-4325-95f6-e3cb00a04c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:23.474452 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895b40f-78f7-4325-95f6-e3cb00a04c57 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:23.474717 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895b40f-78f7-4325-95f6-e3cb00a04c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:23.475018 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895b40f-78f7-4325-95f6-e3cb00a04c57 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:23.475750 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895b40f-78f7-4325-95f6-e3cb00a04c57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:23.477337 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895b40f-78f7-4325-95f6-e3cb00a04c57 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:23.478934 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 803/1607] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:20:23 2021] POST /identity/v3/users => generated 296 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:20:23.479739 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee34272-189c-485e-8382-0542ba8578ec admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:23.487491 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 805/1608] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:20:23 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:20:23.488264 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895b40f-78f7-4325-95f6-e3cb00a04c57 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:23.489127 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee34272-189c-485e-8382-0542ba8578ec admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:23.493973 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986a521-40cf-4222-8bd2-9daf8d3fff17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:23.494619 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986a521-40cf-4222-8bd2-9daf8d3fff17 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:23.494917 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986a521-40cf-4222-8bd2-9daf8d3fff17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:23.495182 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986a521-40cf-4222-8bd2-9daf8d3fff17 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:23.495868 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0986a521-40cf-4222-8bd2-9daf8d3fff17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:23.497510 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895b40f-78f7-4325-95f6-e3cb00a04c57 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:23.497746 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0986a521-40cf-4222-8bd2-9daf8d3fff17 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:23.502047 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b80f64b-1d7f-459a-b7b8-0eb9c1748cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:23.502665 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80f64b-1d7f-459a-b7b8-0eb9c1748cb8 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:23.502978 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80f64b-1d7f-459a-b7b8-0eb9c1748cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:23.503255 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80f64b-1d7f-459a-b7b8-0eb9c1748cb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:23.503938 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b80f64b-1d7f-459a-b7b8-0eb9c1748cb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:23.505812 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b80f64b-1d7f-459a-b7b8-0eb9c1748cb8 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:23.522028 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 804/1609] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:20:23 2021] POST /identity/v3/users => generated 295 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:20:23.522028 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986a521-40cf-4222-8bd2-9daf8d3fff17 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:23.535543 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 806/1610] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:20:23 2021] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:20:23.536349 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b80f64b-1d7f-459a-b7b8-0eb9c1748cb8 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:23.576406 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986a521-40cf-4222-8bd2-9daf8d3fff17 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:23.595683 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b80f64b-1d7f-459a-b7b8-0eb9c1748cb8 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:23.600273 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31124c44-309e-4c97-869c-d79e8b1cde6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:23.600927 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31124c44-309e-4c97-869c-d79e8b1cde6b admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:23.601214 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31124c44-309e-4c97-869c-d79e8b1cde6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:23.601490 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31124c44-309e-4c97-869c-d79e8b1cde6b admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:23.602194 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31124c44-309e-4c97-869c-d79e8b1cde6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:23.604290 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31124c44-309e-4c97-869c-d79e8b1cde6b admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:23.622637 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c07382-d2b3-4f05-8298-d3caebe3021a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:23.623319 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c07382-d2b3-4f05-8298-d3caebe3021a service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:23.623597 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c07382-d2b3-4f05-8298-d3caebe3021a service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:23.623876 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c07382-d2b3-4f05-8298-d3caebe3021a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:23.629864 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 807/1611] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:20:23 2021] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:20:23.630759 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31124c44-309e-4c97-869c-d79e8b1cde6b admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:23.632955 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c07382-d2b3-4f05-8298-d3caebe3021a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:23.634496 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c07382-d2b3-4f05-8298-d3caebe3021a service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:23.643841 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 805/1612] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:20:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:20:23.644973 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c07382-d2b3-4f05-8298-d3caebe3021a service neutron] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:23.653730 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c07382-d2b3-4f05-8298-d3caebe3021a service neutron] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:23.695358 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31124c44-309e-4c97-869c-d79e8b1cde6b admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:23.700887 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba3a34-e4a3-4c34-8e36-7c40df7c1363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:23.701573 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba3a34-e4a3-4c34-8e36-7c40df7c1363 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:23.701851 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba3a34-e4a3-4c34-8e36-7c40df7c1363 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:23.702126 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba3a34-e4a3-4c34-8e36-7c40df7c1363 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:23.702953 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba3a34-e4a3-4c34-8e36-7c40df7c1363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:23.704890 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba3a34-e4a3-4c34-8e36-7c40df7c1363 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:23.713320 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1f471-4bb0-4d27-9566-e8a3ae63abd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:23.714227 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1f471-4bb0-4d27-9566-e8a3ae63abd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:23.714515 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1f471-4bb0-4d27-9566-e8a3ae63abd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:23.714783 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1f471-4bb0-4d27-9566-e8a3ae63abd6 admin admin] PATH_INFO: `/v3/projects/8217a6b82c7b4d45b801489c7cc7829d/users/6125deb499c649d0911cf8ccf4bde709/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:23.719003 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 808/1613] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:20:23 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:20:23.719003 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba3a34-e4a3-4c34-8e36-7c40df7c1363 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:23.728876 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba3a34-e4a3-4c34-8e36-7c40df7c1363 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:23.733196 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1f471-4bb0-4d27-9566-e8a3ae63abd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8217a6b82c7b4d45b801489c7cc7829d, user_id=6125deb499c649d0911cf8ccf4bde709, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:23.735040 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3dc4de-9f35-4d89-a853-4dce6edc2197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:23.736166 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3dc4de-9f35-4d89-a853-4dce6edc2197 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:23.736282 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1f471-4bb0-4d27-9566-e8a3ae63abd6 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:23.736382 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3dc4de-9f35-4d89-a853-4dce6edc2197 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:23.736579 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3dc4de-9f35-4d89-a853-4dce6edc2197 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:23.737254 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3dc4de-9f35-4d89-a853-4dce6edc2197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:23.739060 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3dc4de-9f35-4d89-a853-4dce6edc2197 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:23.750345 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 809/1614] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:20:23 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:20:23.751205 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3dc4de-9f35-4d89-a853-4dce6edc2197 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:23.752997 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 806/1615] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:20:23 2021] PUT /identity/v3/projects/8217a6b82c7b4d45b801489c7cc7829d/users/6125deb499c649d0911cf8ccf4bde709/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:23.754067 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1f471-4bb0-4d27-9566-e8a3ae63abd6 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:23.762387 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3dc4de-9f35-4d89-a853-4dce6edc2197 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:23.818327 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1f471-4bb0-4d27-9566-e8a3ae63abd6 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:23.823137 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7231ef4-c0dd-4550-8ee8-5405e64332d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:23.823282 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef61c2de-8cc3-47dd-ae6b-c4515731f0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:23.823808 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7231ef4-c0dd-4550-8ee8-5405e64332d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:23.823931 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61c2de-8cc3-47dd-ae6b-c4515731f0fa admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:23.824098 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7231ef4-c0dd-4550-8ee8-5405e64332d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:23.824214 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61c2de-8cc3-47dd-ae6b-c4515731f0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:23.824387 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7231ef4-c0dd-4550-8ee8-5405e64332d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:23.824500 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61c2de-8cc3-47dd-ae6b-c4515731f0fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:23.828107 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7231ef4-c0dd-4550-8ee8-5405e64332d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:23.828272 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef61c2de-8cc3-47dd-ae6b-c4515731f0fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:23.828375 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7231ef4-c0dd-4550-8ee8-5405e64332d0 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:23.828453 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef61c2de-8cc3-47dd-ae6b-c4515731f0fa admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:23.839939 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 810/1616] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:20:23 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:20:23.839939 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7231ef4-c0dd-4550-8ee8-5405e64332d0 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:23.843286 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 807/1617] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:20:23 2021] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:20:23.844070 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef61c2de-8cc3-47dd-ae6b-c4515731f0fa admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:23.848800 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7231ef4-c0dd-4550-8ee8-5405e64332d0 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:23.854560 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc7aa7e-92a9-4a43-a64f-230015e800d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:23.855342 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7aa7e-92a9-4a43-a64f-230015e800d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:23.855651 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7aa7e-92a9-4a43-a64f-230015e800d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:23.855912 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7aa7e-92a9-4a43-a64f-230015e800d3 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:23.856652 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc7aa7e-92a9-4a43-a64f-230015e800d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:23.857842 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef61c2de-8cc3-47dd-ae6b-c4515731f0fa admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:23.858902 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc7aa7e-92a9-4a43-a64f-230015e800d3 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:23.863143 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570aad7-79fd-4420-aaed-e9c304a78611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:23.863990 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570aad7-79fd-4420-aaed-e9c304a78611 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:23.864271 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570aad7-79fd-4420-aaed-e9c304a78611 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:23.864547 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570aad7-79fd-4420-aaed-e9c304a78611 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:23.865239 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5570aad7-79fd-4420-aaed-e9c304a78611 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:23.867354 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5570aad7-79fd-4420-aaed-e9c304a78611 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:23.883260 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 811/1618] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:20:23 2021] POST /identity/v3/users => generated 291 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:20:23.884089 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc7aa7e-92a9-4a43-a64f-230015e800d3 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:23.888049 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 808/1619] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:20:23 2021] POST /identity/v3/users => generated 287 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:20:23.892076 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570aad7-79fd-4420-aaed-e9c304a78611 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:23.895746 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc7aa7e-92a9-4a43-a64f-230015e800d3 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:23.900997 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3504bf68-52bd-41d3-8132-508bb083bb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:23.901663 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504bf68-52bd-41d3-8132-508bb083bb73 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:23.901937 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504bf68-52bd-41d3-8132-508bb083bb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:23.902210 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3504bf68-52bd-41d3-8132-508bb083bb73 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:23.902979 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504bf68-52bd-41d3-8132-508bb083bb73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:23.904078 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570aad7-79fd-4420-aaed-e9c304a78611 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:23.904576 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3504bf68-52bd-41d3-8132-508bb083bb73 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:23.910602 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c8c78-ef7f-4815-bcc7-37ec763373f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:23.911811 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c8c78-ef7f-4815-bcc7-37ec763373f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:23.912162 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c8c78-ef7f-4815-bcc7-37ec763373f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:23.912978 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c8c78-ef7f-4815-bcc7-37ec763373f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:23.913735 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c8c78-ef7f-4815-bcc7-37ec763373f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:23.915372 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c8c78-ef7f-4815-bcc7-37ec763373f1 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:23.916255 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 812/1620] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:20:23 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:20:23.920602 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034e4c2-d444-44f5-b181-5dc415a76968 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:23.920919 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034e4c2-d444-44f5-b181-5dc415a76968 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:23.921163 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034e4c2-d444-44f5-b181-5dc415a76968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:23.926501 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 809/1621] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:20:23 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:20:23.927404 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c8c78-ef7f-4815-bcc7-37ec763373f1 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:23.943785 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c8c78-ef7f-4815-bcc7-37ec763373f1 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:23.954534 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-4034e4c2-d444-44f5-b181-5dc415a76968 None None] MFA Rules not processed for user `6125deb499c649d0911cf8ccf4bde709`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:23.955918 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-4034e4c2-d444-44f5-b181-5dc415a76968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:23.965431 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb375b9b-8ec7-434f-8cf8-9145000f9350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:23.966032 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb375b9b-8ec7-434f-8cf8-9145000f9350 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:23.966515 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb375b9b-8ec7-434f-8cf8-9145000f9350 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:23.966715 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb375b9b-8ec7-434f-8cf8-9145000f9350 admin admin] PATH_INFO: `/v3/projects/c3d183a9f26a477e97231639ce00e93f/users/d559050deccf44e0a0705b87763d0751/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:23.986020 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb375b9b-8ec7-434f-8cf8-9145000f9350 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3d183a9f26a477e97231639ce00e93f, user_id=d559050deccf44e0a0705b87763d0751, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:23.989609 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb375b9b-8ec7-434f-8cf8-9145000f9350 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:24.018901 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 810/1622] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:20:23 2021] PUT /identity/v3/projects/c3d183a9f26a477e97231639ce00e93f/users/d559050deccf44e0a0705b87763d0751/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:24.023721 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb375b9b-8ec7-434f-8cf8-9145000f9350 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:24.047686 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 813/1623] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:23 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:24.048927 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034e4c2-d444-44f5-b181-5dc415a76968 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:24.067461 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034e4c2-d444-44f5-b181-5dc415a76968 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:24.108939 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb375b9b-8ec7-434f-8cf8-9145000f9350 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:24.114182 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1316f-04ee-4cc4-94c8-5099e993d8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:24.114889 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1316f-04ee-4cc4-94c8-5099e993d8c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:24.115161 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1316f-04ee-4cc4-94c8-5099e993d8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:24.115433 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be1316f-04ee-4cc4-94c8-5099e993d8c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:24.116266 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1316f-04ee-4cc4-94c8-5099e993d8c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:24.117844 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be1316f-04ee-4cc4-94c8-5099e993d8c1 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:24.127925 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 811/1624] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:20:24 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:20:24.131859 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1316f-04ee-4cc4-94c8-5099e993d8c1 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:24.134597 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ca470-ac93-431d-a864-0c19a128f3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:24.135312 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ca470-ac93-431d-a864-0c19a128f3a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:24.135585 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ca470-ac93-431d-a864-0c19a128f3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:24.135854 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ca470-ac93-431d-a864-0c19a128f3a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:24.137161 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ca470-ac93-431d-a864-0c19a128f3a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:24.140548 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967ca470-ac93-431d-a864-0c19a128f3a2 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:24.141886 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be1316f-04ee-4cc4-94c8-5099e993d8c1 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:24.146746 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89024aad-57a7-4d81-8467-2a734165a8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:24.147546 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89024aad-57a7-4d81-8467-2a734165a8ee admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:24.147823 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89024aad-57a7-4d81-8467-2a734165a8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:24.148094 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89024aad-57a7-4d81-8467-2a734165a8ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:24.148820 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89024aad-57a7-4d81-8467-2a734165a8ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:24.150418 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89024aad-57a7-4d81-8467-2a734165a8ee admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:24.152835 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 814/1625] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:20:24 2021] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:20:24.153741 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ca470-ac93-431d-a864-0c19a128f3a2 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:24.162298 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 812/1626] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:20:24 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:20:24.163387 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89024aad-57a7-4d81-8467-2a734165a8ee admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:24.163528 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ca470-ac93-431d-a864-0c19a128f3a2 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:24.168198 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0bad67-5074-478e-9671-f7c9b46c7b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:24.169075 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bad67-5074-478e-9671-f7c9b46c7b15 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:24.169355 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bad67-5074-478e-9671-f7c9b46c7b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:24.169626 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bad67-5074-478e-9671-f7c9b46c7b15 admin admin] PATH_INFO: `/v3/projects/3e43daf7f595459f97cf2eb7960291a1/users/682a8ea75de1423199659f6f850d2ade/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:24.175413 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89024aad-57a7-4d81-8467-2a734165a8ee admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:24.182397 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc790ba4-d605-4953-8e0b-4404fc10b002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:24.183377 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc790ba4-d605-4953-8e0b-4404fc10b002 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:24.184042 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc790ba4-d605-4953-8e0b-4404fc10b002 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:24.184325 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc790ba4-d605-4953-8e0b-4404fc10b002 admin admin] PATH_INFO: `/v3/projects/a80c484003d7406c92104a6a57ea50af/users/2ed842b05ab04f0a807a60c34ad9198a/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:24.186508 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0bad67-5074-478e-9671-f7c9b46c7b15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e43daf7f595459f97cf2eb7960291a1, user_id=682a8ea75de1423199659f6f850d2ade, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:24.189217 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0bad67-5074-478e-9671-f7c9b46c7b15 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:24.201673 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc790ba4-d605-4953-8e0b-4404fc10b002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a80c484003d7406c92104a6a57ea50af, user_id=2ed842b05ab04f0a807a60c34ad9198a, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:24.207473 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 815/1627] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:20:24 2021] PUT /identity/v3/projects/3e43daf7f595459f97cf2eb7960291a1/users/682a8ea75de1423199659f6f850d2ade/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:24.207648 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc790ba4-d605-4953-8e0b-4404fc10b002 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:24.207769 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e40e7-0b2b-4423-b409-bfa6cca67792 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:24.207769 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e40e7-0b2b-4423-b409-bfa6cca67792 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:24.207769 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e40e7-0b2b-4423-b409-bfa6cca67792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:24.220869 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 813/1628] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:20:24 2021] PUT /identity/v3/projects/a80c484003d7406c92104a6a57ea50af/users/2ed842b05ab04f0a807a60c34ad9198a/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:24.222467 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3f59e-00eb-48a0-bc62-dac5fe58b1e9 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:24.222872 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3f59e-00eb-48a0-bc62-dac5fe58b1e9 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:24.223297 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3f59e-00eb-48a0-bc62-dac5fe58b1e9 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:24.225353 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 814/1629] 10.222.0.15 () {54 vars in 961 bytes} [Mon Nov 29 20:20:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:20:24.225988 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3f59e-00eb-48a0-bc62-dac5fe58b1e9 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:24.235789 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-4c7e40e7-0b2b-4423-b409-bfa6cca67792 None None] MFA Rules not processed for user `d559050deccf44e0a0705b87763d0751`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:24.237193 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-4c7e40e7-0b2b-4423-b409-bfa6cca67792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:24.306582 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3f59e-00eb-48a0-bc62-dac5fe58b1e9 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:24.310602 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 816/1630] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:24 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:24.311878 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e40e7-0b2b-4423-b409-bfa6cca67792 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:24.321078 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea3e14-7665-4657-83c0-5e15dfd86c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:24.321986 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea3e14-7665-4657-83c0-5e15dfd86c84 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:24.322265 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea3e14-7665-4657-83c0-5e15dfd86c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:24.322535 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea3e14-7665-4657-83c0-5e15dfd86c84 admin admin] PATH_INFO: `/v3/projects/bec7a65a88e44bdf93195a0f3ebce687/users/0746d603781d4b3796959e8217112cc5/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:24.342873 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e40e7-0b2b-4423-b409-bfa6cca67792 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:24.343127 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea3e14-7665-4657-83c0-5e15dfd86c84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bec7a65a88e44bdf93195a0f3ebce687, user_id=0746d603781d4b3796959e8217112cc5, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:24.343239 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce816aa-549e-4c9a-ac94-d4489a23b0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:24.343239 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce816aa-549e-4c9a-ac94-d4489a23b0ab admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:24.343500 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea3e14-7665-4657-83c0-5e15dfd86c84 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:24.343593 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce816aa-549e-4c9a-ac94-d4489a23b0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:24.343593 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce816aa-549e-4c9a-ac94-d4489a23b0ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:24.343593 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce816aa-549e-4c9a-ac94-d4489a23b0ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:24.345392 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce816aa-549e-4c9a-ac94-d4489a23b0ab admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:24.356864 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 815/1631] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:20:24 2021] PUT /identity/v3/projects/bec7a65a88e44bdf93195a0f3ebce687/users/0746d603781d4b3796959e8217112cc5/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:24.357526 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea3e14-7665-4657-83c0-5e15dfd86c84 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:24.361169 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 817/1632] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:20:24 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:20:24.363639 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40bbb6e-4ad0-4570-9fcd-8963e1c940de None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:24.364723 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40bbb6e-4ad0-4570-9fcd-8963e1c940de None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:24.365015 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40bbb6e-4ad0-4570-9fcd-8963e1c940de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:24.382520 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-c40bbb6e-4ad0-4570-9fcd-8963e1c940de None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:24.383789 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-c40bbb6e-4ad0-4570-9fcd-8963e1c940de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:24.421220 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea3e14-7665-4657-83c0-5e15dfd86c84 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:24.426316 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515130d4-8671-4e3a-8815-86e010f95519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:24.427000 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515130d4-8671-4e3a-8815-86e010f95519 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:24.427275 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515130d4-8671-4e3a-8815-86e010f95519 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:24.427542 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515130d4-8671-4e3a-8815-86e010f95519 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:24.428271 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515130d4-8671-4e3a-8815-86e010f95519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:24.429845 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515130d4-8671-4e3a-8815-86e010f95519 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:24.441427 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 816/1633] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:20:24 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:20:24.442731 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e8fc9-f7f0-4e22-be26-e87b0b888a9a None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:24.443043 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e8fc9-f7f0-4e22-be26-e87b0b888a9a None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:24.443327 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e8fc9-f7f0-4e22-be26-e87b0b888a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:24.449034 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 818/1634] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:24.450548 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d9d29-28f8-4b19-8f84-b0aef4585645 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:24.450768 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d9d29-28f8-4b19-8f84-b0aef4585645 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:24.451132 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d9d29-28f8-4b19-8f84-b0aef4585645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:24.469197 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-458e8fc9-f7f0-4e22-be26-e87b0b888a9a None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:24.470338 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-8f3d9d29-28f8-4b19-8f84-b0aef4585645 None None] MFA Rules not processed for user `5f76a8c3d04e440b92d12ced18d97941`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:24.470597 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-458e8fc9-f7f0-4e22-be26-e87b0b888a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:24.471677 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-8f3d9d29-28f8-4b19-8f84-b0aef4585645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:24.479705 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 817/1635] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:24.481003 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6bb9d-31ab-47df-baa8-da4ebdd09c19 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:24.481286 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6bb9d-31ab-47df-baa8-da4ebdd09c19 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:24.481566 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6bb9d-31ab-47df-baa8-da4ebdd09c19 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:24.483274 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 818/1636] 10.222.0.15 () {54 vars in 961 bytes} [Mon Nov 29 20:20:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:20:24.484391 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a21c40-f5b0-4da6-b9b4-aa4cbff00fcd None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:24.484734 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a21c40-f5b0-4da6-b9b4-aa4cbff00fcd None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:24.485011 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a21c40-f5b0-4da6-b9b4-aa4cbff00fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:24.512384 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-51a21c40-f5b0-4da6-b9b4-aa4cbff00fcd None None] MFA Rules not processed for user `b7b0ec8500024b14802bd38b95e822c8`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:24.513626 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-51a21c40-f5b0-4da6-b9b4-aa4cbff00fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:24.548781 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 819/1637] 10.222.0.15 () {58 vars in 1058 bytes} [Mon Nov 29 20:20:24 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:24.550427 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb832d3-c31c-46f2-bbec-f455f961667c None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:24.550720 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb832d3-c31c-46f2-bbec-f455f961667c None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:24.551083 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb832d3-c31c-46f2-bbec-f455f961667c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:24.569877 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-edb832d3-c31c-46f2-bbec-f455f961667c None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:24.573063 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-edb832d3-c31c-46f2-bbec-f455f961667c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:24.581408 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 820/1638] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:24 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:24.582025 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 819/1639] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:24 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:24.582510 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb832d3-c31c-46f2-bbec-f455f961667c None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:24.582825 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a21c40-f5b0-4da6-b9b4-aa4cbff00fcd None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:24.596650 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a21c40-f5b0-4da6-b9b4-aa4cbff00fcd None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:24.601178 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b02688e-2e39-4d7d-8dda-95fe402572be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:24.601662 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb832d3-c31c-46f2-bbec-f455f961667c None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:24.602193 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02688e-2e39-4d7d-8dda-95fe402572be admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:24.602477 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02688e-2e39-4d7d-8dda-95fe402572be admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:24.602755 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02688e-2e39-4d7d-8dda-95fe402572be admin admin] PATH_INFO: `/v3/projects/1fcc3a49491a488dadee049f6143ff91/users/2fda63f12ed546528d4d24aea1f439c3/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:24.606981 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b600d-7b8a-4e3c-832b-661e3ac59534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:24.607860 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b600d-7b8a-4e3c-832b-661e3ac59534 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:24.608135 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b600d-7b8a-4e3c-832b-661e3ac59534 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:24.608402 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b600d-7b8a-4e3c-832b-661e3ac59534 admin admin] PATH_INFO: `/v3/projects/d86c721ef418486daa857e8b283ed5fa/users/1a6e81bb9c714cf0bda9aef82e6319f4/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:24.617020 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b02688e-2e39-4d7d-8dda-95fe402572be admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fcc3a49491a488dadee049f6143ff91, user_id=2fda63f12ed546528d4d24aea1f439c3, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:24.619752 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b02688e-2e39-4d7d-8dda-95fe402572be admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:24.623180 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3b600d-7b8a-4e3c-832b-661e3ac59534 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d86c721ef418486daa857e8b283ed5fa, user_id=1a6e81bb9c714cf0bda9aef82e6319f4, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:24.626082 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3b600d-7b8a-4e3c-832b-661e3ac59534 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:24.632892 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 820/1640] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:20:24 2021] PUT /identity/v3/projects/1fcc3a49491a488dadee049f6143ff91/users/2fda63f12ed546528d4d24aea1f439c3/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:24.644306 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b02688e-2e39-4d7d-8dda-95fe402572be admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:24.644452 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 821/1641] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:20:24 2021] PUT /identity/v3/projects/d86c721ef418486daa857e8b283ed5fa/users/1a6e81bb9c714cf0bda9aef82e6319f4/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:24.644452 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726da0e-3995-4524-b328-54f3494defc2 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:24.644452 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726da0e-3995-4524-b328-54f3494defc2 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:24.644452 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a726da0e-3995-4524-b328-54f3494defc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:24.663963 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-a726da0e-3995-4524-b328-54f3494defc2 None None] MFA Rules not processed for user `5f76a8c3d04e440b92d12ced18d97941`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:24.665164 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-a726da0e-3995-4524-b328-54f3494defc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:24.697337 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b02688e-2e39-4d7d-8dda-95fe402572be admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:24.730339 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 822/1642] 10.222.0.15 () {58 vars in 1058 bytes} [Mon Nov 29 20:20:24 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:24.731310 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726da0e-3995-4524-b328-54f3494defc2 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:24.745018 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f142015-297c-40d1-aafc-6d3233f418e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:24.745671 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f142015-297c-40d1-aafc-6d3233f418e3 service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:24.745950 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f142015-297c-40d1-aafc-6d3233f418e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:24.746223 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f142015-297c-40d1-aafc-6d3233f418e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:24.783509 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a726da0e-3995-4524-b328-54f3494defc2 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:24.787166 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db70ac-f4ca-4684-bdd0-c5e647ea8926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:24.787807 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db70ac-f4ca-4684-bdd0-c5e647ea8926 service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:24.788084 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db70ac-f4ca-4684-bdd0-c5e647ea8926 service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:24.788357 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db70ac-f4ca-4684-bdd0-c5e647ea8926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:24.804112 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f142015-297c-40d1-aafc-6d3233f418e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:24.805511 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f142015-297c-40d1-aafc-6d3233f418e3 service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:24.815444 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 821/1643] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:20:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:20:24.816164 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f142015-297c-40d1-aafc-6d3233f418e3 service neutron] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:24.834472 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f142015-297c-40d1-aafc-6d3233f418e3 service neutron] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:24.843407 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29cafef-966f-4121-869b-9c2edec5b301 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:24.844077 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29cafef-966f-4121-869b-9c2edec5b301 service nova] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:24.844390 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29cafef-966f-4121-869b-9c2edec5b301 service nova] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:24.844663 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29cafef-966f-4121-869b-9c2edec5b301 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:24.848701 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db70ac-f4ca-4684-bdd0-c5e647ea8926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:24.850225 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3db70ac-f4ca-4684-bdd0-c5e647ea8926 service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:24.864651 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 823/1644] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:20:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:20:24.866456 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4276c-0ccd-44f0-9379-92408be591df None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:24.866801 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4276c-0ccd-44f0-9379-92408be591df None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:24.867185 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4276c-0ccd-44f0-9379-92408be591df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:24.887130 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-04d4276c-0ccd-44f0-9379-92408be591df None None] MFA Rules not processed for user `b7b0ec8500024b14802bd38b95e822c8`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:24.888437 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-04d4276c-0ccd-44f0-9379-92408be591df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:24.904057 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29cafef-966f-4121-869b-9c2edec5b301 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:24.905972 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29cafef-966f-4121-869b-9c2edec5b301 service nova] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:24.915496 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 822/1645] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:20:24 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:20:24.928242 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29cafef-966f-4121-869b-9c2edec5b301 service nova] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:24.943253 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29cafef-966f-4121-869b-9c2edec5b301 service nova] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:24.948791 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703cafe7-fd6b-42e0-8ca7-f2ff4a7bca92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:24.949502 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703cafe7-fd6b-42e0-8ca7-f2ff4a7bca92 service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:24.949777 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703cafe7-fd6b-42e0-8ca7-f2ff4a7bca92 service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:24.950658 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703cafe7-fd6b-42e0-8ca7-f2ff4a7bca92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:24.962039 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 824/1646] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:24 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:24.964305 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703cafe7-fd6b-42e0-8ca7-f2ff4a7bca92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:24.964560 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065435ef-5403-42cf-b6b1-9ae88d32f6ae None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:24.964943 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065435ef-5403-42cf-b6b1-9ae88d32f6ae None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:24.965270 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065435ef-5403-42cf-b6b1-9ae88d32f6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:24.965839 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703cafe7-fd6b-42e0-8ca7-f2ff4a7bca92 service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:24.980007 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 823/1647] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:20:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:20:24.981699 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193789ef-6b2e-416e-9ef3-c9fd27a49817 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:24.982037 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193789ef-6b2e-416e-9ef3-c9fd27a49817 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:24.982372 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193789ef-6b2e-416e-9ef3-c9fd27a49817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:25.015826 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-065435ef-5403-42cf-b6b1-9ae88d32f6ae None None] MFA Rules not processed for user `2fda63f12ed546528d4d24aea1f439c3`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:25.017074 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-065435ef-5403-42cf-b6b1-9ae88d32f6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:25.025164 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-193789ef-6b2e-416e-9ef3-c9fd27a49817 None None] MFA Rules not processed for user `1a6e81bb9c714cf0bda9aef82e6319f4`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:25.027319 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-193789ef-6b2e-416e-9ef3-c9fd27a49817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:25.108230 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 825/1648] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:24 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:25.109585 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065435ef-5403-42cf-b6b1-9ae88d32f6ae None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:25.116648 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 824/1649] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:24 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:25.117858 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193789ef-6b2e-416e-9ef3-c9fd27a49817 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:25.126823 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065435ef-5403-42cf-b6b1-9ae88d32f6ae None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:25.130177 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193789ef-6b2e-416e-9ef3-c9fd27a49817 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:25.134546 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2d769-4d7d-40c5-9626-4d0975973dd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:25.135846 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96fd91-ec64-4594-9f0e-1e4d5b64cb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:25.136666 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96fd91-ec64-4594-9f0e-1e4d5b64cb05 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:25.137058 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96fd91-ec64-4594-9f0e-1e4d5b64cb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:25.137426 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96fd91-ec64-4594-9f0e-1e4d5b64cb05 admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:25.140226 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2d769-4d7d-40c5-9626-4d0975973dd5 service nova] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:25.140524 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2d769-4d7d-40c5-9626-4d0975973dd5 service nova] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:25.140640 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db96fd91-ec64-4594-9f0e-1e4d5b64cb05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:25.140798 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2d769-4d7d-40c5-9626-4d0975973dd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:25.143200 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db96fd91-ec64-4594-9f0e-1e4d5b64cb05 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:25.176967 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 825/1650] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:20:25 2021] POST /identity/v3/projects => generated 371 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:20:25.178317 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96fd91-ec64-4594-9f0e-1e4d5b64cb05 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:25.207685 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db2d769-4d7d-40c5-9626-4d0975973dd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:25.209306 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db2d769-4d7d-40c5-9626-4d0975973dd5 service nova] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:25.219310 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 826/1651] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:20:25 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:20:25.228653 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2d769-4d7d-40c5-9626-4d0975973dd5 service nova] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:25.246286 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2d769-4d7d-40c5-9626-4d0975973dd5 service nova] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:25.247004 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96fd91-ec64-4594-9f0e-1e4d5b64cb05 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:25.251974 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf12e6-8f72-46f5-9172-5371ac0fd9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:25.252866 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf12e6-8f72-46f5-9172-5371ac0fd9cf admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:25.253210 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf12e6-8f72-46f5-9172-5371ac0fd9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:25.254143 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf12e6-8f72-46f5-9172-5371ac0fd9cf admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:25.254480 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf12e6-8f72-46f5-9172-5371ac0fd9cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:25.256626 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaf12e6-8f72-46f5-9172-5371ac0fd9cf admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:25.290407 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 826/1652] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:20:25 2021] POST /identity/v3/projects => generated 381 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:20:25.291537 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf12e6-8f72-46f5-9172-5371ac0fd9cf admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:25.331946 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ecffcc-77b2-49b4-ae73-e4add7d53907 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:25.333321 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ecffcc-77b2-49b4-ae73-e4add7d53907 service nova] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:25.334621 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ecffcc-77b2-49b4-ae73-e4add7d53907 service nova] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:25.335179 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ecffcc-77b2-49b4-ae73-e4add7d53907 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:25.362624 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf12e6-8f72-46f5-9172-5371ac0fd9cf admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:25.368273 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ee57c-0dae-4cd8-b14d-35931e15d84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:25.369032 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ee57c-0dae-4cd8-b14d-35931e15d84c admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:25.369386 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ee57c-0dae-4cd8-b14d-35931e15d84c admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:25.369788 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ee57c-0dae-4cd8-b14d-35931e15d84c admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:25.370569 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ee57c-0dae-4cd8-b14d-35931e15d84c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:25.372724 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ee57c-0dae-4cd8-b14d-35931e15d84c admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:25.402025 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 827/1653] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:20:25 2021] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:20:25.402867 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ee57c-0dae-4cd8-b14d-35931e15d84c admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:25.442557 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ee57c-0dae-4cd8-b14d-35931e15d84c admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:25.444114 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ecffcc-77b2-49b4-ae73-e4add7d53907 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:25.445908 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ecffcc-77b2-49b4-ae73-e4add7d53907 service nova] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:25.455183 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc40c7fc-0034-4185-b6bb-6a077664fb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:25.457230 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 827/1654] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:20:25 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:20:25.458193 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ecffcc-77b2-49b4-ae73-e4add7d53907 service nova] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:25.467519 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40c7fc-0034-4185-b6bb-6a077664fb72 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:25.467780 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40c7fc-0034-4185-b6bb-6a077664fb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:25.468110 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40c7fc-0034-4185-b6bb-6a077664fb72 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:25.468951 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc40c7fc-0034-4185-b6bb-6a077664fb72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:25.471023 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ecffcc-77b2-49b4-ae73-e4add7d53907 service nova] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:25.471156 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc40c7fc-0034-4185-b6bb-6a077664fb72 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:25.476686 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d740f3-3bd8-48f2-8469-dda4de2b8f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:25.477423 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d740f3-3bd8-48f2-8469-dda4de2b8f67 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:25.477704 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d740f3-3bd8-48f2-8469-dda4de2b8f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:25.477981 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d740f3-3bd8-48f2-8469-dda4de2b8f67 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:25.479221 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d740f3-3bd8-48f2-8469-dda4de2b8f67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:25.481141 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d740f3-3bd8-48f2-8469-dda4de2b8f67 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:25.502565 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 828/1655] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:20:25 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:20:25.504148 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccbae0-717a-4762-a587-55b147bba678 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:25.504425 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccbae0-717a-4762-a587-55b147bba678 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:25.504702 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccbae0-717a-4762-a587-55b147bba678 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:25.506864 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 829/1656] 10.222.0.15 () {54 vars in 912 bytes} [Mon Nov 29 20:20:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:20:25.507304 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 828/1657] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:20:25 2021] POST /identity/v3/users => generated 297 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:20:25.507818 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ccbae0-717a-4762-a587-55b147bba678 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:25.511178 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc40c7fc-0034-4185-b6bb-6a077664fb72 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:25.522550 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ccbae0-717a-4762-a587-55b147bba678 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:25.527161 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631bb60c-9f40-4a7c-91b6-9e3d4d60db60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:25.528051 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bb60c-9f40-4a7c-91b6-9e3d4d60db60 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:25.528330 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bb60c-9f40-4a7c-91b6-9e3d4d60db60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:25.528604 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bb60c-9f40-4a7c-91b6-9e3d4d60db60 admin admin] PATH_INFO: `/v3/projects/7791fa7a908442f8a659afc3e24bb60c/users/17d7ec23284741dc9357c1e871a6d941/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:25.538842 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc40c7fc-0034-4185-b6bb-6a077664fb72 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:25.546027 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631bb60c-9f40-4a7c-91b6-9e3d4d60db60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7791fa7a908442f8a659afc3e24bb60c, user_id=17d7ec23284741dc9357c1e871a6d941, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:25.547913 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa810f-8651-4327-8d7c-377e6c3baada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:25.549191 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631bb60c-9f40-4a7c-91b6-9e3d4d60db60 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:25.549614 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa810f-8651-4327-8d7c-377e6c3baada admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:25.550092 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa810f-8651-4327-8d7c-377e6c3baada admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:25.550944 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa810f-8651-4327-8d7c-377e6c3baada admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:25.552377 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa810f-8651-4327-8d7c-377e6c3baada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:25.555488 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa810f-8651-4327-8d7c-377e6c3baada admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:25.569174 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 829/1659] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:20:25 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 29 20:20:25.570371 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75577c0a-3ebc-4d9d-93ec-d9765b434f4a None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:25.570661 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75577c0a-3ebc-4d9d-93ec-d9765b434f4a None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:25.571012 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 830/1659] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:20:25 2021] PUT /identity/v3/projects/7791fa7a908442f8a659afc3e24bb60c/users/17d7ec23284741dc9357c1e871a6d941/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:25.571268 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75577c0a-3ebc-4d9d-93ec-d9765b434f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:25.573654 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a0df7-7184-4973-86d8-c2608d16d2f5 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:25.574067 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a0df7-7184-4973-86d8-c2608d16d2f5 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:25.574414 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a0df7-7184-4973-86d8-c2608d16d2f5 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:25.576610 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 831/1660] 10.222.0.15 () {54 vars in 912 bytes} [Mon Nov 29 20:20:25 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:20:25.577401 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a0df7-7184-4973-86d8-c2608d16d2f5 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:25.590935 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-75577c0a-3ebc-4d9d-93ec-d9765b434f4a None None] MFA Rules not processed for user `5f76a8c3d04e440b92d12ced18d97941`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:25.592466 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-75577c0a-3ebc-4d9d-93ec-d9765b434f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:25.646242 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a0df7-7184-4973-86d8-c2608d16d2f5 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:25.652009 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847aa407-2a4d-4c7d-8a04-90451f2e27df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:25.652717 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847aa407-2a4d-4c7d-8a04-90451f2e27df admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:25.652972 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847aa407-2a4d-4c7d-8a04-90451f2e27df admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:25.653464 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847aa407-2a4d-4c7d-8a04-90451f2e27df admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:25.654262 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847aa407-2a4d-4c7d-8a04-90451f2e27df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:25.656321 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847aa407-2a4d-4c7d-8a04-90451f2e27df admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:25.694701 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 830/1661] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Nov 29 20:20:25 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:25.696359 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75577c0a-3ebc-4d9d-93ec-d9765b434f4a None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:25.703306 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 832/1662] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:20:25 2021] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:20:25.704586 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54697320-2bc5-4641-9f70-f56a1d3c8468 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:25.704872 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54697320-2bc5-4641-9f70-f56a1d3c8468 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:25.705148 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54697320-2bc5-4641-9f70-f56a1d3c8468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:25.709636 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75577c0a-3ebc-4d9d-93ec-d9765b434f4a None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:25.717022 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb79b9-c3a8-4141-8938-9313680da99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:25.718383 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb79b9-c3a8-4141-8938-9313680da99b admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:25.718996 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb79b9-c3a8-4141-8938-9313680da99b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:25.719297 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb79b9-c3a8-4141-8938-9313680da99b admin admin] PATH_INFO: `/v3/projects/22945ef9350e4d8a8d126bb32f4cd2b8/users/6213b9aa225c4f8697d018684c08f025/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:25.738509 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bb79b9-c3a8-4141-8938-9313680da99b admin admin] RBAC: Authorizing `identity:create_grant(project_id=22945ef9350e4d8a8d126bb32f4cd2b8, user_id=6213b9aa225c4f8697d018684c08f025, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:25.741943 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bb79b9-c3a8-4141-8938-9313680da99b admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:25.749875 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-54697320-2bc5-4641-9f70-f56a1d3c8468 None None] MFA Rules not processed for user `5f76a8c3d04e440b92d12ced18d97941`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:25.751706 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-54697320-2bc5-4641-9f70-f56a1d3c8468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:25.771148 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 833/1663] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Nov 29 20:20:25 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:25.772467 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 831/1664] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:20:25 2021] PUT /identity/v3/projects/22945ef9350e4d8a8d126bb32f4cd2b8/users/6213b9aa225c4f8697d018684c08f025/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:25.773154 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54697320-2bc5-4641-9f70-f56a1d3c8468 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:25.774039 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb79b9-c3a8-4141-8938-9313680da99b admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:25.802202 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54697320-2bc5-4641-9f70-f56a1d3c8468 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:25.889378 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb79b9-c3a8-4141-8938-9313680da99b admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:25.893863 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eab266-25a2-46e3-a5b7-41ef44bfd5c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:25.894836 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eab266-25a2-46e3-a5b7-41ef44bfd5c5 service cinder] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:25.895505 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eab266-25a2-46e3-a5b7-41ef44bfd5c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:25.895777 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eab266-25a2-46e3-a5b7-41ef44bfd5c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:25.897191 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3b701-b1b0-4fa3-b217-57db0d8c1f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:25.898610 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3b701-b1b0-4fa3-b217-57db0d8c1f99 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:25.898967 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3b701-b1b0-4fa3-b217-57db0d8c1f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:25.899247 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3b701-b1b0-4fa3-b217-57db0d8c1f99 admin admin] PATH_INFO: `/v3/projects/7791fa7a908442f8a659afc3e24bb60c/users/17d7ec23284741dc9357c1e871a6d941/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:25.902461 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce3b701-b1b0-4fa3-b217-57db0d8c1f99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7791fa7a908442f8a659afc3e24bb60c, user_id=17d7ec23284741dc9357c1e871a6d941, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:25.910392 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce3b701-b1b0-4fa3-b217-57db0d8c1f99 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:25.940002 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 834/1665] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:20:25 2021] PUT /identity/v3/projects/7791fa7a908442f8a659afc3e24bb60c/users/17d7ec23284741dc9357c1e871a6d941/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:25.940002 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3b701-b1b0-4fa3-b217-57db0d8c1f99 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:26.036650 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eab266-25a2-46e3-a5b7-41ef44bfd5c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:26.038262 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eab266-25a2-46e3-a5b7-41ef44bfd5c5 service cinder] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:26.062383 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 832/1666] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:20:25 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:20:26.066799 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eab266-25a2-46e3-a5b7-41ef44bfd5c5 service cinder] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:26.070756 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-06eab266-25a2-46e3-a5b7-41ef44bfd5c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:26.088330 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3b701-b1b0-4fa3-b217-57db0d8c1f99 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:26.096130 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acefcf1-375f-4e3f-96f8-7270bf254bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:26.096934 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acefcf1-375f-4e3f-96f8-7270bf254bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:26.097307 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acefcf1-375f-4e3f-96f8-7270bf254bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:26.097694 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acefcf1-375f-4e3f-96f8-7270bf254bf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:26.098825 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acefcf1-375f-4e3f-96f8-7270bf254bf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:26.104258 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acefcf1-375f-4e3f-96f8-7270bf254bf6 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:26.118349 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 835/1667] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:20:25 2021] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:20:26.119821 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea4c08-e2b8-4f09-9b0c-06caa197f888 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:26.120204 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea4c08-e2b8-4f09-9b0c-06caa197f888 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:26.120576 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea4c08-e2b8-4f09-9b0c-06caa197f888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:26.155167 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-77ea4c08-e2b8-4f09-9b0c-06caa197f888 None None] MFA Rules not processed for user `17d7ec23284741dc9357c1e871a6d941`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:26.157968 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-77ea4c08-e2b8-4f09-9b0c-06caa197f888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:26.233149 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eab266-25a2-46e3-a5b7-41ef44bfd5c5 service cinder] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:26.285406 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 836/1668] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:26 2021] POST /identity/v3/auth/tokens => generated 3305 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:26.293168 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea4c08-e2b8-4f09-9b0c-06caa197f888 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:26.318779 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea4c08-e2b8-4f09-9b0c-06caa197f888 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:26.332745 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba526e-1581-4abf-902d-63f15aaee9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:26.333683 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba526e-1581-4abf-902d-63f15aaee9e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:26.333981 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba526e-1581-4abf-902d-63f15aaee9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:26.334236 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba526e-1581-4abf-902d-63f15aaee9e2 admin admin] PATH_INFO: `/v3/projects/22945ef9350e4d8a8d126bb32f4cd2b8/users/6213b9aa225c4f8697d018684c08f025/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:26.338448 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba526e-1581-4abf-902d-63f15aaee9e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22945ef9350e4d8a8d126bb32f4cd2b8, user_id=6213b9aa225c4f8697d018684c08f025, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:26.344715 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba526e-1581-4abf-902d-63f15aaee9e2 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:26.355051 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3f4ec-9f48-461c-88cd-039c632c1764 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcc415af1f5a42febbdbd187e066cf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:26.355722 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3f4ec-9f48-461c-88cd-039c632c1764 service glance] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:26.356005 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3f4ec-9f48-461c-88cd-039c632c1764 service glance] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:26.356310 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3f4ec-9f48-461c-88cd-039c632c1764 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:26.379445 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 837/1669] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:20:26 2021] PUT /identity/v3/projects/22945ef9350e4d8a8d126bb32f4cd2b8/users/6213b9aa225c4f8697d018684c08f025/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:26.379445 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba526e-1581-4abf-902d-63f15aaee9e2 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:26.507896 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba526e-1581-4abf-902d-63f15aaee9e2 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:26.518902 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c17dd-3b70-449e-8885-32717d91017f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:26.519735 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e3f4ec-9f48-461c-88cd-039c632c1764 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:26.521793 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c17dd-3b70-449e-8885-32717d91017f service cinder] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:26.523201 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e3f4ec-9f48-461c-88cd-039c632c1764 service glance] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:26.523342 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c17dd-3b70-449e-8885-32717d91017f service cinder] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:26.523342 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c17dd-3b70-449e-8885-32717d91017f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:26.553734 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 833/1670] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:20:26 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:20:26.561068 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a649fb7-aa6f-4204-82aa-80e68a534297 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:26.561068 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a649fb7-aa6f-4204-82aa-80e68a534297 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:26.561068 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a649fb7-aa6f-4204-82aa-80e68a534297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:26.642669 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-4a649fb7-aa6f-4204-82aa-80e68a534297 None None] MFA Rules not processed for user `6213b9aa225c4f8697d018684c08f025`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:26.645300 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-4a649fb7-aa6f-4204-82aa-80e68a534297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:26.685822 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c17dd-3b70-449e-8885-32717d91017f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:26.687409 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c17dd-3b70-449e-8885-32717d91017f service cinder] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:26.701842 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 838/1671] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:20:26 2021] GET /identity/v3/auth/tokens => generated 3305 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:20:26.799600 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 834/1672] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:26 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:26.835809 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c17dd-3b70-449e-8885-32717d91017f service cinder] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:26.845968 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c17dd-3b70-449e-8885-32717d91017f service cinder] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:26.853453 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a4ac90-5e99-43b5-b0d2-e357d4248347 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:26.854971 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4ac90-5e99-43b5-b0d2-e357d4248347 service cinder] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:26.855412 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4ac90-5e99-43b5-b0d2-e357d4248347 service cinder] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:26.855856 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a4ac90-5e99-43b5-b0d2-e357d4248347 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:26.869329 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a4ac90-5e99-43b5-b0d2-e357d4248347 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:26.871849 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a4ac90-5e99-43b5-b0d2-e357d4248347 service cinder] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:26.896693 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 839/1673] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:20:26 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:20:27.448884 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a649fb7-aa6f-4204-82aa-80e68a534297 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:27.597617 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193761c-2ed5-4bdb-9e4c-67476a9a5d3c None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:27.598170 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193761c-2ed5-4bdb-9e4c-67476a9a5d3c None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:27.598170 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f193761c-2ed5-4bdb-9e4c-67476a9a5d3c None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:27.600025 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 840/1674] 10.222.0.15 () {54 vars in 912 bytes} [Mon Nov 29 20:20:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:20:27.608542 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d7080-1962-4dd8-9196-5fdb143025c8 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:27.608675 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d7080-1962-4dd8-9196-5fdb143025c8 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:27.608990 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d7080-1962-4dd8-9196-5fdb143025c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:27.644634 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a649fb7-aa6f-4204-82aa-80e68a534297 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:27.659140 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9dc83-230b-4476-ab6e-488b07919d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:27.660057 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9dc83-230b-4476-ab6e-488b07919d6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:27.660342 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9dc83-230b-4476-ab6e-488b07919d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:27.660621 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9dc83-230b-4476-ab6e-488b07919d6b admin admin] PATH_INFO: `/v3/users/2fda63f12ed546528d4d24aea1f439c3` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:27.663513 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c9dc83-230b-4476-ab6e-488b07919d6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fda63f12ed546528d4d24aea1f439c3)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:27.667980 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: WARNING py.warnings [None req-18c9dc83-230b-4476-ab6e-488b07919d6b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 29 20:20:27.667980 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: warnings.warn(msg) Nov 29 20:20:27.667980 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: Nov 29 20:20:27.669232 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c9dc83-230b-4476-ab6e-488b07919d6b admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:27.693873 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-c20d7080-1962-4dd8-9196-5fdb143025c8 None None] MFA Rules not processed for user `821fb4ce82de47ca873fc22d29d4f957`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:27.696718 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-c20d7080-1962-4dd8-9196-5fdb143025c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:27.786109 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-18c9dc83-230b-4476-ab6e-488b07919d6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fda63f12ed546528d4d24aea1f439c3'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:27.806147 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-18c9dc83-230b-4476-ab6e-488b07919d6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fda63f12ed546528d4d24aea1f439c3'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:27.807302 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 841/1675] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Nov 29 20:20:27 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:20:27.808760 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d7080-1962-4dd8-9196-5fdb143025c8 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:27.830605 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-18c9dc83-230b-4476-ab6e-488b07919d6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fda63f12ed546528d4d24aea1f439c3'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:27.837544 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d7080-1962-4dd8-9196-5fdb143025c8 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:27.851368 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107a64a-c605-48b0-b4aa-6bba672396d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:27.852581 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107a64a-c605-48b0-b4aa-6bba672396d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:27.853052 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107a64a-c605-48b0-b4aa-6bba672396d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:27.853596 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3107a64a-c605-48b0-b4aa-6bba672396d2 admin admin] PATH_INFO: `/v3/users/6125deb499c649d0911cf8ccf4bde709` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:27.855042 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107a64a-c605-48b0-b4aa-6bba672396d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6125deb499c649d0911cf8ccf4bde709)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:27.857150 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3107a64a-c605-48b0-b4aa-6bba672396d2 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:27.867328 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-18c9dc83-230b-4476-ab6e-488b07919d6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fda63f12ed546528d4d24aea1f439c3'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:27.875343 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-18c9dc83-230b-4476-ab6e-488b07919d6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fda63f12ed546528d4d24aea1f439c3'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:27.885306 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 835/1676] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:20:27 2021] DELETE /identity/v3/users/2fda63f12ed546528d4d24aea1f439c3 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:27.886950 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9dc83-230b-4476-ab6e-488b07919d6b admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:27.896210 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-18c9dc83-230b-4476-ab6e-488b07919d6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:27.919097 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-3107a64a-c605-48b0-b4aa-6bba672396d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6125deb499c649d0911cf8ccf4bde709'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:27.931153 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-3107a64a-c605-48b0-b4aa-6bba672396d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6125deb499c649d0911cf8ccf4bde709'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:27.952384 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-3107a64a-c605-48b0-b4aa-6bba672396d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6125deb499c649d0911cf8ccf4bde709'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:27.953372 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-3107a64a-c605-48b0-b4aa-6bba672396d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6125deb499c649d0911cf8ccf4bde709'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:27.954128 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-3107a64a-c605-48b0-b4aa-6bba672396d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6125deb499c649d0911cf8ccf4bde709'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:27.982249 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 842/1677] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:20:27 2021] DELETE /identity/v3/users/6125deb499c649d0911cf8ccf4bde709 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:27.982827 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107a64a-c605-48b0-b4aa-6bba672396d2 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:27.985106 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-3107a64a-c605-48b0-b4aa-6bba672396d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:28.013728 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9dc83-230b-4476-ab6e-488b07919d6b admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:28.068633 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5dbe9b-7f87-4809-82bb-7893eca4d090 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:28.069190 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5dbe9b-7f87-4809-82bb-7893eca4d090 service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:28.069470 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5dbe9b-7f87-4809-82bb-7893eca4d090 service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:28.069741 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5dbe9b-7f87-4809-82bb-7893eca4d090 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:28.071592 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-ce5dbe9b-7f87-4809-82bb-7893eca4d090 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:28.081366 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5dbe9b-7f87-4809-82bb-7893eca4d090 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:28.082912 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5dbe9b-7f87-4809-82bb-7893eca4d090 service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:28.092620 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 836/1678] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:20:27 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:20:28.094134 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b3cd2-6a93-41aa-a2cc-a2e1bfcfa9a3 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:28.094421 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b3cd2-6a93-41aa-a2cc-a2e1bfcfa9a3 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:28.094696 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b3cd2-6a93-41aa-a2cc-a2e1bfcfa9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:28.107692 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3107a64a-c605-48b0-b4aa-6bba672396d2 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:28.112649 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878721e6-5b12-4c7b-84f1-1730e3ea8562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:28.113164 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-d44b3cd2-6a93-41aa-a2cc-a2e1bfcfa9a3 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:28.113712 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878721e6-5b12-4c7b-84f1-1730e3ea8562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:28.113994 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878721e6-5b12-4c7b-84f1-1730e3ea8562 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:28.114263 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878721e6-5b12-4c7b-84f1-1730e3ea8562 admin admin] PATH_INFO: `/v3/users/1a6e81bb9c714cf0bda9aef82e6319f4` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:28.114410 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-d44b3cd2-6a93-41aa-a2cc-a2e1bfcfa9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:28.116059 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878721e6-5b12-4c7b-84f1-1730e3ea8562 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a6e81bb9c714cf0bda9aef82e6319f4)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:28.118549 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878721e6-5b12-4c7b-84f1-1730e3ea8562 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:28.122784 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 837/1679] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:28.124359 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e9d54-7057-41a1-8e1d-0481f56a8652 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:28.124726 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e9d54-7057-41a1-8e1d-0481f56a8652 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:28.125006 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e9d54-7057-41a1-8e1d-0481f56a8652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:28.145415 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-361e9d54-7057-41a1-8e1d-0481f56a8652 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:28.146625 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-361e9d54-7057-41a1-8e1d-0481f56a8652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:28.157621 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 838/1680] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:28.164882 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e9d54-7057-41a1-8e1d-0481f56a8652 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:28.166314 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-361e9d54-7057-41a1-8e1d-0481f56a8652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:28.188054 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e9d54-7057-41a1-8e1d-0481f56a8652 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:28.195737 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-878721e6-5b12-4c7b-84f1-1730e3ea8562 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a6e81bb9c714cf0bda9aef82e6319f4'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:28.197581 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237116e-37ee-4042-ad2a-58e6b7cfb67f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:28.198265 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237116e-37ee-4042-ad2a-58e6b7cfb67f service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:28.198551 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237116e-37ee-4042-ad2a-58e6b7cfb67f service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:28.198818 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237116e-37ee-4042-ad2a-58e6b7cfb67f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:28.208147 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-878721e6-5b12-4c7b-84f1-1730e3ea8562 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a6e81bb9c714cf0bda9aef82e6319f4'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:28.224668 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d237116e-37ee-4042-ad2a-58e6b7cfb67f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:28.224992 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-878721e6-5b12-4c7b-84f1-1730e3ea8562 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a6e81bb9c714cf0bda9aef82e6319f4'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:28.226307 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-878721e6-5b12-4c7b-84f1-1730e3ea8562 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a6e81bb9c714cf0bda9aef82e6319f4'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:28.226517 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d237116e-37ee-4042-ad2a-58e6b7cfb67f service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:28.227173 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-878721e6-5b12-4c7b-84f1-1730e3ea8562 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a6e81bb9c714cf0bda9aef82e6319f4'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:28.251257 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 839/1681] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:20:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:20:28.252151 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 843/1682] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:20:27 2021] DELETE /identity/v3/users/1a6e81bb9c714cf0bda9aef82e6319f4 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:28.256989 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ceb12-0aaf-4222-81a2-06e4682e5f0e None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:28.257409 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ceb12-0aaf-4222-81a2-06e4682e5f0e None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:28.258886 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ceb12-0aaf-4222-81a2-06e4682e5f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:28.292702 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-100ceb12-0aaf-4222-81a2-06e4682e5f0e None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:28.298922 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-100ceb12-0aaf-4222-81a2-06e4682e5f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:28.322963 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878721e6-5b12-4c7b-84f1-1730e3ea8562 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:28.327244 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-878721e6-5b12-4c7b-84f1-1730e3ea8562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:28.425226 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 840/1683] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:28 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:28.479993 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878721e6-5b12-4c7b-84f1-1730e3ea8562 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:28.497524 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae23d04-8a81-47e3-b5c4-914cb6b067dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:28.500739 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae23d04-8a81-47e3-b5c4-914cb6b067dd service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:28.501037 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae23d04-8a81-47e3-b5c4-914cb6b067dd service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:28.501316 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae23d04-8a81-47e3-b5c4-914cb6b067dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:28.504459 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-4ae23d04-8a81-47e3-b5c4-914cb6b067dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:28.520287 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae23d04-8a81-47e3-b5c4-914cb6b067dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:28.522079 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ceb12-0aaf-4222-81a2-06e4682e5f0e None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:28.522586 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae23d04-8a81-47e3-b5c4-914cb6b067dd service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:28.536289 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ceb12-0aaf-4222-81a2-06e4682e5f0e None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:28.547720 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98fabb-d467-4789-b6fd-42881343cfb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:28.548769 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98fabb-d467-4789-b6fd-42881343cfb2 service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:28.549308 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98fabb-d467-4789-b6fd-42881343cfb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:28.551359 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98fabb-d467-4789-b6fd-42881343cfb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:28.558909 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 844/1684] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:20:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:20:28.584499 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98fabb-d467-4789-b6fd-42881343cfb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:28.586297 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98fabb-d467-4789-b6fd-42881343cfb2 service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:28.626986 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 841/1685] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:20:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 29 20:20:29.601527 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae23d04-8a81-47e3-b5c4-914cb6b067dd service neutron] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:29.603660 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-4ae23d04-8a81-47e3-b5c4-914cb6b067dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:29.685054 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae23d04-8a81-47e3-b5c4-914cb6b067dd service neutron] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:29.693608 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da2fb1-5c27-4b27-9f51-d875a92f3377 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b954c18d7e9349e899f4c1cd42b89166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:29.694797 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da2fb1-5c27-4b27-9f51-d875a92f3377 service placement] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:29.695289 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da2fb1-5c27-4b27-9f51-d875a92f3377 service placement] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:29.695668 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da2fb1-5c27-4b27-9f51-d875a92f3377 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:29.697893 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-f6da2fb1-5c27-4b27-9f51-d875a92f3377 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:29.716396 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da2fb1-5c27-4b27-9f51-d875a92f3377 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:29.718344 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da2fb1-5c27-4b27-9f51-d875a92f3377 service placement] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:29.730926 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 845/1686] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:20:29 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:20:29.941366 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98fabb-d467-4789-b6fd-42881343cfb2 service neutron] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:29.943174 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-4a98fabb-d467-4789-b6fd-42881343cfb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:29.963696 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98fabb-d467-4789-b6fd-42881343cfb2 service neutron] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:29.974677 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f6db1-40e6-496e-b61d-559bc79e3711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:29.979244 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f6db1-40e6-496e-b61d-559bc79e3711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:29.979552 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f6db1-40e6-496e-b61d-559bc79e3711 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:29.979807 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f6db1-40e6-496e-b61d-559bc79e3711 admin admin] PATH_INFO: `/v3/projects/1fcc3a49491a488dadee049f6143ff91` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:29.981168 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f6db1-40e6-496e-b61d-559bc79e3711 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fcc3a49491a488dadee049f6143ff91)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:29.983166 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f6db1-40e6-496e-b61d-559bc79e3711 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:30.109446 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-f74f6db1-40e6-496e-b61d-559bc79e3711 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fcc3a49491a488dadee049f6143ff91', 'request_id': 'req-f74f6db1-40e6-496e-b61d-559bc79e3711'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:30.134941 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-f74f6db1-40e6-496e-b61d-559bc79e3711 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fcc3a49491a488dadee049f6143ff91', 'request_id': 'req-f74f6db1-40e6-496e-b61d-559bc79e3711'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:30.156693 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-f74f6db1-40e6-496e-b61d-559bc79e3711 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fcc3a49491a488dadee049f6143ff91', 'request_id': 'req-f74f6db1-40e6-496e-b61d-559bc79e3711'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:30.196884 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-f74f6db1-40e6-496e-b61d-559bc79e3711 admin admin] The token cache is being invalidate because project 1fcc3a49491a488dadee049f6143ff91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:20:30.199352 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-f74f6db1-40e6-496e-b61d-559bc79e3711 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:30.201730 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-f74f6db1-40e6-496e-b61d-559bc79e3711 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:30.205215 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 842/1687] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:20:29 2021] DELETE /identity/v3/projects/1fcc3a49491a488dadee049f6143ff91 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:30.210269 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da2fb1-5c27-4b27-9f51-d875a92f3377 service placement] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:30.230397 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da2fb1-5c27-4b27-9f51-d875a92f3377 service placement] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:30.287429 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f6db1-40e6-496e-b61d-559bc79e3711 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:30.290054 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-f74f6db1-40e6-496e-b61d-559bc79e3711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:30.374293 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44d89b-0528-4953-bca5-3c00cba4fac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:30.376418 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44d89b-0528-4953-bca5-3c00cba4fac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:30.378398 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44d89b-0528-4953-bca5-3c00cba4fac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:30.378619 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44d89b-0528-4953-bca5-3c00cba4fac1 admin admin] PATH_INFO: `/v3/users/17d7ec23284741dc9357c1e871a6d941` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:30.382355 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc44d89b-0528-4953-bca5-3c00cba4fac1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17d7ec23284741dc9357c1e871a6d941)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:30.386944 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc44d89b-0528-4953-bca5-3c00cba4fac1 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:30.457365 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f6db1-40e6-496e-b61d-559bc79e3711 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:30.469013 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55064118-8344-41da-bcd1-2b4bef412c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:30.469945 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55064118-8344-41da-bcd1-2b4bef412c81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:30.470222 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55064118-8344-41da-bcd1-2b4bef412c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:30.470678 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55064118-8344-41da-bcd1-2b4bef412c81 admin admin] PATH_INFO: `/v3/projects/d86c721ef418486daa857e8b283ed5fa` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:30.474461 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55064118-8344-41da-bcd1-2b4bef412c81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d86c721ef418486daa857e8b283ed5fa)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:30.476653 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55064118-8344-41da-bcd1-2b4bef412c81 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:30.498862 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-cc44d89b-0528-4953-bca5-3c00cba4fac1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17d7ec23284741dc9357c1e871a6d941'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:30.516183 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-cc44d89b-0528-4953-bca5-3c00cba4fac1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17d7ec23284741dc9357c1e871a6d941'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:30.568659 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-cc44d89b-0528-4953-bca5-3c00cba4fac1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17d7ec23284741dc9357c1e871a6d941'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:30.572287 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-cc44d89b-0528-4953-bca5-3c00cba4fac1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17d7ec23284741dc9357c1e871a6d941'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:30.574589 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-cc44d89b-0528-4953-bca5-3c00cba4fac1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17d7ec23284741dc9357c1e871a6d941'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:30.612843 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 846/1688] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:20:30 2021] DELETE /identity/v3/users/17d7ec23284741dc9357c1e871a6d941 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:30.618028 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-55064118-8344-41da-bcd1-2b4bef412c81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd86c721ef418486daa857e8b283ed5fa', 'request_id': 'req-55064118-8344-41da-bcd1-2b4bef412c81'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:30.638555 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-55064118-8344-41da-bcd1-2b4bef412c81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd86c721ef418486daa857e8b283ed5fa', 'request_id': 'req-55064118-8344-41da-bcd1-2b4bef412c81'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:30.678498 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-55064118-8344-41da-bcd1-2b4bef412c81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd86c721ef418486daa857e8b283ed5fa', 'request_id': 'req-55064118-8344-41da-bcd1-2b4bef412c81'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:30.714227 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-55064118-8344-41da-bcd1-2b4bef412c81 admin admin] The token cache is being invalidate because project d86c721ef418486daa857e8b283ed5fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:20:30.716542 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-55064118-8344-41da-bcd1-2b4bef412c81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:30.718530 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-55064118-8344-41da-bcd1-2b4bef412c81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:30.725503 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 843/1689] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:20:30 2021] DELETE /identity/v3/projects/d86c721ef418486daa857e8b283ed5fa => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:30.729619 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44d89b-0528-4953-bca5-3c00cba4fac1 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:30.731177 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-cc44d89b-0528-4953-bca5-3c00cba4fac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:30.878438 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44d89b-0528-4953-bca5-3c00cba4fac1 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:30.887253 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1158839b-dd57-4785-af71-523a393f1d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:30.888419 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158839b-dd57-4785-af71-523a393f1d4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:30.888847 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158839b-dd57-4785-af71-523a393f1d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:30.889284 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1158839b-dd57-4785-af71-523a393f1d4a admin admin] PATH_INFO: `/v3/users/6213b9aa225c4f8697d018684c08f025` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:30.891250 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1158839b-dd57-4785-af71-523a393f1d4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6213b9aa225c4f8697d018684c08f025)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:30.894872 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1158839b-dd57-4785-af71-523a393f1d4a admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:31.020430 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-1158839b-dd57-4785-af71-523a393f1d4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6213b9aa225c4f8697d018684c08f025'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:31.036570 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-1158839b-dd57-4785-af71-523a393f1d4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6213b9aa225c4f8697d018684c08f025'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:31.062882 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-1158839b-dd57-4785-af71-523a393f1d4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6213b9aa225c4f8697d018684c08f025'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:31.066238 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-1158839b-dd57-4785-af71-523a393f1d4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6213b9aa225c4f8697d018684c08f025'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:31.067008 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-1158839b-dd57-4785-af71-523a393f1d4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6213b9aa225c4f8697d018684c08f025'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:31.092413 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 847/1690] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:20:30 2021] DELETE /identity/v3/users/6213b9aa225c4f8697d018684c08f025 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:31.231314 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55064118-8344-41da-bcd1-2b4bef412c81 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:31.234501 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-55064118-8344-41da-bcd1-2b4bef412c81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:31.439499 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55064118-8344-41da-bcd1-2b4bef412c81 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:31.565155 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f69ad-beec-4d65-9b1d-ee0870cf2dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:31.568804 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f69ad-beec-4d65-9b1d-ee0870cf2dde admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:31.569101 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f69ad-beec-4d65-9b1d-ee0870cf2dde admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:31.569844 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f69ad-beec-4d65-9b1d-ee0870cf2dde admin admin] PATH_INFO: `/v3/projects/8217a6b82c7b4d45b801489c7cc7829d` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:31.572407 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f69ad-beec-4d65-9b1d-ee0870cf2dde admin admin] RBAC: Authorizing `identity:delete_project(project_id=8217a6b82c7b4d45b801489c7cc7829d)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:31.575868 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f69ad-beec-4d65-9b1d-ee0870cf2dde admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:31.692772 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-c08f69ad-beec-4d65-9b1d-ee0870cf2dde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8217a6b82c7b4d45b801489c7cc7829d', 'request_id': 'req-c08f69ad-beec-4d65-9b1d-ee0870cf2dde'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:31.714419 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-c08f69ad-beec-4d65-9b1d-ee0870cf2dde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8217a6b82c7b4d45b801489c7cc7829d', 'request_id': 'req-c08f69ad-beec-4d65-9b1d-ee0870cf2dde'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:31.747282 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1158839b-dd57-4785-af71-523a393f1d4a admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:31.748779 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-c08f69ad-beec-4d65-9b1d-ee0870cf2dde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8217a6b82c7b4d45b801489c7cc7829d', 'request_id': 'req-c08f69ad-beec-4d65-9b1d-ee0870cf2dde'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:31.749558 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-1158839b-dd57-4785-af71-523a393f1d4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:31.778262 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1158839b-dd57-4785-af71-523a393f1d4a admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:31.784795 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-c08f69ad-beec-4d65-9b1d-ee0870cf2dde admin admin] The token cache is being invalidate because project 8217a6b82c7b4d45b801489c7cc7829d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:20:31.787017 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-c08f69ad-beec-4d65-9b1d-ee0870cf2dde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:31.788173 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-c08f69ad-beec-4d65-9b1d-ee0870cf2dde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:31.794422 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 844/1691] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:20:31 2021] DELETE /identity/v3/projects/8217a6b82c7b4d45b801489c7cc7829d => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:20:31.799990 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca25c90-1504-49e1-93e6-47d79c55afcf None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:31.800508 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca25c90-1504-49e1-93e6-47d79c55afcf None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:31.801000 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca25c90-1504-49e1-93e6-47d79c55afcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:31.833880 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-9ca25c90-1504-49e1-93e6-47d79c55afcf None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:31.835186 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-9ca25c90-1504-49e1-93e6-47d79c55afcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:31.922884 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 845/1692] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:31.932979 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922039e-1bea-478b-8dcf-ddfc3aba55be None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:31.932979 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922039e-1bea-478b-8dcf-ddfc3aba55be None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:31.934108 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72daa98-bdd1-42b1-b4a0-2f4a7009def3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:31.934884 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72daa98-bdd1-42b1-b4a0-2f4a7009def3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:31.935176 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72daa98-bdd1-42b1-b4a0-2f4a7009def3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:31.935468 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72daa98-bdd1-42b1-b4a0-2f4a7009def3 admin admin] PATH_INFO: `/v3/projects/7791fa7a908442f8a659afc3e24bb60c` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:31.939696 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4922039e-1bea-478b-8dcf-ddfc3aba55be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:31.940997 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72daa98-bdd1-42b1-b4a0-2f4a7009def3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7791fa7a908442f8a659afc3e24bb60c)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:31.942051 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: WARNING py.warnings [None req-f72daa98-bdd1-42b1-b4a0-2f4a7009def3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Nov 29 20:20:31.942051 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: warnings.warn(msg) Nov 29 20:20:31.942051 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: Nov 29 20:20:31.950009 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72daa98-bdd1-42b1-b4a0-2f4a7009def3 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:32.014763 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-4922039e-1bea-478b-8dcf-ddfc3aba55be None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:32.018103 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-4922039e-1bea-478b-8dcf-ddfc3aba55be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:32.043815 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 846/1693] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:20:32.047224 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922039e-1bea-478b-8dcf-ddfc3aba55be None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:32.070732 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4922039e-1bea-478b-8dcf-ddfc3aba55be None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:32.079098 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-f72daa98-bdd1-42b1-b4a0-2f4a7009def3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7791fa7a908442f8a659afc3e24bb60c', 'request_id': 'req-f72daa98-bdd1-42b1-b4a0-2f4a7009def3'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:32.099341 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-f72daa98-bdd1-42b1-b4a0-2f4a7009def3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7791fa7a908442f8a659afc3e24bb60c', 'request_id': 'req-f72daa98-bdd1-42b1-b4a0-2f4a7009def3'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:32.107035 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-f72daa98-bdd1-42b1-b4a0-2f4a7009def3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7791fa7a908442f8a659afc3e24bb60c', 'request_id': 'req-f72daa98-bdd1-42b1-b4a0-2f4a7009def3'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:32.127372 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-f72daa98-bdd1-42b1-b4a0-2f4a7009def3 admin admin] The token cache is being invalidate because project 7791fa7a908442f8a659afc3e24bb60c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:20:32.127761 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-f72daa98-bdd1-42b1-b4a0-2f4a7009def3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:32.128990 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-f72daa98-bdd1-42b1-b4a0-2f4a7009def3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:32.142496 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 848/1694] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:20:31 2021] DELETE /identity/v3/projects/7791fa7a908442f8a659afc3e24bb60c => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:20:32.149586 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec40ec-780d-47d4-812c-e6c0863aef9c None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:32.149931 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec40ec-780d-47d4-812c-e6c0863aef9c None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:32.150192 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec40ec-780d-47d4-812c-e6c0863aef9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:32.197191 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-80ec40ec-780d-47d4-812c-e6c0863aef9c None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:32.201301 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-80ec40ec-780d-47d4-812c-e6c0863aef9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:32.262252 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1b208-3e76-444d-8eef-4b33bb3eea98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:32.264875 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1b208-3e76-444d-8eef-4b33bb3eea98 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:32.268208 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1b208-3e76-444d-8eef-4b33bb3eea98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:32.269490 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1b208-3e76-444d-8eef-4b33bb3eea98 admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:32.271623 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d1b208-3e76-444d-8eef-4b33bb3eea98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:20:32.276532 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d1b208-3e76-444d-8eef-4b33bb3eea98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:32.285637 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d1b208-3e76-444d-8eef-4b33bb3eea98 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:32.343790 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 847/1695] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:20:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:20:32.350217 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1b208-3e76-444d-8eef-4b33bb3eea98 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:32.354484 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-12d1b208-3e76-444d-8eef-4b33bb3eea98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:32.400838 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1b208-3e76-444d-8eef-4b33bb3eea98 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:32.414734 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 849/1696] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:32.424482 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec40ec-780d-47d4-812c-e6c0863aef9c None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:32.426131 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-80ec40ec-780d-47d4-812c-e6c0863aef9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:32.448455 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec40ec-780d-47d4-812c-e6c0863aef9c None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:32.461935 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd0c38-0a0e-4dc2-bd85-f1b2b0e605f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:32.462615 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd0c38-0a0e-4dc2-bd85-f1b2b0e605f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:32.462922 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd0c38-0a0e-4dc2-bd85-f1b2b0e605f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:32.463203 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd0c38-0a0e-4dc2-bd85-f1b2b0e605f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:32.463922 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd0c38-0a0e-4dc2-bd85-f1b2b0e605f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:32.465965 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f445c-5002-4175-b415-d1713888317b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:32.466838 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f445c-5002-4175-b415-d1713888317b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:32.467380 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f445c-5002-4175-b415-d1713888317b admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:32.467975 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f445c-5002-4175-b415-d1713888317b admin admin] PATH_INFO: `/v3/projects/22945ef9350e4d8a8d126bb32f4cd2b8` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:32.468967 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f445c-5002-4175-b415-d1713888317b admin admin] RBAC: Authorizing `identity:delete_project(project_id=22945ef9350e4d8a8d126bb32f4cd2b8)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:32.470931 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026f445c-5002-4175-b415-d1713888317b admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:32.493226 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd0c38-0a0e-4dc2-bd85-f1b2b0e605f0 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:32.588935 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 848/1697] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:20:32 2021] POST /identity/v3/projects => generated 373 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:20:32.588935 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7d0be-f683-4f2a-8ee9-42ed6e2d9a9c None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:32.588935 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7d0be-f683-4f2a-8ee9-42ed6e2d9a9c None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:32.588935 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7d0be-f683-4f2a-8ee9-42ed6e2d9a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:32.591619 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-026f445c-5002-4175-b415-d1713888317b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22945ef9350e4d8a8d126bb32f4cd2b8', 'request_id': 'req-026f445c-5002-4175-b415-d1713888317b'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:32.611244 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-026f445c-5002-4175-b415-d1713888317b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22945ef9350e4d8a8d126bb32f4cd2b8', 'request_id': 'req-026f445c-5002-4175-b415-d1713888317b'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:32.623687 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-026f445c-5002-4175-b415-d1713888317b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22945ef9350e4d8a8d126bb32f4cd2b8', 'request_id': 'req-026f445c-5002-4175-b415-d1713888317b'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:32.651454 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-d2c7d0be-f683-4f2a-8ee9-42ed6e2d9a9c None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:32.652992 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-d2c7d0be-f683-4f2a-8ee9-42ed6e2d9a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:32.653722 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-026f445c-5002-4175-b415-d1713888317b admin admin] The token cache is being invalidate because project 22945ef9350e4d8a8d126bb32f4cd2b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:20:32.654080 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-026f445c-5002-4175-b415-d1713888317b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:32.655246 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-026f445c-5002-4175-b415-d1713888317b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:32.660816 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 850/1698] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:20:32 2021] DELETE /identity/v3/projects/22945ef9350e4d8a8d126bb32f4cd2b8 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:20:32.661688 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f445c-5002-4175-b415-d1713888317b admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:32.666010 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-026f445c-5002-4175-b415-d1713888317b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:32.829676 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 849/1699] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:32.832614 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26cf26-f912-42eb-9cdf-6d55818891cd None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:32.833875 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26cf26-f912-42eb-9cdf-6d55818891cd None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:32.834295 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee26cf26-f912-42eb-9cdf-6d55818891cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:32.873011 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-ee26cf26-f912-42eb-9cdf-6d55818891cd None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:32.880633 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-ee26cf26-f912-42eb-9cdf-6d55818891cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:32.901932 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 850/1700] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:32 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:32.903219 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26cf26-f912-42eb-9cdf-6d55818891cd None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:32.904913 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f445c-5002-4175-b415-d1713888317b admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:32.926128 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202e841-f163-43bf-a802-649c733dee79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:32.927119 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202e841-f163-43bf-a802-649c733dee79 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:32.927608 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202e841-f163-43bf-a802-649c733dee79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:32.927737 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee26cf26-f912-42eb-9cdf-6d55818891cd None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:32.928234 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202e841-f163-43bf-a802-649c733dee79 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:32.929185 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7202e841-f163-43bf-a802-649c733dee79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:32.931697 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7202e841-f163-43bf-a802-649c733dee79 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:32.953465 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e9d02-6774-4e67-a95b-e75d34195b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:32.954146 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e9d02-6774-4e67-a95b-e75d34195b45 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:32.955144 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e9d02-6774-4e67-a95b-e75d34195b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:32.955428 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e9d02-6774-4e67-a95b-e75d34195b45 admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:32.956192 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e9d02-6774-4e67-a95b-e75d34195b45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:20:32.956498 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e9d02-6774-4e67-a95b-e75d34195b45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:32.958144 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0e9d02-6774-4e67-a95b-e75d34195b45 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:33.001019 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 851/1701] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:20:32 2021] POST /identity/v3/users => generated 287 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:20:33.002960 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291872f7-61bf-460d-9ae2-61951e4437b0 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:33.004157 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291872f7-61bf-460d-9ae2-61951e4437b0 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:33.005138 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291872f7-61bf-460d-9ae2-61951e4437b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:33.026977 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 851/1702] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:20:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:20:33.030645 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e9d02-6774-4e67-a95b-e75d34195b45 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:33.035928 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-291872f7-61bf-460d-9ae2-61951e4437b0 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:33.037517 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-291872f7-61bf-460d-9ae2-61951e4437b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:33.048056 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 852/1703] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:33 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:33.051105 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291872f7-61bf-460d-9ae2-61951e4437b0 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:33.057354 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e9d02-6774-4e67-a95b-e75d34195b45 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:33.061170 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291872f7-61bf-460d-9ae2-61951e4437b0 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:33.064201 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816272b2-7eec-4077-88d4-1ded2d7a5493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:33.064883 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816272b2-7eec-4077-88d4-1ded2d7a5493 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:33.065308 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816272b2-7eec-4077-88d4-1ded2d7a5493 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:33.065587 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816272b2-7eec-4077-88d4-1ded2d7a5493 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:33.066506 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816272b2-7eec-4077-88d4-1ded2d7a5493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:33.067054 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7a9cb-bfa0-4455-bfb0-862e6e341e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:33.068090 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7a9cb-bfa0-4455-bfb0-862e6e341e07 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:33.068250 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816272b2-7eec-4077-88d4-1ded2d7a5493 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:33.068548 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7a9cb-bfa0-4455-bfb0-862e6e341e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:33.068912 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7a9cb-bfa0-4455-bfb0-862e6e341e07 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:33.069934 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7a9cb-bfa0-4455-bfb0-862e6e341e07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:33.072388 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7a9cb-bfa0-4455-bfb0-862e6e341e07 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:33.085275 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 852/1704] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:20:33 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:20:33.086494 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816272b2-7eec-4077-88d4-1ded2d7a5493 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:33.098207 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816272b2-7eec-4077-88d4-1ded2d7a5493 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:33.104737 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e5a49-2b2c-4f3e-8ab7-9e879ee45b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:33.105476 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e5a49-2b2c-4f3e-8ab7-9e879ee45b73 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:33.105762 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e5a49-2b2c-4f3e-8ab7-9e879ee45b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:33.106035 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20e5a49-2b2c-4f3e-8ab7-9e879ee45b73 admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:33.107547 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20e5a49-2b2c-4f3e-8ab7-9e879ee45b73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:20:33.107955 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20e5a49-2b2c-4f3e-8ab7-9e879ee45b73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:33.109767 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20e5a49-2b2c-4f3e-8ab7-9e879ee45b73 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:33.116857 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 853/1705] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:20:33 2021] POST /identity/v3/projects => generated 365 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:20:33.118048 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7a9cb-bfa0-4455-bfb0-862e6e341e07 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:33.127244 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 853/1706] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:20:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:20:33.128527 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e5a49-2b2c-4f3e-8ab7-9e879ee45b73 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:33.145309 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20e5a49-2b2c-4f3e-8ab7-9e879ee45b73 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:33.231888 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7a9cb-bfa0-4455-bfb0-862e6e341e07 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:33.245292 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293b180-58f7-4b7a-8ca8-02030c9a8a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:33.246390 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293b180-58f7-4b7a-8ca8-02030c9a8a42 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:33.248821 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293b180-58f7-4b7a-8ca8-02030c9a8a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:33.249461 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293b180-58f7-4b7a-8ca8-02030c9a8a42 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:33.250447 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c293b180-58f7-4b7a-8ca8-02030c9a8a42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:33.257420 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c293b180-58f7-4b7a-8ca8-02030c9a8a42 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:33.257656 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b892ed5-bb78-470a-95c6-d42640ac06f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:33.258394 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b892ed5-bb78-470a-95c6-d42640ac06f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:33.258672 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b892ed5-bb78-470a-95c6-d42640ac06f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:33.258970 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b892ed5-bb78-470a-95c6-d42640ac06f8 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:33.259692 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b892ed5-bb78-470a-95c6-d42640ac06f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:33.261941 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b892ed5-bb78-470a-95c6-d42640ac06f8 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:33.285233 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 854/1707] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:20:33 2021] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:20:33.286555 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293b180-58f7-4b7a-8ca8-02030c9a8a42 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:33.310463 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293b180-58f7-4b7a-8ca8-02030c9a8a42 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:33.321168 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 854/1708] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:20:33 2021] POST /identity/v3/users => generated 283 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:20:33.323101 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b892ed5-bb78-470a-95c6-d42640ac06f8 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:33.327166 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5cddcb-6720-441f-afd2-27094f5c4ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:33.328292 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5cddcb-6720-441f-afd2-27094f5c4ced admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:33.328654 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5cddcb-6720-441f-afd2-27094f5c4ced admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:33.329013 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5cddcb-6720-441f-afd2-27094f5c4ced admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:33.329780 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5cddcb-6720-441f-afd2-27094f5c4ced admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:33.332013 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5cddcb-6720-441f-afd2-27094f5c4ced admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:33.354892 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b892ed5-bb78-470a-95c6-d42640ac06f8 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:33.372780 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a833fa-fd22-4b10-9fe5-2a4556a77d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:33.375042 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a833fa-fd22-4b10-9fe5-2a4556a77d1b admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:33.375329 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a833fa-fd22-4b10-9fe5-2a4556a77d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:33.375602 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a833fa-fd22-4b10-9fe5-2a4556a77d1b admin admin] PATH_INFO: `/v3/projects/a78ec33eb7764617864b019f22ae49f6/users/8dc249f525ac4b74a033158838bd2257/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:33.420422 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a833fa-fd22-4b10-9fe5-2a4556a77d1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a78ec33eb7764617864b019f22ae49f6, user_id=8dc249f525ac4b74a033158838bd2257, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:33.424393 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a833fa-fd22-4b10-9fe5-2a4556a77d1b admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:33.439124 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 855/1709] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:20:33 2021] POST /identity/v3/projects => generated 383 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:20:33.445688 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5cddcb-6720-441f-afd2-27094f5c4ced admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:33.454966 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 855/1710] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:20:33 2021] PUT /identity/v3/projects/a78ec33eb7764617864b019f22ae49f6/users/8dc249f525ac4b74a033158838bd2257/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:33.456176 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a833fa-fd22-4b10-9fe5-2a4556a77d1b admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:33.576206 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a833fa-fd22-4b10-9fe5-2a4556a77d1b admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:33.589592 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213bf690-2e34-46f1-8e7e-6d3765454f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:33.591988 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213bf690-2e34-46f1-8e7e-6d3765454f17 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:33.609198 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5cddcb-6720-441f-afd2-27094f5c4ced admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:33.615193 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb777cd6-bc41-4aa5-a634-39a27944f146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:33.615406 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213bf690-2e34-46f1-8e7e-6d3765454f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:33.615531 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213bf690-2e34-46f1-8e7e-6d3765454f17 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:33.616392 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb777cd6-bc41-4aa5-a634-39a27944f146 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:33.616876 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb777cd6-bc41-4aa5-a634-39a27944f146 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:33.617444 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb777cd6-bc41-4aa5-a634-39a27944f146 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:33.618380 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb777cd6-bc41-4aa5-a634-39a27944f146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:33.620063 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213bf690-2e34-46f1-8e7e-6d3765454f17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:33.620394 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb777cd6-bc41-4aa5-a634-39a27944f146 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:33.629935 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213bf690-2e34-46f1-8e7e-6d3765454f17 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:33.654175 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 856/1711] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:20:33 2021] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:20:33.657682 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81823f-780f-4169-8ebc-fa0ec8487f1c None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:33.658133 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81823f-780f-4169-8ebc-fa0ec8487f1c None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:33.658478 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81823f-780f-4169-8ebc-fa0ec8487f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:33.677470 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 856/1712] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:20:33 2021] POST /identity/v3/users => generated 292 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:20:33.682775 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213bf690-2e34-46f1-8e7e-6d3765454f17 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:33.707800 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213bf690-2e34-46f1-8e7e-6d3765454f17 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:33.718949 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-0e81823f-780f-4169-8ebc-fa0ec8487f1c None None] MFA Rules not processed for user `8dc249f525ac4b74a033158838bd2257`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:33.720577 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-0e81823f-780f-4169-8ebc-fa0ec8487f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:33.721467 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7a83e-44d5-46ac-82fc-7c94ef07ab7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:33.722322 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7a83e-44d5-46ac-82fc-7c94ef07ab7c admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:33.722712 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7a83e-44d5-46ac-82fc-7c94ef07ab7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:33.723026 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7a83e-44d5-46ac-82fc-7c94ef07ab7c admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:33.723918 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7a83e-44d5-46ac-82fc-7c94ef07ab7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:33.725699 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7a83e-44d5-46ac-82fc-7c94ef07ab7c admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:33.757073 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 857/1713] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:20:33 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:20:33.758148 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7a83e-44d5-46ac-82fc-7c94ef07ab7c admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:33.780379 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7a83e-44d5-46ac-82fc-7c94ef07ab7c admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:33.797855 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d4cde-e605-4b1f-bc35-e494540c2992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:33.798756 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d4cde-e605-4b1f-bc35-e494540c2992 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:33.799130 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d4cde-e605-4b1f-bc35-e494540c2992 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:33.800043 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d4cde-e605-4b1f-bc35-e494540c2992 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:33.801481 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d4cde-e605-4b1f-bc35-e494540c2992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:33.803803 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d4cde-e605-4b1f-bc35-e494540c2992 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:33.825020 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 858/1714] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:20:33 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:20:33.827005 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d4cde-e605-4b1f-bc35-e494540c2992 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:33.841272 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d4cde-e605-4b1f-bc35-e494540c2992 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:33.861616 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674960d-712d-43ee-ace2-38d905ff2c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:33.864871 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674960d-712d-43ee-ace2-38d905ff2c40 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:33.866688 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674960d-712d-43ee-ace2-38d905ff2c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:33.867162 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3674960d-712d-43ee-ace2-38d905ff2c40 admin admin] PATH_INFO: `/v3/projects/5351de3f92a1462b91649d2031d3fb65/users/9df9dad29feb4036a7947244c48c65b8/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:33.893415 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 857/1715] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:33 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:33.893415 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e81823f-780f-4169-8ebc-fa0ec8487f1c None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:33.922053 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674960d-712d-43ee-ace2-38d905ff2c40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5351de3f92a1462b91649d2031d3fb65, user_id=9df9dad29feb4036a7947244c48c65b8, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:33.930227 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3674960d-712d-43ee-ace2-38d905ff2c40 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:33.931034 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e81823f-780f-4169-8ebc-fa0ec8487f1c None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:33.946126 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeefffbb-37ce-493a-be46-455360cb7bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:33.947242 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefffbb-37ce-493a-be46-455360cb7bcb admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:33.947500 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefffbb-37ce-493a-be46-455360cb7bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:33.947837 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefffbb-37ce-493a-be46-455360cb7bcb admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:33.951299 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeefffbb-37ce-493a-be46-455360cb7bcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:33.954307 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeefffbb-37ce-493a-be46-455360cb7bcb admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:33.961889 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 859/1716] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:20:33 2021] PUT /identity/v3/projects/5351de3f92a1462b91649d2031d3fb65/users/9df9dad29feb4036a7947244c48c65b8/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:33.962910 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674960d-712d-43ee-ace2-38d905ff2c40 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:34.002549 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 858/1717] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:20:33 2021] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:20:34.006034 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a475a-a66d-4389-a180-d363f0402004 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:34.006329 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a475a-a66d-4389-a180-d363f0402004 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:34.006604 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a475a-a66d-4389-a180-d363f0402004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:34.107033 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-a82a475a-a66d-4389-a180-d363f0402004 None None] MFA Rules not processed for user `9df9dad29feb4036a7947244c48c65b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:34.108396 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-a82a475a-a66d-4389-a180-d363f0402004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:34.264127 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 859/1718] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:34 2021] POST /identity/v3/auth/tokens => generated 3232 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:34.264947 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a475a-a66d-4389-a180-d363f0402004 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:34.268257 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3674960d-712d-43ee-ace2-38d905ff2c40 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:34.290889 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d9b32-d344-49cd-9d75-dac26c011bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:34.292052 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d9b32-d344-49cd-9d75-dac26c011bf9 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:34.292052 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d9b32-d344-49cd-9d75-dac26c011bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:34.292250 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d9b32-d344-49cd-9d75-dac26c011bf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:34.293072 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d9b32-d344-49cd-9d75-dac26c011bf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:34.294930 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d9b32-d344-49cd-9d75-dac26c011bf9 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:34.301102 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a475a-a66d-4389-a180-d363f0402004 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:34.319650 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f8a628-8d26-4675-8e73-e1ffb2ec059f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:34.320812 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8a628-8d26-4675-8e73-e1ffb2ec059f admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:34.321189 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8a628-8d26-4675-8e73-e1ffb2ec059f admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:34.321634 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8a628-8d26-4675-8e73-e1ffb2ec059f admin admin] PATH_INFO: `/v3/projects/09baf25f2a3544419809267971c840c2/users/5ba4e06385d64df6a34492862b1f600e/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:34.362170 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f8a628-8d26-4675-8e73-e1ffb2ec059f admin admin] RBAC: Authorizing `identity:create_grant(project_id=09baf25f2a3544419809267971c840c2, user_id=5ba4e06385d64df6a34492862b1f600e, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:34.368595 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f8a628-8d26-4675-8e73-e1ffb2ec059f admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:34.378368 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 860/1719] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:20:33 2021] POST /identity/v3/projects => generated 373 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:20:34.379427 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d9b32-d344-49cd-9d75-dac26c011bf9 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:34.397524 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 860/1720] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:20:34 2021] PUT /identity/v3/projects/09baf25f2a3544419809267971c840c2/users/5ba4e06385d64df6a34492862b1f600e/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:34.398611 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f8a628-8d26-4675-8e73-e1ffb2ec059f admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:34.558289 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f8a628-8d26-4675-8e73-e1ffb2ec059f admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:34.572692 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80b045-6d9e-446b-932c-5a52e01ce912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:34.573835 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80b045-6d9e-446b-932c-5a52e01ce912 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:34.574211 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80b045-6d9e-446b-932c-5a52e01ce912 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:34.574604 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80b045-6d9e-446b-932c-5a52e01ce912 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:34.575470 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb80b045-6d9e-446b-932c-5a52e01ce912 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:34.578177 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb80b045-6d9e-446b-932c-5a52e01ce912 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:34.595676 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d9b32-d344-49cd-9d75-dac26c011bf9 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:34.634607 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 861/1721] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:20:34 2021] POST /identity/v3/users => generated 293 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:20:34.636049 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34262fa0-2ef4-4221-b1ca-51e65907f7ab None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:34.638398 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34262fa0-2ef4-4221-b1ca-51e65907f7ab None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:34.638908 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34262fa0-2ef4-4221-b1ca-51e65907f7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:34.663757 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba359a7-79db-4a11-a3a7-1e2be786bb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:34.664460 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba359a7-79db-4a11-a3a7-1e2be786bb95 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:34.664740 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba359a7-79db-4a11-a3a7-1e2be786bb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:34.665014 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba359a7-79db-4a11-a3a7-1e2be786bb95 admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:34.665769 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba359a7-79db-4a11-a3a7-1e2be786bb95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:34.667917 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba359a7-79db-4a11-a3a7-1e2be786bb95 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:34.709991 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-34262fa0-2ef4-4221-b1ca-51e65907f7ab None None] MFA Rules not processed for user `5ba4e06385d64df6a34492862b1f600e`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:34.713274 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-34262fa0-2ef4-4221-b1ca-51e65907f7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:34.775774 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 861/1722] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:20:34 2021] POST /identity/v3/projects => generated 363 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:20:34.778503 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba359a7-79db-4a11-a3a7-1e2be786bb95 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:34.941704 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 862/1723] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:34 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:34.943030 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34262fa0-2ef4-4221-b1ca-51e65907f7ab None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:34.956609 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34262fa0-2ef4-4221-b1ca-51e65907f7ab None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:35.061209 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba359a7-79db-4a11-a3a7-1e2be786bb95 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:35.085751 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a1447-724b-4733-a438-25d7321cd44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:35.087017 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a1447-724b-4733-a438-25d7321cd44e admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:35.087287 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a1447-724b-4733-a438-25d7321cd44e admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:35.087564 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a1447-724b-4733-a438-25d7321cd44e admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:35.088316 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a1447-724b-4733-a438-25d7321cd44e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:35.090564 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a1447-724b-4733-a438-25d7321cd44e admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:35.113401 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 862/1724] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:20:34 2021] GET /identity/v3/roles => generated 1420 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:20:35.115014 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a1447-724b-4733-a438-25d7321cd44e admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:35.116762 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12914940-f467-4dd3-a75c-5944973f55c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:35.117875 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12914940-f467-4dd3-a75c-5944973f55c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:35.118323 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12914940-f467-4dd3-a75c-5944973f55c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:35.119010 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12914940-f467-4dd3-a75c-5944973f55c0 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:35.121029 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12914940-f467-4dd3-a75c-5944973f55c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:35.123499 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12914940-f467-4dd3-a75c-5944973f55c0 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:35.148758 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a1447-724b-4733-a438-25d7321cd44e admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:35.159222 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95260c81-b8c1-474b-b5a9-f56e88a88cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:35.159464 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95260c81-b8c1-474b-b5a9-f56e88a88cc6 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:35.159645 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95260c81-b8c1-474b-b5a9-f56e88a88cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:35.160570 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95260c81-b8c1-474b-b5a9-f56e88a88cc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:35.160698 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95260c81-b8c1-474b-b5a9-f56e88a88cc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:35.162761 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95260c81-b8c1-474b-b5a9-f56e88a88cc6 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:35.185272 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 863/1725] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:20:34 2021] POST /identity/v3/users => generated 288 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:20:35.185820 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441069be-a302-447a-b826-3ff4d3aba2e2 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:35.186129 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441069be-a302-447a-b826-3ff4d3aba2e2 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:35.186502 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441069be-a302-447a-b826-3ff4d3aba2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:35.224697 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-441069be-a302-447a-b826-3ff4d3aba2e2 None None] MFA Rules not processed for user `19d72c913c2b4442836a991120eec243`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:35.227750 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-441069be-a302-447a-b826-3ff4d3aba2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:35.229050 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 863/1726] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:20:35 2021] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:20:35.230132 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95260c81-b8c1-474b-b5a9-f56e88a88cc6 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:35.352682 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95260c81-b8c1-474b-b5a9-f56e88a88cc6 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:35.359613 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc9b410-8a2d-4572-b3e8-8eb9b5133050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:35.360523 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9b410-8a2d-4572-b3e8-8eb9b5133050 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:35.360798 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9b410-8a2d-4572-b3e8-8eb9b5133050 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:35.361219 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9b410-8a2d-4572-b3e8-8eb9b5133050 admin admin] PATH_INFO: `/v3/projects/d3c399b606864aa384e23e3b35f9ecc3/users/2950f7b85e4c4ac2bd4795428a6af60a/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:35.378893 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc9b410-8a2d-4572-b3e8-8eb9b5133050 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3c399b606864aa384e23e3b35f9ecc3, user_id=2950f7b85e4c4ac2bd4795428a6af60a, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:35.381717 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc9b410-8a2d-4572-b3e8-8eb9b5133050 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:35.410653 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 864/1728] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:20:35 2021] PUT /identity/v3/projects/d3c399b606864aa384e23e3b35f9ecc3/users/2950f7b85e4c4ac2bd4795428a6af60a/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:35.410781 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 864/1728] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Nov 29 20:20:35 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:35.412816 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441069be-a302-447a-b826-3ff4d3aba2e2 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:35.415384 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc9b410-8a2d-4572-b3e8-8eb9b5133050 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:35.456220 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441069be-a302-447a-b826-3ff4d3aba2e2 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:35.662219 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32361a-5c5a-433b-be8c-a1b9d37a7898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:35.663076 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32361a-5c5a-433b-be8c-a1b9d37a7898 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:35.663465 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32361a-5c5a-433b-be8c-a1b9d37a7898 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:35.663842 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32361a-5c5a-433b-be8c-a1b9d37a7898 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:35.664176 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc9b410-8a2d-4572-b3e8-8eb9b5133050 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:35.664772 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f32361a-5c5a-433b-be8c-a1b9d37a7898 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:35.667089 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f32361a-5c5a-433b-be8c-a1b9d37a7898 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:35.678285 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca4016-83bd-4a83-97c5-fffff0a08ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:35.679898 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca4016-83bd-4a83-97c5-fffff0a08ce5 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:35.680179 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca4016-83bd-4a83-97c5-fffff0a08ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:35.680596 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca4016-83bd-4a83-97c5-fffff0a08ce5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:35.681474 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca4016-83bd-4a83-97c5-fffff0a08ce5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:35.684448 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ca4016-83bd-4a83-97c5-fffff0a08ce5 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:35.700953 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 865/1729] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:20:35 2021] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:20:35.703305 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca4016-83bd-4a83-97c5-fffff0a08ce5 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:35.716690 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ca4016-83bd-4a83-97c5-fffff0a08ce5 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:35.730206 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 865/1730] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:20:35 2021] POST /identity/v3/users => generated 298 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:20:35.730935 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32361a-5c5a-433b-be8c-a1b9d37a7898 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:35.734351 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44903849-ff02-42f9-b8f0-74cc97f7c1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:35.735327 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44903849-ff02-42f9-b8f0-74cc97f7c1dd admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:35.735775 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44903849-ff02-42f9-b8f0-74cc97f7c1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:35.736417 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44903849-ff02-42f9-b8f0-74cc97f7c1dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:35.737304 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44903849-ff02-42f9-b8f0-74cc97f7c1dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:35.741392 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44903849-ff02-42f9-b8f0-74cc97f7c1dd admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:35.771682 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 866/1731] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:20:35 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:20:35.774383 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32361a-5c5a-433b-be8c-a1b9d37a7898 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:35.777300 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44903849-ff02-42f9-b8f0-74cc97f7c1dd admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:35.797093 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c56ea2-260b-4eb5-bb0c-6467c1f7b9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:35.798305 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c56ea2-260b-4eb5-bb0c-6467c1f7b9ec admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:35.798588 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c56ea2-260b-4eb5-bb0c-6467c1f7b9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:35.798874 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c56ea2-260b-4eb5-bb0c-6467c1f7b9ec admin admin] PATH_INFO: `/v3/projects/9cd21404dae143f1a2b7c7a95d1953e5/users/4dfff15cb8ff4dd8a22ae90b88f13a45/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:35.804540 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44903849-ff02-42f9-b8f0-74cc97f7c1dd admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:35.832709 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d85e6-8593-45ab-8412-1de791d9afdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:35.833428 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d85e6-8593-45ab-8412-1de791d9afdf admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:35.833707 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d85e6-8593-45ab-8412-1de791d9afdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:35.833983 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765d85e6-8593-45ab-8412-1de791d9afdf admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:35.834746 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765d85e6-8593-45ab-8412-1de791d9afdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:35.840796 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765d85e6-8593-45ab-8412-1de791d9afdf admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:35.851763 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c56ea2-260b-4eb5-bb0c-6467c1f7b9ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cd21404dae143f1a2b7c7a95d1953e5, user_id=4dfff15cb8ff4dd8a22ae90b88f13a45, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:35.858352 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c56ea2-260b-4eb5-bb0c-6467c1f7b9ec admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:35.875219 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 867/1732] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:20:35 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:20:35.878238 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d85e6-8593-45ab-8412-1de791d9afdf admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:35.886306 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-765d85e6-8593-45ab-8412-1de791d9afdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:35.893745 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 866/1733] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:20:35 2021] PUT /identity/v3/projects/9cd21404dae143f1a2b7c7a95d1953e5/users/4dfff15cb8ff4dd8a22ae90b88f13a45/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:35.900318 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c56ea2-260b-4eb5-bb0c-6467c1f7b9ec admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:36.046619 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765d85e6-8593-45ab-8412-1de791d9afdf admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:36.060045 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c56ea2-260b-4eb5-bb0c-6467c1f7b9ec admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:36.096758 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36466dd3-aa99-4f06-a459-4b9186cb0a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:36.097737 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36466dd3-aa99-4f06-a459-4b9186cb0a7a admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:36.098026 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36466dd3-aa99-4f06-a459-4b9186cb0a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:36.100176 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36466dd3-aa99-4f06-a459-4b9186cb0a7a admin admin] PATH_INFO: `/v3/projects/d3c399b606864aa384e23e3b35f9ecc3/users/2950f7b85e4c4ac2bd4795428a6af60a/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:36.107669 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36466dd3-aa99-4f06-a459-4b9186cb0a7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3c399b606864aa384e23e3b35f9ecc3, user_id=2950f7b85e4c4ac2bd4795428a6af60a, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:36.113548 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36466dd3-aa99-4f06-a459-4b9186cb0a7a admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:36.145465 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 867/1734] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:20:35 2021] PUT /identity/v3/projects/d3c399b606864aa384e23e3b35f9ecc3/users/2950f7b85e4c4ac2bd4795428a6af60a/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:36.146421 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36466dd3-aa99-4f06-a459-4b9186cb0a7a admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:36.235388 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3ae54-b261-43cd-a234-d622b4cf7e84 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51fc6fd9b37447bba1759a702b86ce6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:36.236061 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3ae54-b261-43cd-a234-d622b4cf7e84 service swift] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:36.236349 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3ae54-b261-43cd-a234-d622b4cf7e84 service swift] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:36.236627 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3ae54-b261-43cd-a234-d622b4cf7e84 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:36.295734 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36466dd3-aa99-4f06-a459-4b9186cb0a7a admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:36.307514 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab2880-4682-44c1-bb89-b04eb425b049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:36.308731 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab2880-4682-44c1-bb89-b04eb425b049 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:36.309100 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab2880-4682-44c1-bb89-b04eb425b049 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:36.309485 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab2880-4682-44c1-bb89-b04eb425b049 admin admin] PATH_INFO: `/v3/projects/7d9483cd436d44689b4fd17461ff0ef6/users/066d32d333134195b89a25e9957a98a6/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:36.398392 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab2880-4682-44c1-bb89-b04eb425b049 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d9483cd436d44689b4fd17461ff0ef6, user_id=066d32d333134195b89a25e9957a98a6, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:36.401115 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab2880-4682-44c1-bb89-b04eb425b049 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:36.438714 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 868/1735] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:20:36 2021] PUT /identity/v3/projects/7d9483cd436d44689b4fd17461ff0ef6/users/066d32d333134195b89a25e9957a98a6/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:36.439668 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab2880-4682-44c1-bb89-b04eb425b049 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:36.454629 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3ae54-b261-43cd-a234-d622b4cf7e84 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:36.457277 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3ae54-b261-43cd-a234-d622b4cf7e84 service swift] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:36.485768 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 868/1736] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Nov 29 20:20:35 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:20:36.488821 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba7fa2-644f-47cf-8e60-779f6d530fa6 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:36.492226 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba7fa2-644f-47cf-8e60-779f6d530fa6 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:36.492733 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ba7fa2-644f-47cf-8e60-779f6d530fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:36.559217 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-87ba7fa2-644f-47cf-8e60-779f6d530fa6 None None] MFA Rules not processed for user `2950f7b85e4c4ac2bd4795428a6af60a`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:36.562161 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-87ba7fa2-644f-47cf-8e60-779f6d530fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:36.608144 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab2880-4682-44c1-bb89-b04eb425b049 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:36.639735 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982229e-6099-45b4-9b13-70270b61bc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:36.640920 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982229e-6099-45b4-9b13-70270b61bc0e admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:36.641409 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982229e-6099-45b4-9b13-70270b61bc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:36.641882 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982229e-6099-45b4-9b13-70270b61bc0e admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:36.643308 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7982229e-6099-45b4-9b13-70270b61bc0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:36.646445 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7982229e-6099-45b4-9b13-70270b61bc0e admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:36.719167 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 869/1737] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:20:36 2021] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:20:36.721092 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c07d10-c795-4d99-bc05-28ebc0e40785 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:36.725911 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c07d10-c795-4d99-bc05-28ebc0e40785 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:36.727792 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c07d10-c795-4d99-bc05-28ebc0e40785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:36.778537 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-16c07d10-c795-4d99-bc05-28ebc0e40785 None None] MFA Rules not processed for user `682a8ea75de1423199659f6f850d2ade`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:36.779896 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-16c07d10-c795-4d99-bc05-28ebc0e40785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:36.820477 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 869/1738] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:36 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:36.821609 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba7fa2-644f-47cf-8e60-779f6d530fa6 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:36.864164 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ba7fa2-644f-47cf-8e60-779f6d530fa6 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:36.889296 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6934d-795b-4b8c-9b64-b29fd4e34ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:36.890525 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6934d-795b-4b8c-9b64-b29fd4e34ced admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:36.893440 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6934d-795b-4b8c-9b64-b29fd4e34ced admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:36.894247 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6934d-795b-4b8c-9b64-b29fd4e34ced admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:36.895223 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a6934d-795b-4b8c-9b64-b29fd4e34ced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:36.898403 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a6934d-795b-4b8c-9b64-b29fd4e34ced admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:36.916788 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 870/1739] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:20:36 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:20:36.930627 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6934d-795b-4b8c-9b64-b29fd4e34ced admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:36.942221 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-f2a6934d-795b-4b8c-9b64-b29fd4e34ced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:36.970454 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6934d-795b-4b8c-9b64-b29fd4e34ced admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:36.977743 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d2a5e-e3da-48bc-8aa7-b47369c1242b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:36.985124 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d2a5e-e3da-48bc-8aa7-b47369c1242b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:36.985415 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d2a5e-e3da-48bc-8aa7-b47369c1242b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:36.985693 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d2a5e-e3da-48bc-8aa7-b47369c1242b admin admin] PATH_INFO: `/v3/users/d559050deccf44e0a0705b87763d0751` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:36.987779 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d2a5e-e3da-48bc-8aa7-b47369c1242b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d559050deccf44e0a0705b87763d0751)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:36.989867 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d2a5e-e3da-48bc-8aa7-b47369c1242b admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:37.010509 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 870/1740] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:36 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:37.011561 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c07d10-c795-4d99-bc05-28ebc0e40785 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:37.035145 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c07d10-c795-4d99-bc05-28ebc0e40785 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:37.048660 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fda376-382e-40ae-aedc-a2968434f69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:37.049537 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fda376-382e-40ae-aedc-a2968434f69f admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:37.049870 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fda376-382e-40ae-aedc-a2968434f69f admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:37.050149 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fda376-382e-40ae-aedc-a2968434f69f admin admin] PATH_INFO: `/v3/projects/9cd21404dae143f1a2b7c7a95d1953e5/users/4dfff15cb8ff4dd8a22ae90b88f13a45/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:37.053972 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fda376-382e-40ae-aedc-a2968434f69f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cd21404dae143f1a2b7c7a95d1953e5, user_id=4dfff15cb8ff4dd8a22ae90b88f13a45, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:37.057591 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fda376-382e-40ae-aedc-a2968434f69f admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:37.121538 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 871/1741] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:20:37 2021] PUT /identity/v3/projects/9cd21404dae143f1a2b7c7a95d1953e5/users/4dfff15cb8ff4dd8a22ae90b88f13a45/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:37.123592 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fda376-382e-40ae-aedc-a2968434f69f admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:37.128226 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-e6fda376-382e-40ae-aedc-a2968434f69f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:37.134934 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-9c5d2a5e-e3da-48bc-8aa7-b47369c1242b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd559050deccf44e0a0705b87763d0751'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:37.149606 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-9c5d2a5e-e3da-48bc-8aa7-b47369c1242b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd559050deccf44e0a0705b87763d0751'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:37.170486 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-9c5d2a5e-e3da-48bc-8aa7-b47369c1242b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd559050deccf44e0a0705b87763d0751'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:37.208122 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-9c5d2a5e-e3da-48bc-8aa7-b47369c1242b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd559050deccf44e0a0705b87763d0751'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:37.210593 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-9c5d2a5e-e3da-48bc-8aa7-b47369c1242b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd559050deccf44e0a0705b87763d0751'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:37.221120 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 871/1742] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:20:36 2021] DELETE /identity/v3/users/d559050deccf44e0a0705b87763d0751 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:37.225029 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d2a5e-e3da-48bc-8aa7-b47369c1242b admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:37.228318 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-9c5d2a5e-e3da-48bc-8aa7-b47369c1242b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:37.290644 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fda376-382e-40ae-aedc-a2968434f69f admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:37.404323 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d2a5e-e3da-48bc-8aa7-b47369c1242b admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:37.416206 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53905abf-8fbe-41bb-a1af-521bdb28083a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:37.417139 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53905abf-8fbe-41bb-a1af-521bdb28083a admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:37.417463 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53905abf-8fbe-41bb-a1af-521bdb28083a admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:37.417788 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53905abf-8fbe-41bb-a1af-521bdb28083a admin admin] PATH_INFO: `/v3/projects/7d9483cd436d44689b4fd17461ff0ef6/users/066d32d333134195b89a25e9957a98a6/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:37.419824 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3f527-174c-40cb-9042-e67030a5c404 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:37.420488 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3f527-174c-40cb-9042-e67030a5c404 service cinder] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:37.421025 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3f527-174c-40cb-9042-e67030a5c404 service cinder] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:37.421401 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3f527-174c-40cb-9042-e67030a5c404 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:37.424674 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53905abf-8fbe-41bb-a1af-521bdb28083a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d9483cd436d44689b4fd17461ff0ef6, user_id=066d32d333134195b89a25e9957a98a6, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:37.427401 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53905abf-8fbe-41bb-a1af-521bdb28083a admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:37.428587 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-d0c3f527-174c-40cb-9042-e67030a5c404 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:37.457061 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 872/1743] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:20:37 2021] PUT /identity/v3/projects/7d9483cd436d44689b4fd17461ff0ef6/users/066d32d333134195b89a25e9957a98a6/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:37.461986 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53905abf-8fbe-41bb-a1af-521bdb28083a admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:37.469300 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-53905abf-8fbe-41bb-a1af-521bdb28083a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:37.607748 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c3f527-174c-40cb-9042-e67030a5c404 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:37.609414 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c3f527-174c-40cb-9042-e67030a5c404 service cinder] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:37.636900 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 872/1744] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:20:37 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:20:37.643508 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a04c20-cdd6-4254-b127-f2e5dbb8ebcf None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:37.643774 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a04c20-cdd6-4254-b127-f2e5dbb8ebcf None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:37.644492 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a04c20-cdd6-4254-b127-f2e5dbb8ebcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:37.684211 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53905abf-8fbe-41bb-a1af-521bdb28083a admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:37.701248 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46565dda-0500-467d-bfd2-b8fa2a756473 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:37.701610 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46565dda-0500-467d-bfd2-b8fa2a756473 service nova] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:37.701895 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46565dda-0500-467d-bfd2-b8fa2a756473 service nova] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:37.702167 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46565dda-0500-467d-bfd2-b8fa2a756473 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:37.706637 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-46565dda-0500-467d-bfd2-b8fa2a756473 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:37.723223 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-e9a04c20-cdd6-4254-b127-f2e5dbb8ebcf None None] MFA Rules not processed for user `4dfff15cb8ff4dd8a22ae90b88f13a45`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:37.726580 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-e9a04c20-cdd6-4254-b127-f2e5dbb8ebcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:37.892460 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46565dda-0500-467d-bfd2-b8fa2a756473 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:37.895253 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46565dda-0500-467d-bfd2-b8fa2a756473 service nova] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:37.911837 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 873/1745] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:20:37 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:20:37.913869 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948fa94-ab8c-4e40-9a4b-044a2042064c None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:37.914656 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948fa94-ab8c-4e40-9a4b-044a2042064c None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:37.915108 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0948fa94-ab8c-4e40-9a4b-044a2042064c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:37.943095 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-0948fa94-ab8c-4e40-9a4b-044a2042064c None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:37.944515 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-0948fa94-ab8c-4e40-9a4b-044a2042064c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:37.986709 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 873/1746] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:37 2021] POST /identity/v3/auth/tokens => generated 3297 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:37.990538 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd537938-54f9-4a90-a343-304b2f4e2ac9 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:37.991022 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd537938-54f9-4a90-a343-304b2f4e2ac9 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:37.993483 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd537938-54f9-4a90-a343-304b2f4e2ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:38.091435 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-bd537938-54f9-4a90-a343-304b2f4e2ac9 None None] MFA Rules not processed for user `066d32d333134195b89a25e9957a98a6`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:38.094007 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-bd537938-54f9-4a90-a343-304b2f4e2ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:38.134644 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 874/1747] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:38.145603 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0948fa94-ab8c-4e40-9a4b-044a2042064c None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:38.152775 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-0948fa94-ab8c-4e40-9a4b-044a2042064c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:38.253670 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0948fa94-ab8c-4e40-9a4b-044a2042064c None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:38.259608 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7f0d6-ddb5-45e8-b934-ef99806f1851 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:38.260595 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7f0d6-ddb5-45e8-b934-ef99806f1851 service cinder] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:38.260943 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7f0d6-ddb5-45e8-b934-ef99806f1851 service cinder] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:38.261224 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b7f0d6-ddb5-45e8-b934-ef99806f1851 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:38.266136 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-c7b7f0d6-ddb5-45e8-b934-ef99806f1851 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:38.304252 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 874/1748] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:37 2021] POST /identity/v3/auth/tokens => generated 3317 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:38.308899 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd537938-54f9-4a90-a343-304b2f4e2ac9 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:38.312333 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-bd537938-54f9-4a90-a343-304b2f4e2ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:38.366007 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd537938-54f9-4a90-a343-304b2f4e2ac9 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:38.405247 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99643e-145d-456c-8c82-01f2c9c7c93c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:38.406048 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99643e-145d-456c-8c82-01f2c9c7c93c service cinder] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:38.406326 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99643e-145d-456c-8c82-01f2c9c7c93c service cinder] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:38.410052 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99643e-145d-456c-8c82-01f2c9c7c93c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:38.425027 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b99643e-145d-456c-8c82-01f2c9c7c93c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:38.426475 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b99643e-145d-456c-8c82-01f2c9c7c93c service cinder] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:38.456973 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b7f0d6-ddb5-45e8-b934-ef99806f1851 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:38.460328 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b7f0d6-ddb5-45e8-b934-ef99806f1851 service cinder] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:38.462722 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 875/1749] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:20:38 2021] GET /identity/v3/auth/tokens => generated 3297 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:20:38.463804 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99643e-145d-456c-8c82-01f2c9c7c93c service cinder] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:38.466454 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-0b99643e-145d-456c-8c82-01f2c9c7c93c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:38.495372 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 875/1750] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:20:38 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:20:38.567959 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7f0d6-ddb5-45e8-b934-ef99806f1851 service cinder] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:38.580732 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b7f0d6-ddb5-45e8-b934-ef99806f1851 service cinder] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:38.592370 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74599c17-ba7d-4151-a804-e9e8c4623517 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:38.593902 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74599c17-ba7d-4151-a804-e9e8c4623517 service cinder] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:38.597763 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74599c17-ba7d-4151-a804-e9e8c4623517 service cinder] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:38.598187 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74599c17-ba7d-4151-a804-e9e8c4623517 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:38.605887 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-74599c17-ba7d-4151-a804-e9e8c4623517 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:38.618041 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99643e-145d-456c-8c82-01f2c9c7c93c service cinder] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:38.625432 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef9416-972e-4808-b43c-9dd728a222a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:38.626115 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef9416-972e-4808-b43c-9dd728a222a2 service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:38.627044 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef9416-972e-4808-b43c-9dd728a222a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:38.627333 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef9416-972e-4808-b43c-9dd728a222a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:38.645858 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef9416-972e-4808-b43c-9dd728a222a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:38.647747 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef9416-972e-4808-b43c-9dd728a222a2 service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:38.679994 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 876/1751] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:20:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:20:38.682823 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129fa654-a9a1-488a-90c0-d3c49ae6b62e None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:38.684010 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129fa654-a9a1-488a-90c0-d3c49ae6b62e None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:38.684482 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129fa654-a9a1-488a-90c0-d3c49ae6b62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:38.772994 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-129fa654-a9a1-488a-90c0-d3c49ae6b62e None None] MFA Rules not processed for user `2ed842b05ab04f0a807a60c34ad9198a`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:38.775536 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-129fa654-a9a1-488a-90c0-d3c49ae6b62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:38.842554 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74599c17-ba7d-4151-a804-e9e8c4623517 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:38.847096 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74599c17-ba7d-4151-a804-e9e8c4623517 service cinder] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:38.877012 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 876/1752] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:20:38 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:20:39.076968 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 877/1753] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:38 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:39.089602 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe74f22-7b03-44f2-b5a2-9953e5159561 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:39.089602 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe74f22-7b03-44f2-b5a2-9953e5159561 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:39.089602 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe74f22-7b03-44f2-b5a2-9953e5159561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:39.141203 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129fa654-a9a1-488a-90c0-d3c49ae6b62e None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:39.158927 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129fa654-a9a1-488a-90c0-d3c49ae6b62e None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:39.167786 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-bfe74f22-7b03-44f2-b5a2-9953e5159561 None None] MFA Rules not processed for user `2ed842b05ab04f0a807a60c34ad9198a`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:39.169007 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-bfe74f22-7b03-44f2-b5a2-9953e5159561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:39.183219 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ea557-479d-40ea-b037-e0ea56976fce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:39.187722 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ea557-479d-40ea-b037-e0ea56976fce service cinder] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:39.188159 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ea557-479d-40ea-b037-e0ea56976fce service cinder] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:39.190093 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ea557-479d-40ea-b037-e0ea56976fce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:39.199247 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-3b7ea557-479d-40ea-b037-e0ea56976fce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:39.213530 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 877/1754] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:39 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:39.376883 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe74f22-7b03-44f2-b5a2-9953e5159561 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:39.412304 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe74f22-7b03-44f2-b5a2-9953e5159561 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:39.439629 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb5eb1-0930-42b7-96d0-91d22a7d8ca6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:39.440314 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb5eb1-0930-42b7-96d0-91d22a7d8ca6 service nova] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:39.444921 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb5eb1-0930-42b7-96d0-91d22a7d8ca6 service nova] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:39.446176 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb5eb1-0930-42b7-96d0-91d22a7d8ca6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:39.486752 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ea557-479d-40ea-b037-e0ea56976fce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:39.492158 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb5eb1-0930-42b7-96d0-91d22a7d8ca6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:39.496919 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ea557-479d-40ea-b037-e0ea56976fce service cinder] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:39.499539 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb5eb1-0930-42b7-96d0-91d22a7d8ca6 service nova] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:39.557753 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 878/1755] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:20:39 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 29 20:20:39.559217 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 878/1756] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:20:39 2021] GET /identity/v3/auth/tokens => generated 3232 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 29 20:20:40.102467 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb5eb1-0930-42b7-96d0-91d22a7d8ca6 service nova] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:40.104046 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-61cb5eb1-0930-42b7-96d0-91d22a7d8ca6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:40.156882 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb5eb1-0930-42b7-96d0-91d22a7d8ca6 service nova] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:40.188143 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71fde5-9755-4e43-9d69-24ca0fa237a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:40.192678 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71fde5-9755-4e43-9d69-24ca0fa237a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:40.192966 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71fde5-9755-4e43-9d69-24ca0fa237a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:40.193244 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71fde5-9755-4e43-9d69-24ca0fa237a1 admin admin] PATH_INFO: `/v3/projects/c3d183a9f26a477e97231639ce00e93f` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:40.200580 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c71fde5-9755-4e43-9d69-24ca0fa237a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3d183a9f26a477e97231639ce00e93f)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:40.212343 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c71fde5-9755-4e43-9d69-24ca0fa237a1 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:40.374214 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-4c71fde5-9755-4e43-9d69-24ca0fa237a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3d183a9f26a477e97231639ce00e93f', 'request_id': 'req-4c71fde5-9755-4e43-9d69-24ca0fa237a1'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:40.414998 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-4c71fde5-9755-4e43-9d69-24ca0fa237a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3d183a9f26a477e97231639ce00e93f', 'request_id': 'req-4c71fde5-9755-4e43-9d69-24ca0fa237a1'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:40.426984 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-4c71fde5-9755-4e43-9d69-24ca0fa237a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3d183a9f26a477e97231639ce00e93f', 'request_id': 'req-4c71fde5-9755-4e43-9d69-24ca0fa237a1'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:40.520186 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-4c71fde5-9755-4e43-9d69-24ca0fa237a1 admin admin] The token cache is being invalidate because project c3d183a9f26a477e97231639ce00e93f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:20:40.520786 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-4c71fde5-9755-4e43-9d69-24ca0fa237a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:40.523348 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-4c71fde5-9755-4e43-9d69-24ca0fa237a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:40.529258 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 879/1757] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:20:40 2021] DELETE /identity/v3/projects/c3d183a9f26a477e97231639ce00e93f => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:40.535543 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6700152-b239-48a3-967e-30d766b351eb None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:40.535543 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6700152-b239-48a3-967e-30d766b351eb None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:40.535543 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6700152-b239-48a3-967e-30d766b351eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:40.593839 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-f6700152-b239-48a3-967e-30d766b351eb None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:40.610320 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-f6700152-b239-48a3-967e-30d766b351eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:40.838862 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 879/1758] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:40.846219 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9460dab-874b-4e55-9908-4163bddf9a69 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:40.846503 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9460dab-874b-4e55-9908-4163bddf9a69 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:40.846781 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9460dab-874b-4e55-9908-4163bddf9a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:40.892014 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-a9460dab-874b-4e55-9908-4163bddf9a69 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:40.902236 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-a9460dab-874b-4e55-9908-4163bddf9a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:40.932357 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 880/1759] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:40 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:40.935557 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6700152-b239-48a3-967e-30d766b351eb None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:40.959041 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6700152-b239-48a3-967e-30d766b351eb None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:40.980733 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003d6f2-d99b-4a1b-aa5f-5d97527e98e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:40.981387 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003d6f2-d99b-4a1b-aa5f-5d97527e98e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:40.981836 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003d6f2-d99b-4a1b-aa5f-5d97527e98e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:40.982352 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003d6f2-d99b-4a1b-aa5f-5d97527e98e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:40.987337 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b003d6f2-d99b-4a1b-aa5f-5d97527e98e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:20:40.988061 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b003d6f2-d99b-4a1b-aa5f-5d97527e98e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:40.990924 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b003d6f2-d99b-4a1b-aa5f-5d97527e98e4 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:41.009698 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a929d-e958-4b54-a1de-48ea7ce20858 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:41.010006 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a929d-e958-4b54-a1de-48ea7ce20858 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:41.010268 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a929d-e958-4b54-a1de-48ea7ce20858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:41.047326 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 880/1760] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:20:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:20:41.052844 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003d6f2-d99b-4a1b-aa5f-5d97527e98e4 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:41.089011 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-715a929d-e958-4b54-a1de-48ea7ce20858 None None] MFA Rules not processed for user `821fb4ce82de47ca873fc22d29d4f957`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:41.089676 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-715a929d-e958-4b54-a1de-48ea7ce20858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:41.106518 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003d6f2-d99b-4a1b-aa5f-5d97527e98e4 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:41.146020 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b419e7-c420-4464-99c6-7a9228093182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:41.147450 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b419e7-c420-4464-99c6-7a9228093182 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:41.149408 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b419e7-c420-4464-99c6-7a9228093182 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:41.153576 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b419e7-c420-4464-99c6-7a9228093182 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:41.159065 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b419e7-c420-4464-99c6-7a9228093182 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:41.170049 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b419e7-c420-4464-99c6-7a9228093182 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:41.246910 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 881/1761] 10.222.0.58 () {58 vars in 1015 bytes} [Mon Nov 29 20:20:41 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:41.292353 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a929d-e958-4b54-a1de-48ea7ce20858 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:41.292353 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-715a929d-e958-4b54-a1de-48ea7ce20858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:41.317318 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 881/1762] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:20:41 2021] POST /identity/v3/projects => generated 405 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:20:41.321633 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b419e7-c420-4464-99c6-7a9228093182 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:41.324673 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a929d-e958-4b54-a1de-48ea7ce20858 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:41.506058 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf5d7c-8f4e-489c-966b-608fba1df4d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:41.507006 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf5d7c-8f4e-489c-966b-608fba1df4d9 service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:41.507393 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf5d7c-8f4e-489c-966b-608fba1df4d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:41.507764 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf5d7c-8f4e-489c-966b-608fba1df4d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:41.539226 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf5d7c-8f4e-489c-966b-608fba1df4d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:41.542486 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf5d7c-8f4e-489c-966b-608fba1df4d9 service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:41.557760 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b419e7-c420-4464-99c6-7a9228093182 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:41.568125 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 882/1763] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:20:41 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 29 20:20:41.584795 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433be4b0-9737-4336-9ccd-49b6d9b00f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:41.585849 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433be4b0-9737-4336-9ccd-49b6d9b00f45 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:41.586132 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433be4b0-9737-4336-9ccd-49b6d9b00f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:41.586419 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433be4b0-9737-4336-9ccd-49b6d9b00f45 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:41.587185 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433be4b0-9737-4336-9ccd-49b6d9b00f45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:41.589252 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433be4b0-9737-4336-9ccd-49b6d9b00f45 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:41.673254 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 882/1764] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:20:41 2021] POST /identity/v3/users => generated 303 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:20:41.677082 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf5d7c-8f4e-489c-966b-608fba1df4d9 service neutron] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:41.714461 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf5d7c-8f4e-489c-966b-608fba1df4d9 service neutron] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:41.726890 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a52578-cb5a-48a4-b05d-a29235087aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:41.728852 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a52578-cb5a-48a4-b05d-a29235087aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:41.730515 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a52578-cb5a-48a4-b05d-a29235087aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:41.731073 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a52578-cb5a-48a4-b05d-a29235087aa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:41.732416 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a52578-cb5a-48a4-b05d-a29235087aa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:41.735363 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a52578-cb5a-48a4-b05d-a29235087aa4 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:41.761719 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 883/1765] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:20:41 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:20:41.764793 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433be4b0-9737-4336-9ccd-49b6d9b00f45 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:41.783702 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433be4b0-9737-4336-9ccd-49b6d9b00f45 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:41.802257 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd825c-7a5d-4268-b4c5-c27b6bd9cb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:41.802976 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd825c-7a5d-4268-b4c5-c27b6bd9cb51 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:41.803258 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd825c-7a5d-4268-b4c5-c27b6bd9cb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:41.803734 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd825c-7a5d-4268-b4c5-c27b6bd9cb51 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:41.813666 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd825c-7a5d-4268-b4c5-c27b6bd9cb51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:41.818638 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd825c-7a5d-4268-b4c5-c27b6bd9cb51 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:41.872321 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 883/1766] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:20:41 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:20:41.876363 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a52578-cb5a-48a4-b05d-a29235087aa4 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:41.895474 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a52578-cb5a-48a4-b05d-a29235087aa4 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:41.905139 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32cdc8c-beb1-4f24-a07f-4d0ee3ec5893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:41.906459 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cdc8c-beb1-4f24-a07f-4d0ee3ec5893 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:41.906998 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cdc8c-beb1-4f24-a07f-4d0ee3ec5893 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:41.907481 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cdc8c-beb1-4f24-a07f-4d0ee3ec5893 admin admin] PATH_INFO: `/v3/projects/7fa1cc2023764977a1cabea7f9912db4/users/e9ca5a7a4ccb4a37b59c2955d8a7200e/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:41.948421 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32cdc8c-beb1-4f24-a07f-4d0ee3ec5893 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fa1cc2023764977a1cabea7f9912db4, user_id=e9ca5a7a4ccb4a37b59c2955d8a7200e, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:41.951676 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32cdc8c-beb1-4f24-a07f-4d0ee3ec5893 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:41.981688 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 884/1767] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:20:41 2021] PUT /identity/v3/projects/7fa1cc2023764977a1cabea7f9912db4/users/e9ca5a7a4ccb4a37b59c2955d8a7200e/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:42.048873 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea31092-9ed3-4566-b7bc-50c1ab23e494 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:42.049149 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea31092-9ed3-4566-b7bc-50c1ab23e494 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:42.049509 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea31092-9ed3-4566-b7bc-50c1ab23e494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:42.098727 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-4ea31092-9ed3-4566-b7bc-50c1ab23e494 None None] MFA Rules not processed for user `e9ca5a7a4ccb4a37b59c2955d8a7200e`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:42.100341 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-4ea31092-9ed3-4566-b7bc-50c1ab23e494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:42.451994 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 884/1768] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:42 2021] POST /identity/v3/auth/tokens => generated 3272 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:42.455445 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32cdc8c-beb1-4f24-a07f-4d0ee3ec5893 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:42.644959 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32cdc8c-beb1-4f24-a07f-4d0ee3ec5893 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:42.674116 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ddd8f-d1c0-4ae0-91e4-319ab17dcf09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:42.674801 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ddd8f-d1c0-4ae0-91e4-319ab17dcf09 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:42.675700 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ddd8f-d1c0-4ae0-91e4-319ab17dcf09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:42.675700 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ddd8f-d1c0-4ae0-91e4-319ab17dcf09 admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:42.676086 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730ddd8f-d1c0-4ae0-91e4-319ab17dcf09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:42.678274 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730ddd8f-d1c0-4ae0-91e4-319ab17dcf09 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:42.763738 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 885/1769] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:20:42 2021] POST /identity/v3/projects => generated 403 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:20:42.765211 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea31092-9ed3-4566-b7bc-50c1ab23e494 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:42.779656 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea31092-9ed3-4566-b7bc-50c1ab23e494 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:42.933837 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f195a6-139b-4ab7-b786-9b82ffc7fb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:42.936032 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f195a6-139b-4ab7-b786-9b82ffc7fb0f admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:42.937223 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f195a6-139b-4ab7-b786-9b82ffc7fb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:42.937653 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f195a6-139b-4ab7-b786-9b82ffc7fb0f admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:42.939439 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f195a6-139b-4ab7-b786-9b82ffc7fb0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:42.945028 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f195a6-139b-4ab7-b786-9b82ffc7fb0f admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:42.994318 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 885/1770] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:20:42 2021] POST /identity/v3/users => generated 308 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:20:42.999375 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ddd8f-d1c0-4ae0-91e4-319ab17dcf09 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:43.023526 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ddd8f-d1c0-4ae0-91e4-319ab17dcf09 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:43.048349 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07006f54-d3b0-456a-b52c-12f33dbd7af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:43.051982 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07006f54-d3b0-456a-b52c-12f33dbd7af3 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:43.055879 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07006f54-d3b0-456a-b52c-12f33dbd7af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:43.057577 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07006f54-d3b0-456a-b52c-12f33dbd7af3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:43.060502 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07006f54-d3b0-456a-b52c-12f33dbd7af3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:43.082148 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07006f54-d3b0-456a-b52c-12f33dbd7af3 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:43.134681 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 886/1771] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:20:42 2021] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:20:43.138684 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f195a6-139b-4ab7-b786-9b82ffc7fb0f admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:43.160576 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f195a6-139b-4ab7-b786-9b82ffc7fb0f admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:43.190327 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b890206d-657b-424a-bab2-827dab624d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:43.191871 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890206d-657b-424a-bab2-827dab624d57 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:43.192565 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890206d-657b-424a-bab2-827dab624d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:43.193007 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890206d-657b-424a-bab2-827dab624d57 admin admin] PATH_INFO: `/v3/projects/f85397c64792463396c515bee6b4112f/users/be6351d7eae942358c3b633f92c08eab/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:43.257089 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b890206d-657b-424a-bab2-827dab624d57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f85397c64792463396c515bee6b4112f, user_id=be6351d7eae942358c3b633f92c08eab, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:43.260041 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b890206d-657b-424a-bab2-827dab624d57 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:43.297986 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 886/1772] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:20:43 2021] PUT /identity/v3/projects/f85397c64792463396c515bee6b4112f/users/be6351d7eae942358c3b633f92c08eab/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:43.301732 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07006f54-d3b0-456a-b52c-12f33dbd7af3 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:43.320564 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07006f54-d3b0-456a-b52c-12f33dbd7af3 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:43.546026 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40379cb8-8135-4185-8f85-0e09b67be918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:43.548732 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40379cb8-8135-4185-8f85-0e09b67be918 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:43.549236 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40379cb8-8135-4185-8f85-0e09b67be918 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:43.549967 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40379cb8-8135-4185-8f85-0e09b67be918 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:43.552373 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40379cb8-8135-4185-8f85-0e09b67be918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:43.564362 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40379cb8-8135-4185-8f85-0e09b67be918 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:43.609736 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b890206d-657b-424a-bab2-827dab624d57 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:43.628703 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 887/1773] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:20:43 2021] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:20:43.636714 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b890206d-657b-424a-bab2-827dab624d57 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:43.675848 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d7185-180e-4bf4-9572-e7e2462af992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:43.677478 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d7185-180e-4bf4-9572-e7e2462af992 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:43.681049 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d7185-180e-4bf4-9572-e7e2462af992 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:43.685670 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d7185-180e-4bf4-9572-e7e2462af992 admin admin] PATH_INFO: `/v3/projects/f85397c64792463396c515bee6b4112f/users/be6351d7eae942358c3b633f92c08eab/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:43.692903 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d7185-180e-4bf4-9572-e7e2462af992 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f85397c64792463396c515bee6b4112f, user_id=be6351d7eae942358c3b633f92c08eab, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:43.699579 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d7185-180e-4bf4-9572-e7e2462af992 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:43.752599 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 887/1774] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:20:43 2021] PUT /identity/v3/projects/f85397c64792463396c515bee6b4112f/users/be6351d7eae942358c3b633f92c08eab/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:43.762730 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e5069-1a3a-486d-9b3f-9e251700eb0f None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:43.763811 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e5069-1a3a-486d-9b3f-9e251700eb0f None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:43.764232 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e5069-1a3a-486d-9b3f-9e251700eb0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:43.796527 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d7185-180e-4bf4-9572-e7e2462af992 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:43.799296 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-d41d7185-180e-4bf4-9572-e7e2462af992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:43.841577 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-666e5069-1a3a-486d-9b3f-9e251700eb0f None None] MFA Rules not processed for user `be6351d7eae942358c3b633f92c08eab`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:43.843184 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-666e5069-1a3a-486d-9b3f-9e251700eb0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:44.040181 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d7185-180e-4bf4-9572-e7e2462af992 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:44.076209 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae90dec-fa29-4e31-9d4c-4c0307a8b4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:44.079430 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae90dec-fa29-4e31-9d4c-4c0307a8b4a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:44.079712 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae90dec-fa29-4e31-9d4c-4c0307a8b4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:44.080907 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae90dec-fa29-4e31-9d4c-4c0307a8b4a9 admin admin] PATH_INFO: `/v3/users/9df9dad29feb4036a7947244c48c65b8` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:44.087154 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae90dec-fa29-4e31-9d4c-4c0307a8b4a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9df9dad29feb4036a7947244c48c65b8)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:44.126626 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae90dec-fa29-4e31-9d4c-4c0307a8b4a9 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:44.203549 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 888/1775] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:43 2021] POST /identity/v3/auth/tokens => generated 3337 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:20:44.216838 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e5069-1a3a-486d-9b3f-9e251700eb0f None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:44.218962 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-666e5069-1a3a-486d-9b3f-9e251700eb0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:44.380896 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-eae90dec-fa29-4e31-9d4c-4c0307a8b4a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9df9dad29feb4036a7947244c48c65b8'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:44.420875 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-eae90dec-fa29-4e31-9d4c-4c0307a8b4a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9df9dad29feb4036a7947244c48c65b8'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:44.471788 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-eae90dec-fa29-4e31-9d4c-4c0307a8b4a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9df9dad29feb4036a7947244c48c65b8'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:44.479535 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-eae90dec-fa29-4e31-9d4c-4c0307a8b4a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9df9dad29feb4036a7947244c48c65b8'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:44.482258 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-eae90dec-fa29-4e31-9d4c-4c0307a8b4a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9df9dad29feb4036a7947244c48c65b8'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:44.486524 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e5069-1a3a-486d-9b3f-9e251700eb0f None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:44.515515 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3cc78f-1efc-47f2-b949-d20be6d676d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:44.515515 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cc78f-1efc-47f2-b949-d20be6d676d5 service cinder] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:44.515515 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cc78f-1efc-47f2-b949-d20be6d676d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:44.515515 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3cc78f-1efc-47f2-b949-d20be6d676d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:44.517451 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 888/1776] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:20:43 2021] DELETE /identity/v3/users/9df9dad29feb4036a7947244c48c65b8 => generated 0 bytes in 721 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:20:44.518705 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8cc93-385f-4454-bfef-c503555e6bf6 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:44.521859 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-0f3cc78f-1efc-47f2-b949-d20be6d676d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:44.525722 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8cc93-385f-4454-bfef-c503555e6bf6 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:44.526101 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c8cc93-385f-4454-bfef-c503555e6bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:44.566218 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3cc78f-1efc-47f2-b949-d20be6d676d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:44.567584 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3cc78f-1efc-47f2-b949-d20be6d676d5 service cinder] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:44.626101 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 889/1777] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:20:44 2021] GET /identity/v3/auth/tokens => generated 3337 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:20:44.627635 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53db04-1e04-4c56-b2dc-c956d654a3bf None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:44.627925 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53db04-1e04-4c56-b2dc-c956d654a3bf None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:44.628202 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a53db04-1e04-4c56-b2dc-c956d654a3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:44.678066 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-22c8cc93-385f-4454-bfef-c503555e6bf6 None None] MFA Rules not processed for user `2ed842b05ab04f0a807a60c34ad9198a`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:44.679727 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-22c8cc93-385f-4454-bfef-c503555e6bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:44.689618 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-4a53db04-1e04-4c56-b2dc-c956d654a3bf None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:44.694056 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-4a53db04-1e04-4c56-b2dc-c956d654a3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:44.968792 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 890/1778] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:44 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:44.992390 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53db04-1e04-4c56-b2dc-c956d654a3bf None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:44.994684 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-4a53db04-1e04-4c56-b2dc-c956d654a3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:45.024831 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 889/1779] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:44 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 507 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:45.302289 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a53db04-1e04-4c56-b2dc-c956d654a3bf None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:45.324458 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c0378-ef30-41f7-a33e-d94345e04a7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:45.325445 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c0378-ef30-41f7-a33e-d94345e04a7d service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:45.333927 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c0378-ef30-41f7-a33e-d94345e04a7d service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:45.335120 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c0378-ef30-41f7-a33e-d94345e04a7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:45.371154 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c0378-ef30-41f7-a33e-d94345e04a7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:45.378228 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c0378-ef30-41f7-a33e-d94345e04a7d service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:45.427812 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 891/1780] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:20:44 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:20:46.204194 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba085a-3cf7-4c16-832b-dbdf30361e2f None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:46.204850 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba085a-3cf7-4c16-832b-dbdf30361e2f None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:46.204850 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ba085a-3cf7-4c16-832b-dbdf30361e2f None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:46.206953 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 890/1781] 10.222.0.15 () {54 vars in 921 bytes} [Mon Nov 29 20:20:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:20:46.215488 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fe0ff-87ef-43b9-83de-644779fd44c9 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:46.216564 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fe0ff-87ef-43b9-83de-644779fd44c9 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:46.217069 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52fe0ff-87ef-43b9-83de-644779fd44c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:46.248896 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-a52fe0ff-87ef-43b9-83de-644779fd44c9 None None] MFA Rules not processed for user `5f76a8c3d04e440b92d12ced18d97941`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:46.250516 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-a52fe0ff-87ef-43b9-83de-644779fd44c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:46.427864 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 892/1782] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Nov 29 20:20:46 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:20:46.440372 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820ac75-df39-4bb3-ace1-6629cfd83961 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:46.440663 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820ac75-df39-4bb3-ace1-6629cfd83961 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:46.440948 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820ac75-df39-4bb3-ace1-6629cfd83961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:46.469082 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52fe0ff-87ef-43b9-83de-644779fd44c9 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:46.470897 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-a52fe0ff-87ef-43b9-83de-644779fd44c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:46.503741 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52fe0ff-87ef-43b9-83de-644779fd44c9 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:46.543380 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9297b90-7487-458b-afa2-3873a7901105 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:46.544062 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9297b90-7487-458b-afa2-3873a7901105 service nova] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:46.544376 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9297b90-7487-458b-afa2-3873a7901105 service nova] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:46.544665 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9297b90-7487-458b-afa2-3873a7901105 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:46.581140 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-2820ac75-df39-4bb3-ace1-6629cfd83961 None None] MFA Rules not processed for user `0746d603781d4b3796959e8217112cc5`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:46.585714 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-2820ac75-df39-4bb3-ace1-6629cfd83961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:46.592507 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9297b90-7487-458b-afa2-3873a7901105 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:46.594694 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9297b90-7487-458b-afa2-3873a7901105 service nova] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:46.628162 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 893/1783] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:20:46 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 29 20:20:46.630259 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7575655b-820e-49b2-9b29-160e610835b1 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:46.637438 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7575655b-820e-49b2-9b29-160e610835b1 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:46.637903 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7575655b-820e-49b2-9b29-160e610835b1 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:46.644155 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 894/1784] 10.222.0.15 () {54 vars in 912 bytes} [Mon Nov 29 20:20:46 2021] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:20:46.647230 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70b3e4-dd34-4ee2-a64a-0ca5493ca020 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:46.649247 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70b3e4-dd34-4ee2-a64a-0ca5493ca020 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:46.649688 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70b3e4-dd34-4ee2-a64a-0ca5493ca020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:46.729460 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-1c70b3e4-dd34-4ee2-a64a-0ca5493ca020 None None] MFA Rules not processed for user `682a8ea75de1423199659f6f850d2ade`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:46.735694 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-1c70b3e4-dd34-4ee2-a64a-0ca5493ca020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:46.961827 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 895/1785] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:46 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:46.967923 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688069f3-40c0-4379-90b3-995f90424c3a None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:46.970518 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688069f3-40c0-4379-90b3-995f90424c3a None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:46.970955 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688069f3-40c0-4379-90b3-995f90424c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:47.027207 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-688069f3-40c0-4379-90b3-995f90424c3a None None] MFA Rules not processed for user `821fb4ce82de47ca873fc22d29d4f957`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:47.028647 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-688069f3-40c0-4379-90b3-995f90424c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:47.040822 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 896/1786] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Nov 29 20:20:46 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:47.041947 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688069f3-40c0-4379-90b3-995f90424c3a None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:47.043536 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-688069f3-40c0-4379-90b3-995f90424c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:47.086671 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688069f3-40c0-4379-90b3-995f90424c3a None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:47.092916 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08293003-cf80-4d64-8a71-ba137be874c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:47.093941 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08293003-cf80-4d64-8a71-ba137be874c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:47.094329 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08293003-cf80-4d64-8a71-ba137be874c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:47.094708 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08293003-cf80-4d64-8a71-ba137be874c7 admin admin] PATH_INFO: `/v3/projects/5351de3f92a1462b91649d2031d3fb65` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:47.099944 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08293003-cf80-4d64-8a71-ba137be874c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5351de3f92a1462b91649d2031d3fb65)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:47.102077 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08293003-cf80-4d64-8a71-ba137be874c7 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:47.150449 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 891/1787] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:46 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 711 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:47.151719 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820ac75-df39-4bb3-ace1-6629cfd83961 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:47.170894 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820ac75-df39-4bb3-ace1-6629cfd83961 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:47.175714 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678c0af-6efa-4228-b035-31c8531d0e9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:47.176413 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678c0af-6efa-4228-b035-31c8531d0e9c service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:47.176694 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678c0af-6efa-4228-b035-31c8531d0e9c service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:47.177044 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678c0af-6efa-4228-b035-31c8531d0e9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:47.192990 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e678c0af-6efa-4228-b035-31c8531d0e9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:47.195581 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e678c0af-6efa-4228-b035-31c8531d0e9c service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:47.206265 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 892/1788] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:20:47 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:20:47.240062 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-08293003-cf80-4d64-8a71-ba137be874c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5351de3f92a1462b91649d2031d3fb65', 'request_id': 'req-08293003-cf80-4d64-8a71-ba137be874c7'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:47.256068 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-08293003-cf80-4d64-8a71-ba137be874c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5351de3f92a1462b91649d2031d3fb65', 'request_id': 'req-08293003-cf80-4d64-8a71-ba137be874c7'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:47.271035 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-08293003-cf80-4d64-8a71-ba137be874c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5351de3f92a1462b91649d2031d3fb65', 'request_id': 'req-08293003-cf80-4d64-8a71-ba137be874c7'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:47.290403 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-08293003-cf80-4d64-8a71-ba137be874c7 admin admin] The token cache is being invalidate because project 5351de3f92a1462b91649d2031d3fb65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:20:47.291010 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-08293003-cf80-4d64-8a71-ba137be874c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:47.292046 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-08293003-cf80-4d64-8a71-ba137be874c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:47.294561 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 897/1789] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:20:47 2021] DELETE /identity/v3/projects/5351de3f92a1462b91649d2031d3fb65 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:47.298355 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678c0af-6efa-4228-b035-31c8531d0e9c service neutron] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:47.331419 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678c0af-6efa-4228-b035-31c8531d0e9c service neutron] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:47.418878 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ead25-d3c8-4a0c-b383-38dd3bba992a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:47.421012 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ead25-d3c8-4a0c-b383-38dd3bba992a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:47.421367 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ead25-d3c8-4a0c-b383-38dd3bba992a admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:47.421956 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ead25-d3c8-4a0c-b383-38dd3bba992a admin admin] PATH_INFO: `/v3/users/4dfff15cb8ff4dd8a22ae90b88f13a45` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:47.423982 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ead25-d3c8-4a0c-b383-38dd3bba992a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dfff15cb8ff4dd8a22ae90b88f13a45)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:47.426417 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ead25-d3c8-4a0c-b383-38dd3bba992a admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:47.473050 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08293003-cf80-4d64-8a71-ba137be874c7 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:47.477294 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-08293003-cf80-4d64-8a71-ba137be874c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:47.510841 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08293003-cf80-4d64-8a71-ba137be874c7 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:47.524789 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce58d3-739d-485b-a020-a7e879298cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:47.526289 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce58d3-739d-485b-a020-a7e879298cf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:47.526580 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce58d3-739d-485b-a020-a7e879298cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:47.526878 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce58d3-739d-485b-a020-a7e879298cf6 admin admin] PATH_INFO: `/v3/users/e9ca5a7a4ccb4a37b59c2955d8a7200e` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:47.531776 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce58d3-739d-485b-a020-a7e879298cf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9ca5a7a4ccb4a37b59c2955d8a7200e)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:47.535320 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-750ead25-d3c8-4a0c-b383-38dd3bba992a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dfff15cb8ff4dd8a22ae90b88f13a45'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:47.538468 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce58d3-739d-485b-a020-a7e879298cf6 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:47.559737 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-750ead25-d3c8-4a0c-b383-38dd3bba992a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dfff15cb8ff4dd8a22ae90b88f13a45'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:47.601476 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-750ead25-d3c8-4a0c-b383-38dd3bba992a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dfff15cb8ff4dd8a22ae90b88f13a45'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:47.602589 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-750ead25-d3c8-4a0c-b383-38dd3bba992a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dfff15cb8ff4dd8a22ae90b88f13a45'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:47.605351 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-750ead25-d3c8-4a0c-b383-38dd3bba992a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dfff15cb8ff4dd8a22ae90b88f13a45'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:47.632620 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 893/1790] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:20:47 2021] DELETE /identity/v3/users/4dfff15cb8ff4dd8a22ae90b88f13a45 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:47.655255 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-fdce58d3-739d-485b-a020-a7e879298cf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9ca5a7a4ccb4a37b59c2955d8a7200e'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:47.663947 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-fdce58d3-739d-485b-a020-a7e879298cf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9ca5a7a4ccb4a37b59c2955d8a7200e'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:47.690063 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-fdce58d3-739d-485b-a020-a7e879298cf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9ca5a7a4ccb4a37b59c2955d8a7200e'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:47.724488 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-fdce58d3-739d-485b-a020-a7e879298cf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9ca5a7a4ccb4a37b59c2955d8a7200e'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:47.734285 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-fdce58d3-739d-485b-a020-a7e879298cf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9ca5a7a4ccb4a37b59c2955d8a7200e'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:47.749841 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 898/1791] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:20:47 2021] DELETE /identity/v3/users/e9ca5a7a4ccb4a37b59c2955d8a7200e => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:47.754604 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29203c-10d4-4727-bcee-9a58503211fd None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:47.755692 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29203c-10d4-4727-bcee-9a58503211fd None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:47.756005 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29203c-10d4-4727-bcee-9a58503211fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:47.796074 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-da29203c-10d4-4727-bcee-9a58503211fd None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:47.798426 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-da29203c-10d4-4727-bcee-9a58503211fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:47.903835 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 894/1792] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:47.914162 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce58d3-739d-485b-a020-a7e879298cf6 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:47.915910 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-fdce58d3-739d-485b-a020-a7e879298cf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:48.083112 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce58d3-739d-485b-a020-a7e879298cf6 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:48.093575 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9335fdc-c535-4aea-bc8f-4cb1c73c16c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:48.094246 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9335fdc-c535-4aea-bc8f-4cb1c73c16c0 service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:48.094532 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9335fdc-c535-4aea-bc8f-4cb1c73c16c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:48.094796 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9335fdc-c535-4aea-bc8f-4cb1c73c16c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:48.113409 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9335fdc-c535-4aea-bc8f-4cb1c73c16c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:48.114887 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9335fdc-c535-4aea-bc8f-4cb1c73c16c0 service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:48.144062 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 899/1793] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:20:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:20:48.233468 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29203c-10d4-4727-bcee-9a58503211fd None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:48.235793 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-da29203c-10d4-4727-bcee-9a58503211fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:48.283138 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9335fdc-c535-4aea-bc8f-4cb1c73c16c0 service neutron] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:48.285207 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-f9335fdc-c535-4aea-bc8f-4cb1c73c16c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:48.494766 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9335fdc-c535-4aea-bc8f-4cb1c73c16c0 service neutron] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:48.495121 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29203c-10d4-4727-bcee-9a58503211fd None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:48.540778 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d171b92-78d7-49d4-aa64-6a675ccd6f3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:48.541436 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d171b92-78d7-49d4-aa64-6a675ccd6f3d service nova] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:48.542181 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d171b92-78d7-49d4-aa64-6a675ccd6f3d service nova] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:48.542600 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d171b92-78d7-49d4-aa64-6a675ccd6f3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:48.547172 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-4d171b92-78d7-49d4-aa64-6a675ccd6f3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:48.549031 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e3372-28b1-4591-a0cf-b7b5af5f4302 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:48.551547 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e3372-28b1-4591-a0cf-b7b5af5f4302 service cinder] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:48.556155 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e3372-28b1-4591-a0cf-b7b5af5f4302 service cinder] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:48.557469 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e3372-28b1-4591-a0cf-b7b5af5f4302 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:48.567882 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-a80e3372-28b1-4591-a0cf-b7b5af5f4302 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:48.720693 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e3372-28b1-4591-a0cf-b7b5af5f4302 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:48.721633 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d171b92-78d7-49d4-aa64-6a675ccd6f3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:48.722903 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e3372-28b1-4591-a0cf-b7b5af5f4302 service cinder] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:48.725079 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d171b92-78d7-49d4-aa64-6a675ccd6f3d service nova] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:48.745796 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 900/1794] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:20:48 2021] GET /identity/v3/auth/tokens => generated 3317 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:20:48.748598 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 895/1795] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:20:48 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:20:49.649213 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e3372-28b1-4591-a0cf-b7b5af5f4302 service cinder] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:49.650701 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-a80e3372-28b1-4591-a0cf-b7b5af5f4302 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:49.689089 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e3372-28b1-4591-a0cf-b7b5af5f4302 service cinder] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:49.710242 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9fe32f-67c6-4c48-ac97-30d52f933b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:49.712916 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9fe32f-67c6-4c48-ac97-30d52f933b9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:49.713997 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9fe32f-67c6-4c48-ac97-30d52f933b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:49.715869 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9fe32f-67c6-4c48-ac97-30d52f933b9f admin admin] PATH_INFO: `/v3/projects/9cd21404dae143f1a2b7c7a95d1953e5` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:49.720263 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9fe32f-67c6-4c48-ac97-30d52f933b9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cd21404dae143f1a2b7c7a95d1953e5)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:49.722465 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9fe32f-67c6-4c48-ac97-30d52f933b9f admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:49.858577 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-8c9fe32f-67c6-4c48-ac97-30d52f933b9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cd21404dae143f1a2b7c7a95d1953e5', 'request_id': 'req-8c9fe32f-67c6-4c48-ac97-30d52f933b9f'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:49.876901 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-8c9fe32f-67c6-4c48-ac97-30d52f933b9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cd21404dae143f1a2b7c7a95d1953e5', 'request_id': 'req-8c9fe32f-67c6-4c48-ac97-30d52f933b9f'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:49.894986 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-8c9fe32f-67c6-4c48-ac97-30d52f933b9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cd21404dae143f1a2b7c7a95d1953e5', 'request_id': 'req-8c9fe32f-67c6-4c48-ac97-30d52f933b9f'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:49.943400 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-8c9fe32f-67c6-4c48-ac97-30d52f933b9f admin admin] The token cache is being invalidate because project 9cd21404dae143f1a2b7c7a95d1953e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:20:49.947456 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-8c9fe32f-67c6-4c48-ac97-30d52f933b9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:49.950892 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-8c9fe32f-67c6-4c48-ac97-30d52f933b9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:49.968746 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 901/1796] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:20:49 2021] DELETE /identity/v3/projects/9cd21404dae143f1a2b7c7a95d1953e5 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:49.968849 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98533a33-2fc6-4ad0-8e01-ade4e4a569d6 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:49.968849 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98533a33-2fc6-4ad0-8e01-ade4e4a569d6 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:49.968849 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98533a33-2fc6-4ad0-8e01-ade4e4a569d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:50.042398 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-98533a33-2fc6-4ad0-8e01-ade4e4a569d6 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:50.046719 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-98533a33-2fc6-4ad0-8e01-ade4e4a569d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:50.295085 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 896/1797] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:50.305312 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2d6e2-894b-4f45-932b-6c11cd2504cd None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:50.305672 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2d6e2-894b-4f45-932b-6c11cd2504cd None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:50.305907 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2d6e2-894b-4f45-932b-6c11cd2504cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:50.373109 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-81d2d6e2-894b-4f45-932b-6c11cd2504cd None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:50.374337 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-81d2d6e2-894b-4f45-932b-6c11cd2504cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:50.409912 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 902/1798] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:50.414320 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98533a33-2fc6-4ad0-8e01-ade4e4a569d6 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:50.437510 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98533a33-2fc6-4ad0-8e01-ade4e4a569d6 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:50.446441 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17f644-3603-4288-83c1-7c06fefc69b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:50.447300 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17f644-3603-4288-83c1-7c06fefc69b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:50.447582 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17f644-3603-4288-83c1-7c06fefc69b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:50.447846 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17f644-3603-4288-83c1-7c06fefc69b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:50.449629 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17f644-3603-4288-83c1-7c06fefc69b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:20:50.450079 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17f644-3603-4288-83c1-7c06fefc69b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:50.451898 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17f644-3603-4288-83c1-7c06fefc69b2 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:50.490027 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 897/1799] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:20:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:20:50.494294 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2d6e2-894b-4f45-932b-6c11cd2504cd None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:50.507876 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2d6e2-894b-4f45-932b-6c11cd2504cd None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:50.531712 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2897f6ac-5a58-4915-b66f-cdecfd0c4b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:50.532411 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897f6ac-5a58-4915-b66f-cdecfd0c4b96 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:50.532689 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897f6ac-5a58-4915-b66f-cdecfd0c4b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:50.532963 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897f6ac-5a58-4915-b66f-cdecfd0c4b96 admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:50.533996 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2897f6ac-5a58-4915-b66f-cdecfd0c4b96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:50.535632 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2897f6ac-5a58-4915-b66f-cdecfd0c4b96 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:50.627080 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 903/1800] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:20:50 2021] POST /identity/v3/projects => generated 369 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:20:50.627996 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17f644-3603-4288-83c1-7c06fefc69b2 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:50.650950 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17f644-3603-4288-83c1-7c06fefc69b2 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:50.849763 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254dc59-5140-4ad7-a79e-f757b9022316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:50.853667 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254dc59-5140-4ad7-a79e-f757b9022316 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:50.854259 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254dc59-5140-4ad7-a79e-f757b9022316 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:50.855880 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254dc59-5140-4ad7-a79e-f757b9022316 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:50.858479 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1254dc59-5140-4ad7-a79e-f757b9022316 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:50.880346 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1254dc59-5140-4ad7-a79e-f757b9022316 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:50.934632 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 898/1801] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:20:50 2021] POST /identity/v3/users => generated 285 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:20:50.936988 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2897f6ac-5a58-4915-b66f-cdecfd0c4b96 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:50.952828 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2897f6ac-5a58-4915-b66f-cdecfd0c4b96 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:50.965318 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2006d79-aa63-451f-974f-af6972db5f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:50.967636 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2006d79-aa63-451f-974f-af6972db5f49 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:50.969171 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2006d79-aa63-451f-974f-af6972db5f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:50.971089 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2006d79-aa63-451f-974f-af6972db5f49 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:50.972050 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2006d79-aa63-451f-974f-af6972db5f49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:50.975093 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2006d79-aa63-451f-974f-af6972db5f49 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:51.012090 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 904/1802] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:20:50 2021] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:20:51.024852 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254dc59-5140-4ad7-a79e-f757b9022316 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:51.048783 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254dc59-5140-4ad7-a79e-f757b9022316 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:51.051860 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2006d79-aa63-451f-974f-af6972db5f49 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:51.054131 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-d2006d79-aa63-451f-974f-af6972db5f49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:51.068256 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0f5d5-243a-469b-bebb-d244b27ffe1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:51.071066 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0f5d5-243a-469b-bebb-d244b27ffe1f admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:51.071918 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0f5d5-243a-469b-bebb-d244b27ffe1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:51.071918 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0f5d5-243a-469b-bebb-d244b27ffe1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:51.072391 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad0f5d5-243a-469b-bebb-d244b27ffe1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:51.075386 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2006d79-aa63-451f-974f-af6972db5f49 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:51.090491 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad0f5d5-243a-469b-bebb-d244b27ffe1f admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:51.096739 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f2dcd-a906-460c-99f3-830393347d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:51.097635 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f2dcd-a906-460c-99f3-830393347d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:51.097903 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f2dcd-a906-460c-99f3-830393347d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:51.098175 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f2dcd-a906-460c-99f3-830393347d77 admin admin] PATH_INFO: `/v3/projects/7fa1cc2023764977a1cabea7f9912db4` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:51.100767 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3f2dcd-a906-460c-99f3-830393347d77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fa1cc2023764977a1cabea7f9912db4)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:51.109804 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3f2dcd-a906-460c-99f3-830393347d77 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:51.165304 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 899/1803] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:20:51 2021] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:20:51.166628 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0f5d5-243a-469b-bebb-d244b27ffe1f admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:51.185569 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0f5d5-243a-469b-bebb-d244b27ffe1f admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:51.193092 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f331416c-4f9f-40b8-a7da-0bc1a2bea19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:51.195237 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331416c-4f9f-40b8-a7da-0bc1a2bea19a admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:51.195914 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331416c-4f9f-40b8-a7da-0bc1a2bea19a admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:51.196369 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331416c-4f9f-40b8-a7da-0bc1a2bea19a admin admin] PATH_INFO: `/v3/projects/8222162315a7414da2968f71bfdc01be/users/64b1f5b829134350b209ad3d31a98710/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:51.229379 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f331416c-4f9f-40b8-a7da-0bc1a2bea19a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8222162315a7414da2968f71bfdc01be, user_id=64b1f5b829134350b209ad3d31a98710, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:51.230331 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-da3f2dcd-a906-460c-99f3-830393347d77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fa1cc2023764977a1cabea7f9912db4', 'request_id': 'req-da3f2dcd-a906-460c-99f3-830393347d77'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:51.234449 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f331416c-4f9f-40b8-a7da-0bc1a2bea19a admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:51.243611 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-da3f2dcd-a906-460c-99f3-830393347d77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fa1cc2023764977a1cabea7f9912db4', 'request_id': 'req-da3f2dcd-a906-460c-99f3-830393347d77'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:51.258276 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-da3f2dcd-a906-460c-99f3-830393347d77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fa1cc2023764977a1cabea7f9912db4', 'request_id': 'req-da3f2dcd-a906-460c-99f3-830393347d77'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:51.280491 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-da3f2dcd-a906-460c-99f3-830393347d77 admin admin] The token cache is being invalidate because project 7fa1cc2023764977a1cabea7f9912db4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:20:51.281259 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-da3f2dcd-a906-460c-99f3-830393347d77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:51.282136 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-da3f2dcd-a906-460c-99f3-830393347d77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:51.291871 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 900/1804] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:20:51 2021] PUT /identity/v3/projects/8222162315a7414da2968f71bfdc01be/users/64b1f5b829134350b209ad3d31a98710/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:51.294714 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe164f2a-001c-432d-bd5f-d152a2297c7b None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:51.295327 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe164f2a-001c-432d-bd5f-d152a2297c7b None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:51.295891 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe164f2a-001c-432d-bd5f-d152a2297c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:51.296579 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 905/1805] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:20:51 2021] DELETE /identity/v3/projects/7fa1cc2023764977a1cabea7f9912db4 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:51.302769 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f2dcd-a906-460c-99f3-830393347d77 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:51.304246 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-da3f2dcd-a906-460c-99f3-830393347d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:51.363707 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-fe164f2a-001c-432d-bd5f-d152a2297c7b None None] MFA Rules not processed for user `64b1f5b829134350b209ad3d31a98710`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:51.366979 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-fe164f2a-001c-432d-bd5f-d152a2297c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:51.500072 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f2dcd-a906-460c-99f3-830393347d77 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:51.535548 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 901/1806] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:51 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:51.540286 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe164f2a-001c-432d-bd5f-d152a2297c7b None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:51.543616 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-fe164f2a-001c-432d-bd5f-d152a2297c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:51.692830 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda3e10-612d-4190-ab0d-5090f807d460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:51.693974 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda3e10-612d-4190-ab0d-5090f807d460 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:51.694374 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda3e10-612d-4190-ab0d-5090f807d460 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:51.694657 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda3e10-612d-4190-ab0d-5090f807d460 admin admin] PATH_INFO: `/v3/users/be6351d7eae942358c3b633f92c08eab` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:51.698095 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda3e10-612d-4190-ab0d-5090f807d460 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be6351d7eae942358c3b633f92c08eab)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:51.700643 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfda3e10-612d-4190-ab0d-5090f807d460 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:51.708788 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe164f2a-001c-432d-bd5f-d152a2297c7b None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:51.725042 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeedfa4b-cdca-45f3-b5dc-92d2759c1b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:51.725725 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeedfa4b-cdca-45f3-b5dc-92d2759c1b0c admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:51.726039 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeedfa4b-cdca-45f3-b5dc-92d2759c1b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:51.726316 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeedfa4b-cdca-45f3-b5dc-92d2759c1b0c admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:51.727105 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeedfa4b-cdca-45f3-b5dc-92d2759c1b0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:51.729170 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeedfa4b-cdca-45f3-b5dc-92d2759c1b0c admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:51.795726 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-bfda3e10-612d-4190-ab0d-5090f807d460 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be6351d7eae942358c3b633f92c08eab'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:51.806173 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-bfda3e10-612d-4190-ab0d-5090f807d460 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be6351d7eae942358c3b633f92c08eab'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:51.811452 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 902/1807] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:20:51 2021] POST /identity/v3/projects => generated 367 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:20:51.813730 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeedfa4b-cdca-45f3-b5dc-92d2759c1b0c admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:51.833495 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-bfda3e10-612d-4190-ab0d-5090f807d460 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be6351d7eae942358c3b633f92c08eab'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:51.868915 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-bfda3e10-612d-4190-ab0d-5090f807d460 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be6351d7eae942358c3b633f92c08eab'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:51.869759 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-bfda3e10-612d-4190-ab0d-5090f807d460 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be6351d7eae942358c3b633f92c08eab'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:51.876250 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 906/1808] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:20:51 2021] DELETE /identity/v3/users/be6351d7eae942358c3b633f92c08eab => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:52.069539 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeedfa4b-cdca-45f3-b5dc-92d2759c1b0c admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:52.142750 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77724ec-e0ca-4700-9402-01ad0ae36874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:52.143647 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77724ec-e0ca-4700-9402-01ad0ae36874 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:52.144256 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77724ec-e0ca-4700-9402-01ad0ae36874 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:52.144531 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77724ec-e0ca-4700-9402-01ad0ae36874 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:52.145387 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77724ec-e0ca-4700-9402-01ad0ae36874 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:52.148051 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77724ec-e0ca-4700-9402-01ad0ae36874 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:52.179251 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 903/1809] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:20:51 2021] POST /identity/v3/users => generated 290 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:20:52.183345 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda3e10-612d-4190-ab0d-5090f807d460 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:52.185620 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-bfda3e10-612d-4190-ab0d-5090f807d460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:52.208007 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfda3e10-612d-4190-ab0d-5090f807d460 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:52.217559 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227dfa84-6139-4f67-808f-a0f7b97d54e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:52.220635 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227dfa84-6139-4f67-808f-a0f7b97d54e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:52.221238 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227dfa84-6139-4f67-808f-a0f7b97d54e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:52.221684 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227dfa84-6139-4f67-808f-a0f7b97d54e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:52.222610 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227dfa84-6139-4f67-808f-a0f7b97d54e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:52.224965 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227dfa84-6139-4f67-808f-a0f7b97d54e0 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:52.258555 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 907/1810] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:20:52 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:20:52.264424 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77724ec-e0ca-4700-9402-01ad0ae36874 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:52.283896 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77724ec-e0ca-4700-9402-01ad0ae36874 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:52.297448 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f6d46-6896-449c-8e2f-a28992d23708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:52.298661 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f6d46-6896-449c-8e2f-a28992d23708 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:52.300128 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f6d46-6896-449c-8e2f-a28992d23708 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:52.301836 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f6d46-6896-449c-8e2f-a28992d23708 admin admin] PATH_INFO: `/v3/projects/692acbcbab254bcda0646238cb7b4a02/users/4d1441870bc34edaa43c7cf4a68887ab/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:52.344038 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f6d46-6896-449c-8e2f-a28992d23708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=692acbcbab254bcda0646238cb7b4a02, user_id=4d1441870bc34edaa43c7cf4a68887ab, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:52.352232 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f6d46-6896-449c-8e2f-a28992d23708 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:52.386275 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 904/1811] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:20:52 2021] PUT /identity/v3/projects/692acbcbab254bcda0646238cb7b4a02/users/4d1441870bc34edaa43c7cf4a68887ab/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:20:52.387608 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227dfa84-6139-4f67-808f-a0f7b97d54e0 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:52.413943 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227dfa84-6139-4f67-808f-a0f7b97d54e0 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:52.481874 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2831d14-a937-494f-bd6c-2e9f6862247c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:52.482662 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2831d14-a937-494f-bd6c-2e9f6862247c admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:52.483131 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2831d14-a937-494f-bd6c-2e9f6862247c admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:52.483504 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2831d14-a937-494f-bd6c-2e9f6862247c admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:52.484366 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2831d14-a937-494f-bd6c-2e9f6862247c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:52.486660 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2831d14-a937-494f-bd6c-2e9f6862247c admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:52.503446 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 908/1812] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:20:52 2021] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:20:52.504995 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f6d46-6896-449c-8e2f-a28992d23708 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:52.519580 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f6d46-6896-449c-8e2f-a28992d23708 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:52.529380 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c54658-04d1-4b4c-bad2-d8ed6d794795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:52.530378 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c54658-04d1-4b4c-bad2-d8ed6d794795 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:52.530749 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c54658-04d1-4b4c-bad2-d8ed6d794795 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:52.531433 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c54658-04d1-4b4c-bad2-d8ed6d794795 admin admin] PATH_INFO: `/v3/projects/692acbcbab254bcda0646238cb7b4a02/users/4d1441870bc34edaa43c7cf4a68887ab/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:52.535926 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c54658-04d1-4b4c-bad2-d8ed6d794795 admin admin] RBAC: Authorizing `identity:create_grant(project_id=692acbcbab254bcda0646238cb7b4a02, user_id=4d1441870bc34edaa43c7cf4a68887ab, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:52.545439 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c54658-04d1-4b4c-bad2-d8ed6d794795 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:52.589662 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 905/1813] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:20:52 2021] PUT /identity/v3/projects/692acbcbab254bcda0646238cb7b4a02/users/4d1441870bc34edaa43c7cf4a68887ab/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:52.593606 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69646afa-1a72-4221-b33f-dac69eb477c7 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:52.595459 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69646afa-1a72-4221-b33f-dac69eb477c7 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:52.595878 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69646afa-1a72-4221-b33f-dac69eb477c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:52.643037 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-69646afa-1a72-4221-b33f-dac69eb477c7 None None] MFA Rules not processed for user `4d1441870bc34edaa43c7cf4a68887ab`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:52.644937 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-69646afa-1a72-4221-b33f-dac69eb477c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:52.850828 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 909/1814] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:52 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:52.897926 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c54658-04d1-4b4c-bad2-d8ed6d794795 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:52.899953 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-e5c54658-04d1-4b4c-bad2-d8ed6d794795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:52.986775 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c54658-04d1-4b4c-bad2-d8ed6d794795 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:52.991030 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f6d38-2449-41d1-a8f7-f017f812f568 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:52.992122 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f6d38-2449-41d1-a8f7-f017f812f568 service cinder] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:52.992589 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f6d38-2449-41d1-a8f7-f017f812f568 service cinder] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:52.993006 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f6d38-2449-41d1-a8f7-f017f812f568 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:53.008519 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f6d38-2449-41d1-a8f7-f017f812f568 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:53.010419 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f6d38-2449-41d1-a8f7-f017f812f568 service cinder] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:53.025660 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 906/1815] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:20:52 2021] GET /identity/v3/auth/tokens => generated 3301 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:20:53.122879 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69646afa-1a72-4221-b33f-dac69eb477c7 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:53.124182 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-69646afa-1a72-4221-b33f-dac69eb477c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:53.335337 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69646afa-1a72-4221-b33f-dac69eb477c7 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:53.350624 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a7768-748e-484b-8572-ae7467788f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:53.357503 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a7768-748e-484b-8572-ae7467788f47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:53.360985 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a7768-748e-484b-8572-ae7467788f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:53.361716 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a7768-748e-484b-8572-ae7467788f47 admin admin] PATH_INFO: `/v3/projects/f85397c64792463396c515bee6b4112f` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:53.368915 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a7768-748e-484b-8572-ae7467788f47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f85397c64792463396c515bee6b4112f)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:53.374992 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563a7768-748e-484b-8572-ae7467788f47 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:53.529710 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-563a7768-748e-484b-8572-ae7467788f47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f85397c64792463396c515bee6b4112f', 'request_id': 'req-563a7768-748e-484b-8572-ae7467788f47'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:53.550177 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-563a7768-748e-484b-8572-ae7467788f47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f85397c64792463396c515bee6b4112f', 'request_id': 'req-563a7768-748e-484b-8572-ae7467788f47'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:53.576790 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-563a7768-748e-484b-8572-ae7467788f47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f85397c64792463396c515bee6b4112f', 'request_id': 'req-563a7768-748e-484b-8572-ae7467788f47'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:53.615906 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-563a7768-748e-484b-8572-ae7467788f47 admin admin] The token cache is being invalidate because project f85397c64792463396c515bee6b4112f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:20:53.617758 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-563a7768-748e-484b-8572-ae7467788f47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:53.620035 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-563a7768-748e-484b-8572-ae7467788f47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:53.624553 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 910/1816] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:20:53 2021] DELETE /identity/v3/projects/f85397c64792463396c515bee6b4112f => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:53.631003 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137194eb-3521-4530-93ac-9737db66a791 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:53.631535 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137194eb-3521-4530-93ac-9737db66a791 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:53.631535 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137194eb-3521-4530-93ac-9737db66a791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:53.671027 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-137194eb-3521-4530-93ac-9737db66a791 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:53.672264 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-137194eb-3521-4530-93ac-9737db66a791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:53.808288 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 907/1817] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:53.816334 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289ca03-cd04-40e9-99b8-596b8a978723 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:53.818119 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289ca03-cd04-40e9-99b8-596b8a978723 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:53.819114 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289ca03-cd04-40e9-99b8-596b8a978723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:53.876455 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-8289ca03-cd04-40e9-99b8-596b8a978723 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:53.884271 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-8289ca03-cd04-40e9-99b8-596b8a978723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:53.898361 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 911/1818] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:53.902984 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137194eb-3521-4530-93ac-9737db66a791 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:53.922880 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137194eb-3521-4530-93ac-9737db66a791 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:53.937494 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e744a4-fca9-4b66-ab56-b386854c217a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:53.939401 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e744a4-fca9-4b66-ab56-b386854c217a admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:53.940142 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e744a4-fca9-4b66-ab56-b386854c217a admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:53.941806 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e744a4-fca9-4b66-ab56-b386854c217a admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:53.944299 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e744a4-fca9-4b66-ab56-b386854c217a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:20:53.945322 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e744a4-fca9-4b66-ab56-b386854c217a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:53.971786 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e744a4-fca9-4b66-ab56-b386854c217a admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:54.006731 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 908/1819] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:20:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:20:54.009606 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289ca03-cd04-40e9-99b8-596b8a978723 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:54.028037 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289ca03-cd04-40e9-99b8-596b8a978723 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:54.052544 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398721ce-bbbc-4ff7-82ae-fd063bb56fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:54.055126 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398721ce-bbbc-4ff7-82ae-fd063bb56fba admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:54.055563 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398721ce-bbbc-4ff7-82ae-fd063bb56fba admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:54.056706 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398721ce-bbbc-4ff7-82ae-fd063bb56fba admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:54.063124 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398721ce-bbbc-4ff7-82ae-fd063bb56fba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:54.071427 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398721ce-bbbc-4ff7-82ae-fd063bb56fba admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:54.169247 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 912/1820] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:20:54 2021] POST /identity/v3/projects => generated 387 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:20:54.174686 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e744a4-fca9-4b66-ab56-b386854c217a admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:54.195195 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e744a4-fca9-4b66-ab56-b386854c217a admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:54.302211 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c2974-4f49-4249-860b-c21b91591702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:54.305384 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c2974-4f49-4249-860b-c21b91591702 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:54.305781 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c2974-4f49-4249-860b-c21b91591702 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:54.311678 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c2974-4f49-4249-860b-c21b91591702 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:54.311678 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c2974-4f49-4249-860b-c21b91591702 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:54.313743 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c2974-4f49-4249-860b-c21b91591702 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:54.349480 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 909/1821] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:20:54 2021] POST /identity/v3/users => generated 294 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:20:54.355120 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398721ce-bbbc-4ff7-82ae-fd063bb56fba admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:54.376905 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398721ce-bbbc-4ff7-82ae-fd063bb56fba admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:54.396520 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f58db5-3104-4b6f-9c44-fe36abb810bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:54.397213 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f58db5-3104-4b6f-9c44-fe36abb810bb admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:54.397494 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f58db5-3104-4b6f-9c44-fe36abb810bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:54.397767 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f58db5-3104-4b6f-9c44-fe36abb810bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:54.404181 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f58db5-3104-4b6f-9c44-fe36abb810bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:54.406027 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f58db5-3104-4b6f-9c44-fe36abb810bb admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:54.439085 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 913/1822] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:20:54 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:20:54.442719 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c2974-4f49-4249-860b-c21b91591702 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:54.457838 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c2974-4f49-4249-860b-c21b91591702 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:54.481734 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6410c50e-dcc4-40e2-9f93-0d06607f77f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:54.482435 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410c50e-dcc4-40e2-9f93-0d06607f77f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:54.482748 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410c50e-dcc4-40e2-9f93-0d06607f77f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:54.483218 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6410c50e-dcc4-40e2-9f93-0d06607f77f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:54.484015 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6410c50e-dcc4-40e2-9f93-0d06607f77f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:54.487370 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6410c50e-dcc4-40e2-9f93-0d06607f77f6 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:54.507947 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 910/1823] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:20:54 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:20:54.513796 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f58db5-3104-4b6f-9c44-fe36abb810bb admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:54.541715 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f58db5-3104-4b6f-9c44-fe36abb810bb admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:54.546399 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573dad1-2835-4ba0-8aea-9954b2002e9e None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:54.546789 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573dad1-2835-4ba0-8aea-9954b2002e9e None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:54.547168 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573dad1-2835-4ba0-8aea-9954b2002e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:54.559222 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d83d08-0259-45b2-a6d8-a60ab5fd1c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:54.562494 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d83d08-0259-45b2-a6d8-a60ab5fd1c9c admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:54.565438 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d83d08-0259-45b2-a6d8-a60ab5fd1c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:54.565861 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d83d08-0259-45b2-a6d8-a60ab5fd1c9c admin admin] PATH_INFO: `/v3/projects/0f9eb6b21da6482e93c04429338cc99c/users/8d5f913065554ba5bb7b5326c940ab35/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:54.580992 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-a573dad1-2835-4ba0-8aea-9954b2002e9e None None] MFA Rules not processed for user `0746d603781d4b3796959e8217112cc5`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:54.582841 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-a573dad1-2835-4ba0-8aea-9954b2002e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:54.624493 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d83d08-0259-45b2-a6d8-a60ab5fd1c9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f9eb6b21da6482e93c04429338cc99c, user_id=8d5f913065554ba5bb7b5326c940ab35, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:54.632327 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d83d08-0259-45b2-a6d8-a60ab5fd1c9c admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:54.691248 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 914/1824] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:20:54 2021] PUT /identity/v3/projects/0f9eb6b21da6482e93c04429338cc99c/users/8d5f913065554ba5bb7b5326c940ab35/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:54.698069 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 911/1825] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:54 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:54.704865 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dfcc1-9341-4b45-afa8-3034dcad2381 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:54.706340 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dfcc1-9341-4b45-afa8-3034dcad2381 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:54.706709 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dfcc1-9341-4b45-afa8-3034dcad2381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:54.765923 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-bb0dfcc1-9341-4b45-afa8-3034dcad2381 None None] MFA Rules not processed for user `8d5f913065554ba5bb7b5326c940ab35`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:54.772016 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-bb0dfcc1-9341-4b45-afa8-3034dcad2381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:54.876997 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 915/1826] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:54 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:54.878299 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573dad1-2835-4ba0-8aea-9954b2002e9e None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:54.891158 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573dad1-2835-4ba0-8aea-9954b2002e9e None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:54.955373 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b628bfa-0fb8-4d14-86e1-cd186a35d149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:54.956070 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b628bfa-0fb8-4d14-86e1-cd186a35d149 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:54.956412 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b628bfa-0fb8-4d14-86e1-cd186a35d149 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:54.956680 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b628bfa-0fb8-4d14-86e1-cd186a35d149 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:54.957421 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b628bfa-0fb8-4d14-86e1-cd186a35d149 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:54.959784 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b628bfa-0fb8-4d14-86e1-cd186a35d149 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:54.999752 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 912/1827] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:20:54 2021] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:20:55.001151 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0dfcc1-9341-4b45-afa8-3034dcad2381 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:55.016579 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0dfcc1-9341-4b45-afa8-3034dcad2381 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:55.115488 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932a351-f0cc-434e-9282-6416de082d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:55.117198 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932a351-f0cc-434e-9282-6416de082d4c admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:55.117640 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932a351-f0cc-434e-9282-6416de082d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:55.118074 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d932a351-f0cc-434e-9282-6416de082d4c admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:55.119446 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d932a351-f0cc-434e-9282-6416de082d4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:55.121602 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d932a351-f0cc-434e-9282-6416de082d4c admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:55.177361 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 916/1828] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:20:55 2021] POST /identity/v3/users => generated 299 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:20:55.178189 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b628bfa-0fb8-4d14-86e1-cd186a35d149 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:55.189315 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b628bfa-0fb8-4d14-86e1-cd186a35d149 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:55.198155 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1bd618-9a0a-4967-9011-7480f201c163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:55.199065 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1bd618-9a0a-4967-9011-7480f201c163 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:55.199505 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1bd618-9a0a-4967-9011-7480f201c163 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:55.200691 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1bd618-9a0a-4967-9011-7480f201c163 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:55.202393 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1bd618-9a0a-4967-9011-7480f201c163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:55.204612 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1bd618-9a0a-4967-9011-7480f201c163 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:55.223707 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932a351-f0cc-434e-9282-6416de082d4c admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:55.230914 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 913/1829] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:20:55 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:20:55.234914 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d932a351-f0cc-434e-9282-6416de082d4c admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:55.240293 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739a41f-741d-4fb3-938e-86fd038bce74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:55.241406 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739a41f-741d-4fb3-938e-86fd038bce74 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:55.241834 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739a41f-741d-4fb3-938e-86fd038bce74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:55.242237 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739a41f-741d-4fb3-938e-86fd038bce74 admin admin] PATH_INFO: `/v3/projects/228a8c94c70245ea86c1c2370a3d0800/users/2826a1b1e66f4d4da1eca6030724adb0/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:55.265956 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d739a41f-741d-4fb3-938e-86fd038bce74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=228a8c94c70245ea86c1c2370a3d0800, user_id=2826a1b1e66f4d4da1eca6030724adb0, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:55.269249 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d739a41f-741d-4fb3-938e-86fd038bce74 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:55.280104 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1bd618-9a0a-4967-9011-7480f201c163 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:55.282766 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-ce1bd618-9a0a-4967-9011-7480f201c163 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:55.310697 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1bd618-9a0a-4967-9011-7480f201c163 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:55.313464 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 917/1830] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:20:55 2021] PUT /identity/v3/projects/228a8c94c70245ea86c1c2370a3d0800/users/2826a1b1e66f4d4da1eca6030724adb0/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:55.319008 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739a41f-741d-4fb3-938e-86fd038bce74 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:55.456775 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b629fa-c99d-4100-9532-b8c47a55652e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:55.457983 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b629fa-c99d-4100-9532-b8c47a55652e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:55.458264 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b629fa-c99d-4100-9532-b8c47a55652e admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:55.458538 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b629fa-c99d-4100-9532-b8c47a55652e admin admin] PATH_INFO: `/v3/users/5ba4e06385d64df6a34492862b1f600e` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:55.462883 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b629fa-c99d-4100-9532-b8c47a55652e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ba4e06385d64df6a34492862b1f600e)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:55.480354 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b629fa-c99d-4100-9532-b8c47a55652e admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:55.573723 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-73b629fa-c99d-4100-9532-b8c47a55652e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ba4e06385d64df6a34492862b1f600e'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:55.595224 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-73b629fa-c99d-4100-9532-b8c47a55652e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ba4e06385d64df6a34492862b1f600e'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:55.628679 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-73b629fa-c99d-4100-9532-b8c47a55652e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ba4e06385d64df6a34492862b1f600e'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:55.639188 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-73b629fa-c99d-4100-9532-b8c47a55652e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ba4e06385d64df6a34492862b1f600e'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:55.640400 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-73b629fa-c99d-4100-9532-b8c47a55652e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ba4e06385d64df6a34492862b1f600e'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:55.661365 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 914/1831] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:20:55 2021] DELETE /identity/v3/users/5ba4e06385d64df6a34492862b1f600e => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:55.665767 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054c12d-a2ed-45e0-b2cd-08cb8c258d18 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:55.666195 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054c12d-a2ed-45e0-b2cd-08cb8c258d18 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:55.666530 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054c12d-a2ed-45e0-b2cd-08cb8c258d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:55.688527 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739a41f-741d-4fb3-938e-86fd038bce74 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:55.718934 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-4054c12d-a2ed-45e0-b2cd-08cb8c258d18 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:55.720900 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-4054c12d-a2ed-45e0-b2cd-08cb8c258d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:55.838681 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 915/1832] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:55.843828 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054c12d-a2ed-45e0-b2cd-08cb8c258d18 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:55.844494 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f65e43-a528-40fc-8446-40f9bee19d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:55.845380 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f65e43-a528-40fc-8446-40f9bee19d04 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:55.845997 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f65e43-a528-40fc-8446-40f9bee19d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:55.846421 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f65e43-a528-40fc-8446-40f9bee19d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:55.847431 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f65e43-a528-40fc-8446-40f9bee19d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:55.849299 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f65e43-a528-40fc-8446-40f9bee19d04 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:55.855682 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-4054c12d-a2ed-45e0-b2cd-08cb8c258d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:55.869133 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 918/1833] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:20:55 2021] GET /identity/v3/roles => generated 1420 bytes in 551 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:20:55.873354 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f65e43-a528-40fc-8446-40f9bee19d04 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:55.875366 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-77f65e43-a528-40fc-8446-40f9bee19d04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:55.877383 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054c12d-a2ed-45e0-b2cd-08cb8c258d18 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:55.883140 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75cd224-7ccf-4419-a5e6-40b069bd9797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:55.884648 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cd224-7ccf-4419-a5e6-40b069bd9797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:55.885167 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cd224-7ccf-4419-a5e6-40b069bd9797 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:55.885695 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cd224-7ccf-4419-a5e6-40b069bd9797 admin admin] PATH_INFO: `/v3/users/64b1f5b829134350b209ad3d31a98710` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:55.887723 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75cd224-7ccf-4419-a5e6-40b069bd9797 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64b1f5b829134350b209ad3d31a98710)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:55.890213 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75cd224-7ccf-4419-a5e6-40b069bd9797 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:55.903084 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f65e43-a528-40fc-8446-40f9bee19d04 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:55.921846 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0526d7-2516-46ac-8e0e-697ebfcf0f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:55.922762 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0526d7-2516-46ac-8e0e-697ebfcf0f8f admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:55.923347 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0526d7-2516-46ac-8e0e-697ebfcf0f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:55.923641 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0526d7-2516-46ac-8e0e-697ebfcf0f8f admin admin] PATH_INFO: `/v3/projects/228a8c94c70245ea86c1c2370a3d0800/users/2826a1b1e66f4d4da1eca6030724adb0/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:55.925950 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0526d7-2516-46ac-8e0e-697ebfcf0f8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=228a8c94c70245ea86c1c2370a3d0800, user_id=2826a1b1e66f4d4da1eca6030724adb0, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:55.928720 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0526d7-2516-46ac-8e0e-697ebfcf0f8f admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:55.954779 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 919/1834] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:20:55 2021] PUT /identity/v3/projects/228a8c94c70245ea86c1c2370a3d0800/users/2826a1b1e66f4d4da1eca6030724adb0/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:55.955814 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0526d7-2516-46ac-8e0e-697ebfcf0f8f admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:55.960615 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-f75cd224-7ccf-4419-a5e6-40b069bd9797 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64b1f5b829134350b209ad3d31a98710'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:55.963224 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-fe0526d7-2516-46ac-8e0e-697ebfcf0f8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:55.989167 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-f75cd224-7ccf-4419-a5e6-40b069bd9797 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64b1f5b829134350b209ad3d31a98710'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:56.029705 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-f75cd224-7ccf-4419-a5e6-40b069bd9797 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64b1f5b829134350b209ad3d31a98710'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:56.031646 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-f75cd224-7ccf-4419-a5e6-40b069bd9797 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64b1f5b829134350b209ad3d31a98710'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:56.033887 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-f75cd224-7ccf-4419-a5e6-40b069bd9797 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64b1f5b829134350b209ad3d31a98710'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:56.058504 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 916/1835] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:20:55 2021] DELETE /identity/v3/users/64b1f5b829134350b209ad3d31a98710 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:56.060562 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530159c-5a48-40ac-babf-c579049dfdfa None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:56.061200 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530159c-5a48-40ac-babf-c579049dfdfa None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:56.062093 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530159c-5a48-40ac-babf-c579049dfdfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:56.098680 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0526d7-2516-46ac-8e0e-697ebfcf0f8f admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:56.105111 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-d530159c-5a48-40ac-babf-c579049dfdfa None None] MFA Rules not processed for user `2826a1b1e66f4d4da1eca6030724adb0`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:56.107571 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-d530159c-5a48-40ac-babf-c579049dfdfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:56.257619 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c01ca-e65a-4179-8df8-bd57b0658628 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:56.258191 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c01ca-e65a-4179-8df8-bd57b0658628 service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:56.258191 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c01ca-e65a-4179-8df8-bd57b0658628 service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:56.258874 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c01ca-e65a-4179-8df8-bd57b0658628 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:56.263622 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-4c7c01ca-e65a-4179-8df8-bd57b0658628 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:56.277657 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 917/1836] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:56 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:56.279053 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd18572-2fa2-4781-b173-083c496e9412 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:56.279337 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd18572-2fa2-4781-b173-083c496e9412 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:56.279606 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd18572-2fa2-4781-b173-083c496e9412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:56.346182 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-7cd18572-2fa2-4781-b173-083c496e9412 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:56.346182 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-7cd18572-2fa2-4781-b173-083c496e9412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:56.470724 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7c01ca-e65a-4179-8df8-bd57b0658628 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:56.488438 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7c01ca-e65a-4179-8df8-bd57b0658628 service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:56.511295 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 920/1837] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:20:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:20:56.513727 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c01ca-e65a-4179-8df8-bd57b0658628 service neutron] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:56.516110 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-4c7c01ca-e65a-4179-8df8-bd57b0658628 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:56.551029 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 918/1838] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:56.584368 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c01ca-e65a-4179-8df8-bd57b0658628 service neutron] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:56.589416 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43094b9-1c16-423a-8077-793c7562f525 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:56.590268 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43094b9-1c16-423a-8077-793c7562f525 service cinder] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:56.590692 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43094b9-1c16-423a-8077-793c7562f525 service cinder] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:56.591151 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43094b9-1c16-423a-8077-793c7562f525 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:56.593289 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd18572-2fa2-4781-b173-083c496e9412 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:56.595290 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-7cd18572-2fa2-4781-b173-083c496e9412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:56.611007 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43094b9-1c16-423a-8077-793c7562f525 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:56.613418 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43094b9-1c16-423a-8077-793c7562f525 service cinder] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:56.615111 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd18572-2fa2-4781-b173-083c496e9412 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:56.627112 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564c1040-90b4-48bc-a729-c2b9c298290d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:56.627402 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c1040-90b4-48bc-a729-c2b9c298290d service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:56.627605 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c1040-90b4-48bc-a729-c2b9c298290d service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:56.627875 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c1040-90b4-48bc-a729-c2b9c298290d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:56.647468 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c1040-90b4-48bc-a729-c2b9c298290d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:56.648932 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564c1040-90b4-48bc-a729-c2b9c298290d service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:56.652049 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 921/1839] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:20:56 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:20:56.692461 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 919/1840] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:20:56 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 29 20:20:56.701782 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43094b9-1c16-423a-8077-793c7562f525 service cinder] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:56.703356 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-b43094b9-1c16-423a-8077-793c7562f525 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:56.735991 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43094b9-1c16-423a-8077-793c7562f525 service cinder] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:56.753950 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d5d666-106c-455e-b7d4-7499f9f99e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:56.755181 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5d666-106c-455e-b7d4-7499f9f99e87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:56.755464 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5d666-106c-455e-b7d4-7499f9f99e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:56.755740 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5d666-106c-455e-b7d4-7499f9f99e87 admin admin] PATH_INFO: `/v3/users/8d5f913065554ba5bb7b5326c940ab35` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:56.756978 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d5d666-106c-455e-b7d4-7499f9f99e87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d5f913065554ba5bb7b5326c940ab35)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:56.762881 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d5d666-106c-455e-b7d4-7499f9f99e87 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:56.834549 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-72d5d666-106c-455e-b7d4-7499f9f99e87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d5f913065554ba5bb7b5326c940ab35'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:56.852055 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-72d5d666-106c-455e-b7d4-7499f9f99e87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d5f913065554ba5bb7b5326c940ab35'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:56.882788 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-72d5d666-106c-455e-b7d4-7499f9f99e87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d5f913065554ba5bb7b5326c940ab35'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:56.904971 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-72d5d666-106c-455e-b7d4-7499f9f99e87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d5f913065554ba5bb7b5326c940ab35'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:56.906259 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-72d5d666-106c-455e-b7d4-7499f9f99e87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d5f913065554ba5bb7b5326c940ab35'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:56.916404 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 922/1841] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:20:56 2021] DELETE /identity/v3/users/8d5f913065554ba5bb7b5326c940ab35 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:56.922284 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086c995-b706-48d9-9a26-6b8795da395a None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:56.923511 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086c995-b706-48d9-9a26-6b8795da395a None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:56.924033 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086c995-b706-48d9-9a26-6b8795da395a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:56.949694 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-4086c995-b706-48d9-9a26-6b8795da395a None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:56.951406 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-4086c995-b706-48d9-9a26-6b8795da395a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:57.097970 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 920/1842] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:20:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:57.131301 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d5d666-106c-455e-b7d4-7499f9f99e87 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:57.133818 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-72d5d666-106c-455e-b7d4-7499f9f99e87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:57.219990 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d5d666-106c-455e-b7d4-7499f9f99e87 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:57.227117 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2424437-fda5-4560-8c86-4c22e37902c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:57.228873 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2424437-fda5-4560-8c86-4c22e37902c4 service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:57.229370 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2424437-fda5-4560-8c86-4c22e37902c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:57.229796 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2424437-fda5-4560-8c86-4c22e37902c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:57.245640 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2424437-fda5-4560-8c86-4c22e37902c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:57.247810 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2424437-fda5-4560-8c86-4c22e37902c4 service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:57.264472 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 923/1843] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:20:57 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 29 20:20:57.639089 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8dd2af-8b2f-46f4-a851-827f4d5e951c None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:57.640147 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8dd2af-8b2f-46f4-a851-827f4d5e951c None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:57.640692 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8dd2af-8b2f-46f4-a851-827f4d5e951c None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:57.643558 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 921/1844] 10.222.0.15 () {54 vars in 921 bytes} [Mon Nov 29 20:20:57 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:20:57.704581 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978fbd77-f70d-40f5-b2e0-ccbcd20c6b67 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:57.708665 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978fbd77-f70d-40f5-b2e0-ccbcd20c6b67 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:57.708665 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978fbd77-f70d-40f5-b2e0-ccbcd20c6b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:57.782010 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-978fbd77-f70d-40f5-b2e0-ccbcd20c6b67 None None] MFA Rules not processed for user `5f76a8c3d04e440b92d12ced18d97941`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:57.787357 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-978fbd77-f70d-40f5-b2e0-ccbcd20c6b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:57.871581 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e91cab-a1d2-47a5-a889-fe7c78094aeb None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:57.871862 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e91cab-a1d2-47a5-a889-fe7c78094aeb None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:57.872134 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e91cab-a1d2-47a5-a889-fe7c78094aeb None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:57.876239 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 922/1845] 10.222.0.15 () {54 vars in 921 bytes} [Mon Nov 29 20:20:57 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:20:57.884414 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e91cab-a1d2-47a5-a889-fe7c78094aeb None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:57.887223 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-96e91cab-a1d2-47a5-a889-fe7c78094aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:57.928164 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e91cab-a1d2-47a5-a889-fe7c78094aeb None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:57.960580 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404301d-2d07-4716-b027-07c66d0b8856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:57.961757 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404301d-2d07-4716-b027-07c66d0b8856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:57.967004 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404301d-2d07-4716-b027-07c66d0b8856 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:57.967583 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404301d-2d07-4716-b027-07c66d0b8856 admin admin] PATH_INFO: `/v3/projects/8222162315a7414da2968f71bfdc01be` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:57.974263 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a404301d-2d07-4716-b027-07c66d0b8856 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8222162315a7414da2968f71bfdc01be)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:57.978691 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a404301d-2d07-4716-b027-07c66d0b8856 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:58.067068 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 924/1846] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Nov 29 20:20:57 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:58.070866 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a9240-7eb4-41c9-b1a2-63d6ab27fc58 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:58.072132 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a9240-7eb4-41c9-b1a2-63d6ab27fc58 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:58.072892 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a9240-7eb4-41c9-b1a2-63d6ab27fc58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:58.125909 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-f14a9240-7eb4-41c9-b1a2-63d6ab27fc58 None None] MFA Rules not processed for user `5f76a8c3d04e440b92d12ced18d97941`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:20:58.129353 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-f14a9240-7eb4-41c9-b1a2-63d6ab27fc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:58.190776 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-a404301d-2d07-4716-b027-07c66d0b8856 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8222162315a7414da2968f71bfdc01be', 'request_id': 'req-a404301d-2d07-4716-b027-07c66d0b8856'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:58.223656 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-a404301d-2d07-4716-b027-07c66d0b8856 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8222162315a7414da2968f71bfdc01be', 'request_id': 'req-a404301d-2d07-4716-b027-07c66d0b8856'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:58.250875 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-a404301d-2d07-4716-b027-07c66d0b8856 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8222162315a7414da2968f71bfdc01be', 'request_id': 'req-a404301d-2d07-4716-b027-07c66d0b8856'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:58.302611 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-a404301d-2d07-4716-b027-07c66d0b8856 admin admin] The token cache is being invalidate because project 8222162315a7414da2968f71bfdc01be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:20:58.302930 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-a404301d-2d07-4716-b027-07c66d0b8856 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:58.306101 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-a404301d-2d07-4716-b027-07c66d0b8856 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:58.319757 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 923/1847] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:20:57 2021] DELETE /identity/v3/projects/8222162315a7414da2968f71bfdc01be => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:20:58.322279 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404301d-2d07-4716-b027-07c66d0b8856 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:58.327001 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-a404301d-2d07-4716-b027-07c66d0b8856 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:58.371202 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 925/1848] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Nov 29 20:20:58 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:20:58.381948 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a9240-7eb4-41c9-b1a2-63d6ab27fc58 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:58.385501 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-f14a9240-7eb4-41c9-b1a2-63d6ab27fc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:58.552913 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a9240-7eb4-41c9-b1a2-63d6ab27fc58 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:58.561545 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca2847-ab42-4d78-ac1c-48d0b1b2b692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:58.563231 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca2847-ab42-4d78-ac1c-48d0b1b2b692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:58.563712 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca2847-ab42-4d78-ac1c-48d0b1b2b692 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:58.564039 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca2847-ab42-4d78-ac1c-48d0b1b2b692 admin admin] PATH_INFO: `/v3/users/4d1441870bc34edaa43c7cf4a68887ab` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:58.565955 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcca2847-ab42-4d78-ac1c-48d0b1b2b692 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d1441870bc34edaa43c7cf4a68887ab)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:58.569607 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcca2847-ab42-4d78-ac1c-48d0b1b2b692 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:58.577709 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404301d-2d07-4716-b027-07c66d0b8856 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:58.591552 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd5b9f-adae-4259-9dfe-bf9c1e1a05ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:58.592570 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd5b9f-adae-4259-9dfe-bf9c1e1a05ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:58.592787 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd5b9f-adae-4259-9dfe-bf9c1e1a05ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:58.593064 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd5b9f-adae-4259-9dfe-bf9c1e1a05ec admin admin] PATH_INFO: `/v3/projects/09baf25f2a3544419809267971c840c2` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:58.595865 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd5b9f-adae-4259-9dfe-bf9c1e1a05ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=09baf25f2a3544419809267971c840c2)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:58.600766 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd5b9f-adae-4259-9dfe-bf9c1e1a05ec admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:58.687400 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-bcca2847-ab42-4d78-ac1c-48d0b1b2b692 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d1441870bc34edaa43c7cf4a68887ab'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:58.698460 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-bcca2847-ab42-4d78-ac1c-48d0b1b2b692 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d1441870bc34edaa43c7cf4a68887ab'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:58.711122 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-bcca2847-ab42-4d78-ac1c-48d0b1b2b692 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d1441870bc34edaa43c7cf4a68887ab'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:58.715895 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-03dd5b9f-adae-4259-9dfe-bf9c1e1a05ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09baf25f2a3544419809267971c840c2', 'request_id': 'req-03dd5b9f-adae-4259-9dfe-bf9c1e1a05ec'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:58.725783 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-03dd5b9f-adae-4259-9dfe-bf9c1e1a05ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09baf25f2a3544419809267971c840c2', 'request_id': 'req-03dd5b9f-adae-4259-9dfe-bf9c1e1a05ec'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:58.731521 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-bcca2847-ab42-4d78-ac1c-48d0b1b2b692 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d1441870bc34edaa43c7cf4a68887ab'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:58.732332 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-bcca2847-ab42-4d78-ac1c-48d0b1b2b692 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d1441870bc34edaa43c7cf4a68887ab'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:58.735587 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-03dd5b9f-adae-4259-9dfe-bf9c1e1a05ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09baf25f2a3544419809267971c840c2', 'request_id': 'req-03dd5b9f-adae-4259-9dfe-bf9c1e1a05ec'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:58.743865 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 926/1849] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:20:58 2021] DELETE /identity/v3/users/4d1441870bc34edaa43c7cf4a68887ab => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:58.743865 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca2847-ab42-4d78-ac1c-48d0b1b2b692 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:58.744236 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-bcca2847-ab42-4d78-ac1c-48d0b1b2b692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:58.767837 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-03dd5b9f-adae-4259-9dfe-bf9c1e1a05ec admin admin] The token cache is being invalidate because project 09baf25f2a3544419809267971c840c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:20:58.768464 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-03dd5b9f-adae-4259-9dfe-bf9c1e1a05ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:58.769655 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-03dd5b9f-adae-4259-9dfe-bf9c1e1a05ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:58.775805 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 924/1850] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:20:58 2021] DELETE /identity/v3/projects/09baf25f2a3544419809267971c840c2 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:58.778376 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd5b9f-adae-4259-9dfe-bf9c1e1a05ec admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:58.780097 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-03dd5b9f-adae-4259-9dfe-bf9c1e1a05ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:58.843141 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca2847-ab42-4d78-ac1c-48d0b1b2b692 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:58.848659 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c5b78-f965-4eb6-88fc-179545129a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:58.850118 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c5b78-f965-4eb6-88fc-179545129a2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:58.850611 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c5b78-f965-4eb6-88fc-179545129a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:58.851111 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c5b78-f965-4eb6-88fc-179545129a2d admin admin] PATH_INFO: `/v3/projects/0f9eb6b21da6482e93c04429338cc99c` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:58.852977 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c5b78-f965-4eb6-88fc-179545129a2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f9eb6b21da6482e93c04429338cc99c)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:58.855509 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c5b78-f965-4eb6-88fc-179545129a2d admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:58.876110 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd5b9f-adae-4259-9dfe-bf9c1e1a05ec admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:58.944455 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-fe8c5b78-f965-4eb6-88fc-179545129a2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f9eb6b21da6482e93c04429338cc99c', 'request_id': 'req-fe8c5b78-f965-4eb6-88fc-179545129a2d'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:58.955620 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-fe8c5b78-f965-4eb6-88fc-179545129a2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f9eb6b21da6482e93c04429338cc99c', 'request_id': 'req-fe8c5b78-f965-4eb6-88fc-179545129a2d'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:58.969760 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-fe8c5b78-f965-4eb6-88fc-179545129a2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f9eb6b21da6482e93c04429338cc99c', 'request_id': 'req-fe8c5b78-f965-4eb6-88fc-179545129a2d'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:58.993449 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-fe8c5b78-f965-4eb6-88fc-179545129a2d admin admin] The token cache is being invalidate because project 0f9eb6b21da6482e93c04429338cc99c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:20:58.994346 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71f55d0-581d-4289-b713-5421e4e1729b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:58.994811 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-fe8c5b78-f965-4eb6-88fc-179545129a2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:58.995111 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f55d0-581d-4289-b713-5421e4e1729b service nova] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:58.995496 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f55d0-581d-4289-b713-5421e4e1729b service nova] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:58.995833 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71f55d0-581d-4289-b713-5421e4e1729b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:58.997705 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-b71f55d0-581d-4289-b713-5421e4e1729b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:58.999525 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-fe8c5b78-f965-4eb6-88fc-179545129a2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:59.002816 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 927/1851] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:20:58 2021] DELETE /identity/v3/projects/0f9eb6b21da6482e93c04429338cc99c => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:59.004819 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c5b78-f965-4eb6-88fc-179545129a2d admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:59.008337 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-fe8c5b78-f965-4eb6-88fc-179545129a2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:59.013756 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71f55d0-581d-4289-b713-5421e4e1729b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:59.015761 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71f55d0-581d-4289-b713-5421e4e1729b service nova] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:59.031144 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 925/1852] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:20:58 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:20:59.039907 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71f55d0-581d-4289-b713-5421e4e1729b service nova] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:59.044310 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-b71f55d0-581d-4289-b713-5421e4e1729b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:59.063290 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71f55d0-581d-4289-b713-5421e4e1729b service nova] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:59.095840 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c5b78-f965-4eb6-88fc-179545129a2d admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:59.107970 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d250a-582b-4594-b4d0-a683222b8c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:59.109550 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d250a-582b-4594-b4d0-a683222b8c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:59.110025 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d250a-582b-4594-b4d0-a683222b8c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:59.110436 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d250a-582b-4594-b4d0-a683222b8c4f admin admin] PATH_INFO: `/v3/users/066d32d333134195b89a25e9957a98a6` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:59.112773 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d250a-582b-4594-b4d0-a683222b8c4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=066d32d333134195b89a25e9957a98a6)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:59.126322 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d250a-582b-4594-b4d0-a683222b8c4f admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:59.161112 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95447fa5-fa7a-4f42-a974-24cdcb23a574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:59.162493 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95447fa5-fa7a-4f42-a974-24cdcb23a574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:59.163024 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95447fa5-fa7a-4f42-a974-24cdcb23a574 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:59.163513 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95447fa5-fa7a-4f42-a974-24cdcb23a574 admin admin] PATH_INFO: `/v3/users/2826a1b1e66f4d4da1eca6030724adb0` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:59.165002 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95447fa5-fa7a-4f42-a974-24cdcb23a574 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2826a1b1e66f4d4da1eca6030724adb0)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:59.167033 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95447fa5-fa7a-4f42-a974-24cdcb23a574 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:59.187815 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-a28d250a-582b-4594-b4d0-a683222b8c4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '066d32d333134195b89a25e9957a98a6'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:59.213429 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-a28d250a-582b-4594-b4d0-a683222b8c4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '066d32d333134195b89a25e9957a98a6'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:59.232867 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-a28d250a-582b-4594-b4d0-a683222b8c4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '066d32d333134195b89a25e9957a98a6'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:59.235445 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-95447fa5-fa7a-4f42-a974-24cdcb23a574 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2826a1b1e66f4d4da1eca6030724adb0'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:59.242582 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-95447fa5-fa7a-4f42-a974-24cdcb23a574 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2826a1b1e66f4d4da1eca6030724adb0'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:59.255628 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-a28d250a-582b-4594-b4d0-a683222b8c4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '066d32d333134195b89a25e9957a98a6'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:59.256373 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-a28d250a-582b-4594-b4d0-a683222b8c4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '066d32d333134195b89a25e9957a98a6'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:59.265666 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 928/1853] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:20:59 2021] DELETE /identity/v3/users/066d32d333134195b89a25e9957a98a6 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:59.266886 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-95447fa5-fa7a-4f42-a974-24cdcb23a574 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2826a1b1e66f4d4da1eca6030724adb0'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:59.267868 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d250a-582b-4594-b4d0-a683222b8c4f admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:20:59.269145 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-95447fa5-fa7a-4f42-a974-24cdcb23a574 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2826a1b1e66f4d4da1eca6030724adb0'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:59.269928 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-95447fa5-fa7a-4f42-a974-24cdcb23a574 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2826a1b1e66f4d4da1eca6030724adb0'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:20:59.270309 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-a28d250a-582b-4594-b4d0-a683222b8c4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:59.290673 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 926/1854] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:20:59 2021] DELETE /identity/v3/users/2826a1b1e66f4d4da1eca6030724adb0 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:20:59.358737 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d250a-582b-4594-b4d0-a683222b8c4f admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:20:59.433304 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5383e-382f-49a4-8cd3-d02342b13b72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:20:59.434065 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5383e-382f-49a4-8cd3-d02342b13b72 service nova] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:20:59.434420 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5383e-382f-49a4-8cd3-d02342b13b72 service nova] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:20:59.435165 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5383e-382f-49a4-8cd3-d02342b13b72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:20:59.437009 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-16e5383e-382f-49a4-8cd3-d02342b13b72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:20:59.450524 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e5383e-382f-49a4-8cd3-d02342b13b72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:20:59.452309 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e5383e-382f-49a4-8cd3-d02342b13b72 service nova] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:20:59.464828 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 929/1855] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:20:59 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:21:00.104068 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95447fa5-fa7a-4f42-a974-24cdcb23a574 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:00.106740 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-95447fa5-fa7a-4f42-a974-24cdcb23a574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:00.241126 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95447fa5-fa7a-4f42-a974-24cdcb23a574 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:00.247229 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3df06d-2915-48ac-9cca-f5350c9ba821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:00.248180 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3df06d-2915-48ac-9cca-f5350c9ba821 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:00.248586 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3df06d-2915-48ac-9cca-f5350c9ba821 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:00.248927 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3df06d-2915-48ac-9cca-f5350c9ba821 admin admin] PATH_INFO: `/v3/projects/692acbcbab254bcda0646238cb7b4a02` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:00.250763 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3df06d-2915-48ac-9cca-f5350c9ba821 admin admin] RBAC: Authorizing `identity:delete_project(project_id=692acbcbab254bcda0646238cb7b4a02)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:00.252846 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3df06d-2915-48ac-9cca-f5350c9ba821 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:00.307795 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-2f3df06d-2915-48ac-9cca-f5350c9ba821 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '692acbcbab254bcda0646238cb7b4a02', 'request_id': 'req-2f3df06d-2915-48ac-9cca-f5350c9ba821'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:00.316654 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-2f3df06d-2915-48ac-9cca-f5350c9ba821 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '692acbcbab254bcda0646238cb7b4a02', 'request_id': 'req-2f3df06d-2915-48ac-9cca-f5350c9ba821'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:00.324903 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-2f3df06d-2915-48ac-9cca-f5350c9ba821 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '692acbcbab254bcda0646238cb7b4a02', 'request_id': 'req-2f3df06d-2915-48ac-9cca-f5350c9ba821'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:00.344436 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-2f3df06d-2915-48ac-9cca-f5350c9ba821 admin admin] The token cache is being invalidate because project 692acbcbab254bcda0646238cb7b4a02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:21:00.344436 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-2f3df06d-2915-48ac-9cca-f5350c9ba821 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:00.345283 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-2f3df06d-2915-48ac-9cca-f5350c9ba821 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:00.347320 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 927/1856] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:21:00 2021] DELETE /identity/v3/projects/692acbcbab254bcda0646238cb7b4a02 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:21:00.353161 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db86bbb-792c-41dc-ac19-b266c094c90d None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:00.358895 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db86bbb-792c-41dc-ac19-b266c094c90d None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:00.359289 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db86bbb-792c-41dc-ac19-b266c094c90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:00.387129 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-2db86bbb-792c-41dc-ac19-b266c094c90d None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:21:00.388574 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-2db86bbb-792c-41dc-ac19-b266c094c90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:00.445943 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3df06d-2915-48ac-9cca-f5350c9ba821 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:00.447644 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-2f3df06d-2915-48ac-9cca-f5350c9ba821 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:00.533078 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 930/1857] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:21:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:21:00.541209 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741d7e1-fe78-479a-bc79-58befd1c0e1a None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:00.541804 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741d7e1-fe78-479a-bc79-58befd1c0e1a None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:00.542282 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741d7e1-fe78-479a-bc79-58befd1c0e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:00.572162 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3df06d-2915-48ac-9cca-f5350c9ba821 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:00.584246 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892879b8-34e9-46aa-8f11-1918e8a02249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:00.587056 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892879b8-34e9-46aa-8f11-1918e8a02249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:00.587531 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892879b8-34e9-46aa-8f11-1918e8a02249 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:00.588006 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892879b8-34e9-46aa-8f11-1918e8a02249 admin admin] PATH_INFO: `/v3/projects/228a8c94c70245ea86c1c2370a3d0800` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:00.590587 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-c741d7e1-fe78-479a-bc79-58befd1c0e1a None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:21:00.591715 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-c741d7e1-fe78-479a-bc79-58befd1c0e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:00.592298 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892879b8-34e9-46aa-8f11-1918e8a02249 admin admin] RBAC: Authorizing `identity:delete_project(project_id=228a8c94c70245ea86c1c2370a3d0800)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:00.595333 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892879b8-34e9-46aa-8f11-1918e8a02249 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:00.614668 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 931/1858] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:21:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:21:00.614668 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741d7e1-fe78-479a-bc79-58befd1c0e1a None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:00.614668 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-c741d7e1-fe78-479a-bc79-58befd1c0e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:00.641601 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741d7e1-fe78-479a-bc79-58befd1c0e1a None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:00.655177 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab654a3-612d-4e00-9f69-fc64b75ee402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:00.656305 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab654a3-612d-4e00-9f69-fc64b75ee402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:00.656773 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab654a3-612d-4e00-9f69-fc64b75ee402 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:00.657142 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab654a3-612d-4e00-9f69-fc64b75ee402 admin admin] PATH_INFO: `/v3/projects/7d9483cd436d44689b4fd17461ff0ef6` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:00.659375 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab654a3-612d-4e00-9f69-fc64b75ee402 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d9483cd436d44689b4fd17461ff0ef6)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:00.661938 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab654a3-612d-4e00-9f69-fc64b75ee402 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:00.662748 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-892879b8-34e9-46aa-8f11-1918e8a02249 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '228a8c94c70245ea86c1c2370a3d0800', 'request_id': 'req-892879b8-34e9-46aa-8f11-1918e8a02249'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:00.673465 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-892879b8-34e9-46aa-8f11-1918e8a02249 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '228a8c94c70245ea86c1c2370a3d0800', 'request_id': 'req-892879b8-34e9-46aa-8f11-1918e8a02249'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:00.680454 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-892879b8-34e9-46aa-8f11-1918e8a02249 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '228a8c94c70245ea86c1c2370a3d0800', 'request_id': 'req-892879b8-34e9-46aa-8f11-1918e8a02249'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:00.695773 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-892879b8-34e9-46aa-8f11-1918e8a02249 admin admin] The token cache is being invalidate because project 228a8c94c70245ea86c1c2370a3d0800 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:21:00.696143 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-892879b8-34e9-46aa-8f11-1918e8a02249 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:00.696720 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-892879b8-34e9-46aa-8f11-1918e8a02249 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:00.698777 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 928/1859] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:21:00 2021] DELETE /identity/v3/projects/228a8c94c70245ea86c1c2370a3d0800 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:21:00.699642 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892879b8-34e9-46aa-8f11-1918e8a02249 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:00.700962 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-892879b8-34e9-46aa-8f11-1918e8a02249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:00.739134 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-dab654a3-612d-4e00-9f69-fc64b75ee402 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d9483cd436d44689b4fd17461ff0ef6', 'request_id': 'req-dab654a3-612d-4e00-9f69-fc64b75ee402'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:00.748813 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-dab654a3-612d-4e00-9f69-fc64b75ee402 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d9483cd436d44689b4fd17461ff0ef6', 'request_id': 'req-dab654a3-612d-4e00-9f69-fc64b75ee402'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:00.763471 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-dab654a3-612d-4e00-9f69-fc64b75ee402 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d9483cd436d44689b4fd17461ff0ef6', 'request_id': 'req-dab654a3-612d-4e00-9f69-fc64b75ee402'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:00.779086 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-dab654a3-612d-4e00-9f69-fc64b75ee402 admin admin] The token cache is being invalidate because project 7d9483cd436d44689b4fd17461ff0ef6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:21:00.779862 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-dab654a3-612d-4e00-9f69-fc64b75ee402 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:00.781464 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-dab654a3-612d-4e00-9f69-fc64b75ee402 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:00.786566 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892879b8-34e9-46aa-8f11-1918e8a02249 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:00.798304 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 932/1860] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:21:00 2021] DELETE /identity/v3/projects/7d9483cd436d44689b4fd17461ff0ef6 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:21:00.800201 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871afc09-1c96-49d1-8ffb-71cdef9b0ef3 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:00.800595 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871afc09-1c96-49d1-8ffb-71cdef9b0ef3 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:00.800973 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871afc09-1c96-49d1-8ffb-71cdef9b0ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:00.826516 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-871afc09-1c96-49d1-8ffb-71cdef9b0ef3 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:21:00.828099 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-871afc09-1c96-49d1-8ffb-71cdef9b0ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:00.874184 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2672b8-72a3-44ce-9bd9-7d6285a3c3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:00.876068 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2672b8-72a3-44ce-9bd9-7d6285a3c3c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:00.876427 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2672b8-72a3-44ce-9bd9-7d6285a3c3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:00.876771 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2672b8-72a3-44ce-9bd9-7d6285a3c3c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:00.877592 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2672b8-72a3-44ce-9bd9-7d6285a3c3c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:21:00.877971 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2672b8-72a3-44ce-9bd9-7d6285a3c3c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:00.879914 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2672b8-72a3-44ce-9bd9-7d6285a3c3c5 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:00.899625 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 929/1861] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:21:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:21:00.902059 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29929133-0857-4318-b6b4-797c81efd036 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:00.902415 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29929133-0857-4318-b6b4-797c81efd036 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:00.902755 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29929133-0857-4318-b6b4-797c81efd036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:00.926945 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 933/1862] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:21:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:21:00.926945 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871afc09-1c96-49d1-8ffb-71cdef9b0ef3 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:00.926945 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-871afc09-1c96-49d1-8ffb-71cdef9b0ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:00.928680 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-29929133-0857-4318-b6b4-797c81efd036 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:21:00.930080 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-29929133-0857-4318-b6b4-797c81efd036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:00.940321 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871afc09-1c96-49d1-8ffb-71cdef9b0ef3 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:00.944972 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 930/1863] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:21:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:21:00.946617 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062dc0c-415f-47fe-870c-0c36c0e25d11 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:00.946992 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062dc0c-415f-47fe-870c-0c36c0e25d11 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:00.947274 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062dc0c-415f-47fe-870c-0c36c0e25d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:00.952348 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ac230-1b64-4890-8aae-250e0a82ab94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:00.953065 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ac230-1b64-4890-8aae-250e0a82ab94 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:00.953342 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ac230-1b64-4890-8aae-250e0a82ab94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:00.954704 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ac230-1b64-4890-8aae-250e0a82ab94 admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:00.955557 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08ac230-1b64-4890-8aae-250e0a82ab94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:00.958721 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08ac230-1b64-4890-8aae-250e0a82ab94 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:00.980184 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-b062dc0c-415f-47fe-870c-0c36c0e25d11 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:21:00.981543 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-b062dc0c-415f-47fe-870c-0c36c0e25d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:00.993785 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 931/1864] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:21:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:21:00.993785 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75490fd2-3e94-4d4d-95dd-49662f4aa559 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:00.993785 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75490fd2-3e94-4d4d-95dd-49662f4aa559 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:00.993785 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75490fd2-3e94-4d4d-95dd-49662f4aa559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:01.009548 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 934/1865] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:21:00 2021] POST /identity/v3/projects => generated 379 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:21:01.010733 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ac230-1b64-4890-8aae-250e0a82ab94 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:01.013889 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-75490fd2-3e94-4d4d-95dd-49662f4aa559 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:21:01.017580 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-75490fd2-3e94-4d4d-95dd-49662f4aa559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:01.093812 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ac230-1b64-4890-8aae-250e0a82ab94 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:01.098052 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 932/1866] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:21:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:21:01.099163 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75490fd2-3e94-4d4d-95dd-49662f4aa559 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:01.100427 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f13279-7ab5-4f27-aaae-56cc55f204f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:01.101844 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f13279-7ab5-4f27-aaae-56cc55f204f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:01.101844 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f13279-7ab5-4f27-aaae-56cc55f204f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:01.102056 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f13279-7ab5-4f27-aaae-56cc55f204f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:01.102667 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f13279-7ab5-4f27-aaae-56cc55f204f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:21:01.102975 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f13279-7ab5-4f27-aaae-56cc55f204f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:01.104598 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f13279-7ab5-4f27-aaae-56cc55f204f9 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:01.111148 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75490fd2-3e94-4d4d-95dd-49662f4aa559 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:01.117159 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5324c-23a9-490e-9a53-ed0b8308eb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:01.117255 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5324c-23a9-490e-9a53-ed0b8308eb32 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:01.117661 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5324c-23a9-490e-9a53-ed0b8308eb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:01.118461 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 935/1867] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:21:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:21:01.119615 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f13279-7ab5-4f27-aaae-56cc55f204f9 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:01.121798 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c5324c-23a9-490e-9a53-ed0b8308eb32 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:01.122616 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5324c-23a9-490e-9a53-ed0b8308eb32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:01.124679 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c5324c-23a9-490e-9a53-ed0b8308eb32 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:01.131354 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f13279-7ab5-4f27-aaae-56cc55f204f9 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:01.136446 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798fed53-4ae2-4fcc-985a-ab1d77a5c6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:01.137118 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798fed53-4ae2-4fcc-985a-ab1d77a5c6fe admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:01.137402 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798fed53-4ae2-4fcc-985a-ab1d77a5c6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:01.137699 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798fed53-4ae2-4fcc-985a-ab1d77a5c6fe admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:01.138525 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798fed53-4ae2-4fcc-985a-ab1d77a5c6fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:21:01.139367 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798fed53-4ae2-4fcc-985a-ab1d77a5c6fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:01.140956 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798fed53-4ae2-4fcc-985a-ab1d77a5c6fe admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:01.164166 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 933/1868] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:21:01 2021] POST /identity/v3/users => generated 290 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:21:01.165580 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5324c-23a9-490e-9a53-ed0b8308eb32 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:01.168356 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 936/1869] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:21:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:21:01.169302 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798fed53-4ae2-4fcc-985a-ab1d77a5c6fe admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:01.181812 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c5324c-23a9-490e-9a53-ed0b8308eb32 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:01.186705 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798fed53-4ae2-4fcc-985a-ab1d77a5c6fe admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:01.187989 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe711d-8ae8-4eed-ae32-a4243fa1f7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:01.188830 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe711d-8ae8-4eed-ae32-a4243fa1f7f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:01.189260 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe711d-8ae8-4eed-ae32-a4243fa1f7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:01.189673 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe711d-8ae8-4eed-ae32-a4243fa1f7f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:01.190520 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe711d-8ae8-4eed-ae32-a4243fa1f7f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:01.191959 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee46ad-de35-4412-87d8-fc1ff5a5d74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:01.192832 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe711d-8ae8-4eed-ae32-a4243fa1f7f5 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:01.192963 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee46ad-de35-4412-87d8-fc1ff5a5d74c admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:01.194195 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee46ad-de35-4412-87d8-fc1ff5a5d74c admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:01.194402 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee46ad-de35-4412-87d8-fc1ff5a5d74c admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:01.195318 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee46ad-de35-4412-87d8-fc1ff5a5d74c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:01.197026 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee46ad-de35-4412-87d8-fc1ff5a5d74c admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:01.214942 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 937/1870] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:21:01 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:21:01.214942 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee46ad-de35-4412-87d8-fc1ff5a5d74c admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:01.226150 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee46ad-de35-4412-87d8-fc1ff5a5d74c admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:01.229580 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 934/1871] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:21:01 2021] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:21:01.230767 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe711d-8ae8-4eed-ae32-a4243fa1f7f5 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:01.236914 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6f085-a136-41c8-bfb3-e10937b9219b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:01.237704 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6f085-a136-41c8-bfb3-e10937b9219b admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:01.238142 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6f085-a136-41c8-bfb3-e10937b9219b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:01.238420 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6f085-a136-41c8-bfb3-e10937b9219b admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:01.239464 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf6f085-a136-41c8-bfb3-e10937b9219b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:01.242112 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf6f085-a136-41c8-bfb3-e10937b9219b admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:01.282175 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 938/1872] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:21:01 2021] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:21:01.282175 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6f085-a136-41c8-bfb3-e10937b9219b admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:01.318054 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe711d-8ae8-4eed-ae32-a4243fa1f7f5 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:01.354155 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6f085-a136-41c8-bfb3-e10937b9219b admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:01.360119 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89a322-82c4-4759-920c-c123d50a0aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:01.360795 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89a322-82c4-4759-920c-c123d50a0aa9 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:01.361077 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89a322-82c4-4759-920c-c123d50a0aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:01.361403 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e89a322-82c4-4759-920c-c123d50a0aa9 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:01.362059 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e89a322-82c4-4759-920c-c123d50a0aa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:01.364404 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e89a322-82c4-4759-920c-c123d50a0aa9 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:01.397555 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 939/1873] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:21:01 2021] POST /identity/v3/users => generated 287 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:21:01.397555 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89a322-82c4-4759-920c-c123d50a0aa9 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:01.404223 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e275f-a815-46fa-b5c8-f47f0d57e212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:01.404940 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e275f-a815-46fa-b5c8-f47f0d57e212 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:01.405220 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e275f-a815-46fa-b5c8-f47f0d57e212 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:01.405515 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e275f-a815-46fa-b5c8-f47f0d57e212 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:01.406268 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e275f-a815-46fa-b5c8-f47f0d57e212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:01.408034 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e275f-a815-46fa-b5c8-f47f0d57e212 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:01.410723 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e89a322-82c4-4759-920c-c123d50a0aa9 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:01.417257 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a038d19-b97f-443e-85a3-5e93485abc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:01.417978 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a038d19-b97f-443e-85a3-5e93485abc2e admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:01.418265 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a038d19-b97f-443e-85a3-5e93485abc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:01.418536 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a038d19-b97f-443e-85a3-5e93485abc2e admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:01.419283 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a038d19-b97f-443e-85a3-5e93485abc2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:01.419982 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 935/1874] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:21:01 2021] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:21:01.421415 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a038d19-b97f-443e-85a3-5e93485abc2e admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:01.425259 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e275f-a815-46fa-b5c8-f47f0d57e212 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:01.437586 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e275f-a815-46fa-b5c8-f47f0d57e212 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:01.444008 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c19bd8f-4042-41fd-a950-13690de81c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:01.445054 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19bd8f-4042-41fd-a950-13690de81c72 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:01.445249 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19bd8f-4042-41fd-a950-13690de81c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:01.445520 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19bd8f-4042-41fd-a950-13690de81c72 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:01.446420 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c19bd8f-4042-41fd-a950-13690de81c72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:01.448090 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c19bd8f-4042-41fd-a950-13690de81c72 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:01.459234 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 940/1875] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:21:01 2021] POST /identity/v3/users => generated 288 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:21:01.460074 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a038d19-b97f-443e-85a3-5e93485abc2e admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:01.463535 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 936/1876] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:21:01 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:21:01.463535 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c19bd8f-4042-41fd-a950-13690de81c72 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:01.474865 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a038d19-b97f-443e-85a3-5e93485abc2e admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:01.477193 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c19bd8f-4042-41fd-a950-13690de81c72 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:01.482071 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09b755-0ed9-4968-a847-ec2f15dd4389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:01.483394 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee4212-574d-4035-a1f0-1769d123f288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:01.483540 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09b755-0ed9-4968-a847-ec2f15dd4389 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:01.483785 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09b755-0ed9-4968-a847-ec2f15dd4389 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:01.484066 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09b755-0ed9-4968-a847-ec2f15dd4389 admin admin] PATH_INFO: `/v3/projects/4ebcaf445a6847009f1d74674522a62a/users/662ee30ff3ee4e4d90349f2ee42922d5/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:01.485633 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee4212-574d-4035-a1f0-1769d123f288 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:01.486104 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee4212-574d-4035-a1f0-1769d123f288 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:01.487269 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee4212-574d-4035-a1f0-1769d123f288 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:01.488221 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee4212-574d-4035-a1f0-1769d123f288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:01.490050 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee4212-574d-4035-a1f0-1769d123f288 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:01.503166 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f09b755-0ed9-4968-a847-ec2f15dd4389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ebcaf445a6847009f1d74674522a62a, user_id=662ee30ff3ee4e4d90349f2ee42922d5, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:01.506015 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f09b755-0ed9-4968-a847-ec2f15dd4389 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:01.522949 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 941/1877] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:21:01 2021] PUT /identity/v3/projects/4ebcaf445a6847009f1d74674522a62a/users/662ee30ff3ee4e4d90349f2ee42922d5/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:21:01.524079 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09b755-0ed9-4968-a847-ec2f15dd4389 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:01.534580 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 937/1878] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:21:01 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 29 20:21:01.537820 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947fa64-c66d-41cc-9eb9-f5f9db720a74 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:01.539262 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947fa64-c66d-41cc-9eb9-f5f9db720a74 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:01.540037 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947fa64-c66d-41cc-9eb9-f5f9db720a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:01.584265 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-d947fa64-c66d-41cc-9eb9-f5f9db720a74 None None] MFA Rules not processed for user `662ee30ff3ee4e4d90349f2ee42922d5`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:21:01.585671 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-d947fa64-c66d-41cc-9eb9-f5f9db720a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:01.673807 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 938/1879] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:21:01 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:21:01.675789 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d947fa64-c66d-41cc-9eb9-f5f9db720a74 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:01.698654 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09b755-0ed9-4968-a847-ec2f15dd4389 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:01.710928 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a69d0cd-d671-4184-a557-636aab77f853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:01.712470 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69d0cd-d671-4184-a557-636aab77f853 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:01.714490 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69d0cd-d671-4184-a557-636aab77f853 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:01.714881 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a69d0cd-d671-4184-a557-636aab77f853 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:01.715994 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a69d0cd-d671-4184-a557-636aab77f853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:01.717770 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a69d0cd-d671-4184-a557-636aab77f853 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:01.751754 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 942/1880] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:21:01 2021] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:21:01.757097 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a69d0cd-d671-4184-a557-636aab77f853 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:01.784525 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a69d0cd-d671-4184-a557-636aab77f853 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:01.800098 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a806baa-1b17-4047-a76f-cc036bd7c5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:01.800898 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a806baa-1b17-4047-a76f-cc036bd7c5cc admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:01.801271 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a806baa-1b17-4047-a76f-cc036bd7c5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:01.801638 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a806baa-1b17-4047-a76f-cc036bd7c5cc admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:01.803159 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a806baa-1b17-4047-a76f-cc036bd7c5cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:01.805884 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a806baa-1b17-4047-a76f-cc036bd7c5cc admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:01.825111 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d947fa64-c66d-41cc-9eb9-f5f9db720a74 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:01.833060 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec6d7e-0235-46ab-9cbc-ba2bf8021b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:01.834059 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec6d7e-0235-46ab-9cbc-ba2bf8021b91 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:01.834494 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec6d7e-0235-46ab-9cbc-ba2bf8021b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:01.835089 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ec6d7e-0235-46ab-9cbc-ba2bf8021b91 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:01.836264 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ec6d7e-0235-46ab-9cbc-ba2bf8021b91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:01.838311 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ec6d7e-0235-46ab-9cbc-ba2bf8021b91 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:01.852073 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 943/1881] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:21:01 2021] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:21:01.853494 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 939/1882] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:21:01 2021] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:21:01.856071 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a806baa-1b17-4047-a76f-cc036bd7c5cc admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:01.859333 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec6d7e-0235-46ab-9cbc-ba2bf8021b91 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:01.878590 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ec6d7e-0235-46ab-9cbc-ba2bf8021b91 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:01.959576 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a806baa-1b17-4047-a76f-cc036bd7c5cc admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:01.960208 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c54eb-feb1-439e-a712-b5e08fe96957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:01.961125 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c54eb-feb1-439e-a712-b5e08fe96957 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:01.961551 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c54eb-feb1-439e-a712-b5e08fe96957 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:01.962159 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c54eb-feb1-439e-a712-b5e08fe96957 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:01.963050 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c54eb-feb1-439e-a712-b5e08fe96957 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:01.967586 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4578c7fa-4791-4e1f-b24f-6f703a8c72c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:01.968741 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578c7fa-4791-4e1f-b24f-6f703a8c72c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:01.969027 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578c7fa-4791-4e1f-b24f-6f703a8c72c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:01.969304 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578c7fa-4791-4e1f-b24f-6f703a8c72c1 admin admin] PATH_INFO: `/v3/projects/8f97606ad0ff47edb7c25c7bea31d281/users/2c3b66e6fc1c40dba4c871927a632448/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:01.972683 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c54eb-feb1-439e-a712-b5e08fe96957 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:01.992761 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4578c7fa-4791-4e1f-b24f-6f703a8c72c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f97606ad0ff47edb7c25c7bea31d281, user_id=2c3b66e6fc1c40dba4c871927a632448, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:01.996300 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4578c7fa-4791-4e1f-b24f-6f703a8c72c1 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:02.028324 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 944/1883] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:21:01 2021] PUT /identity/v3/projects/8f97606ad0ff47edb7c25c7bea31d281/users/2c3b66e6fc1c40dba4c871927a632448/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:21:02.028324 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4578c7fa-4791-4e1f-b24f-6f703a8c72c1 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:02.046375 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 940/1884] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:21:01 2021] POST /identity/v3/users => generated 296 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:21:02.046375 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f0806-b4ca-4cc8-ab8c-dd6a4e7a5008 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:02.046375 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f0806-b4ca-4cc8-ab8c-dd6a4e7a5008 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:02.046375 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f0806-b4ca-4cc8-ab8c-dd6a4e7a5008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:02.080749 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-4a0f0806-b4ca-4cc8-ab8c-dd6a4e7a5008 None None] MFA Rules not processed for user `2c3b66e6fc1c40dba4c871927a632448`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:21:02.082423 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-4a0f0806-b4ca-4cc8-ab8c-dd6a4e7a5008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:02.129516 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4578c7fa-4791-4e1f-b24f-6f703a8c72c1 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:02.134472 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a28074-359b-49c6-91df-b86df844b660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:02.135601 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a28074-359b-49c6-91df-b86df844b660 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:02.136148 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a28074-359b-49c6-91df-b86df844b660 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:02.136730 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a28074-359b-49c6-91df-b86df844b660 admin admin] PATH_INFO: `/v3/projects/65eb05cde6454c5a8a0db9ec8b84428a/users/12594eb212cb44e2a2aa066e1c66d9b7/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:02.154095 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a28074-359b-49c6-91df-b86df844b660 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65eb05cde6454c5a8a0db9ec8b84428a, user_id=12594eb212cb44e2a2aa066e1c66d9b7, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:02.157994 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a28074-359b-49c6-91df-b86df844b660 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:02.172614 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 941/1885] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:21:02 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:21:02.173762 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f0806-b4ca-4cc8-ab8c-dd6a4e7a5008 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:02.186630 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f0806-b4ca-4cc8-ab8c-dd6a4e7a5008 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:02.202293 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 945/1886] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:21:02 2021] PUT /identity/v3/projects/65eb05cde6454c5a8a0db9ec8b84428a/users/12594eb212cb44e2a2aa066e1c66d9b7/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:21:02.203902 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a28074-359b-49c6-91df-b86df844b660 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:02.210807 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-48a28074-359b-49c6-91df-b86df844b660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:02.288290 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aff46f-6a8b-4071-9c0d-0423d9e12827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:02.289144 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aff46f-6a8b-4071-9c0d-0423d9e12827 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:02.289295 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aff46f-6a8b-4071-9c0d-0423d9e12827 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:02.289567 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aff46f-6a8b-4071-9c0d-0423d9e12827 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:02.290310 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aff46f-6a8b-4071-9c0d-0423d9e12827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:02.291962 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aff46f-6a8b-4071-9c0d-0423d9e12827 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:02.326252 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 942/1887] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:21:02 2021] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:21:02.326252 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa54d0-a175-4627-b081-179bc4ffb74f None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:02.326252 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa54d0-a175-4627-b081-179bc4ffb74f None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:02.326252 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa54d0-a175-4627-b081-179bc4ffb74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:02.337003 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a28074-359b-49c6-91df-b86df844b660 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:02.346791 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d3986-851c-4f87-af84-f69fe5af6c76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:02.348590 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d3986-851c-4f87-af84-f69fe5af6c76 service cinder] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:02.349279 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d3986-851c-4f87-af84-f69fe5af6c76 service cinder] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:02.349560 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d3986-851c-4f87-af84-f69fe5af6c76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:02.370160 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-a1aa54d0-a175-4627-b081-179bc4ffb74f None None] MFA Rules not processed for user `12594eb212cb44e2a2aa066e1c66d9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:21:02.371400 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-a1aa54d0-a175-4627-b081-179bc4ffb74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:02.416643 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d3986-851c-4f87-af84-f69fe5af6c76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:02.418135 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d3986-851c-4f87-af84-f69fe5af6c76 service cinder] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:02.439936 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 946/1888] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:21:02 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:21:02.440630 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d3986-851c-4f87-af84-f69fe5af6c76 service cinder] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:02.458937 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d3986-851c-4f87-af84-f69fe5af6c76 service cinder] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:02.477812 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d74d3b-919e-4afc-ab64-a874ff53a29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:02.478727 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d74d3b-919e-4afc-ab64-a874ff53a29d admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:02.483138 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d74d3b-919e-4afc-ab64-a874ff53a29d admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:02.483487 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d74d3b-919e-4afc-ab64-a874ff53a29d admin admin] PATH_INFO: `/v3/projects/0bc479600f714cc29751122e3a17eabb/users/2eeeaa3b20384faba2ff693e46ffb6e9/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:02.492753 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 943/1889] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:21:02 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:21:02.494235 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa54d0-a175-4627-b081-179bc4ffb74f None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:02.511474 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d74d3b-919e-4afc-ab64-a874ff53a29d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bc479600f714cc29751122e3a17eabb, user_id=2eeeaa3b20384faba2ff693e46ffb6e9, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:02.517343 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d74d3b-919e-4afc-ab64-a874ff53a29d admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:02.524594 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa54d0-a175-4627-b081-179bc4ffb74f None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:02.548713 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 947/1890] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:21:02 2021] PUT /identity/v3/projects/0bc479600f714cc29751122e3a17eabb/users/2eeeaa3b20384faba2ff693e46ffb6e9/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:21:02.549659 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d74d3b-919e-4afc-ab64-a874ff53a29d admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:02.566998 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592016df-6a90-42da-86bc-d085c44ed0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:02.569301 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592016df-6a90-42da-86bc-d085c44ed0ba admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:02.569601 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592016df-6a90-42da-86bc-d085c44ed0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:02.570374 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592016df-6a90-42da-86bc-d085c44ed0ba admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:02.574105 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592016df-6a90-42da-86bc-d085c44ed0ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:02.580859 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592016df-6a90-42da-86bc-d085c44ed0ba admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:02.666758 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 944/1891] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:21:02 2021] POST /identity/v3/projects => generated 375 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:21:02.671644 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592016df-6a90-42da-86bc-d085c44ed0ba admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:02.736570 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d74d3b-919e-4afc-ab64-a874ff53a29d admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:02.786811 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592016df-6a90-42da-86bc-d085c44ed0ba admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:02.794165 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc39dd-6196-4de6-8e61-c3a7570cd22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:02.794907 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc39dd-6196-4de6-8e61-c3a7570cd22a admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:02.795201 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc39dd-6196-4de6-8e61-c3a7570cd22a admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:02.795542 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc39dd-6196-4de6-8e61-c3a7570cd22a admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:02.796858 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fc39dd-6196-4de6-8e61-c3a7570cd22a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:02.799268 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fc39dd-6196-4de6-8e61-c3a7570cd22a admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:02.840310 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 945/1892] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:21:02 2021] POST /identity/v3/users => generated 294 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:21:02.842062 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc39dd-6196-4de6-8e61-c3a7570cd22a admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:02.854526 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc39dd-6196-4de6-8e61-c3a7570cd22a admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:02.859809 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb7601-adda-4213-b181-ebcb101f2bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:02.860836 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb7601-adda-4213-b181-ebcb101f2bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:02.861393 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb7601-adda-4213-b181-ebcb101f2bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:02.861953 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb7601-adda-4213-b181-ebcb101f2bd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:02.863110 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb7601-adda-4213-b181-ebcb101f2bd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:02.865465 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb7601-adda-4213-b181-ebcb101f2bd3 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:02.876485 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73379602-70c5-4561-b5f5-234ad6f88da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:02.878049 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73379602-70c5-4561-b5f5-234ad6f88da2 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:02.883733 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73379602-70c5-4561-b5f5-234ad6f88da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:02.883733 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73379602-70c5-4561-b5f5-234ad6f88da2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:02.883733 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73379602-70c5-4561-b5f5-234ad6f88da2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:02.884884 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 946/1893] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:21:02 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:21:02.886031 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb7601-adda-4213-b181-ebcb101f2bd3 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:02.888550 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73379602-70c5-4561-b5f5-234ad6f88da2 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:02.898919 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb7601-adda-4213-b181-ebcb101f2bd3 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:02.909874 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff669f81-b163-4d12-a639-7aaa20597cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:02.913741 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff669f81-b163-4d12-a639-7aaa20597cb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:02.913869 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 948/1894] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:21:02 2021] GET /identity/v3/roles => generated 1420 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:21:02.913974 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff669f81-b163-4d12-a639-7aaa20597cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:02.913974 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff669f81-b163-4d12-a639-7aaa20597cb4 admin admin] PATH_INFO: `/v3/projects/6f76cdd5e94b4b89abb2f6185ed55b97/users/a0d0570a796340e7ab1e68d9ae222fd6/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:02.914834 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73379602-70c5-4561-b5f5-234ad6f88da2 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:02.931423 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff669f81-b163-4d12-a639-7aaa20597cb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f76cdd5e94b4b89abb2f6185ed55b97, user_id=a0d0570a796340e7ab1e68d9ae222fd6, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:02.934981 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff669f81-b163-4d12-a639-7aaa20597cb4 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:02.943381 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73379602-70c5-4561-b5f5-234ad6f88da2 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:02.956513 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 947/1895] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:21:02 2021] PUT /identity/v3/projects/6f76cdd5e94b4b89abb2f6185ed55b97/users/a0d0570a796340e7ab1e68d9ae222fd6/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:21:02.959658 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60b81d-0329-4bf3-85c7-12620932ceec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:02.959658 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60b81d-0329-4bf3-85c7-12620932ceec admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:02.959658 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60b81d-0329-4bf3-85c7-12620932ceec admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:02.959658 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60b81d-0329-4bf3-85c7-12620932ceec admin admin] PATH_INFO: `/v3/projects/0bc479600f714cc29751122e3a17eabb/users/2eeeaa3b20384faba2ff693e46ffb6e9/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:02.965723 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e60b81d-0329-4bf3-85c7-12620932ceec admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bc479600f714cc29751122e3a17eabb, user_id=2eeeaa3b20384faba2ff693e46ffb6e9, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:02.969942 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e60b81d-0329-4bf3-85c7-12620932ceec admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:02.971013 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff669f81-b163-4d12-a639-7aaa20597cb4 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:02.988533 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 949/1896] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:21:02 2021] PUT /identity/v3/projects/0bc479600f714cc29751122e3a17eabb/users/2eeeaa3b20384faba2ff693e46ffb6e9/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:21:03.022252 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66046f-3791-43f7-975a-6500464238d0 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:03.023124 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66046f-3791-43f7-975a-6500464238d0 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:03.023978 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66046f-3791-43f7-975a-6500464238d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:03.092028 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-bd66046f-3791-43f7-975a-6500464238d0 None None] MFA Rules not processed for user `2eeeaa3b20384faba2ff693e46ffb6e9`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:21:03.093770 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-bd66046f-3791-43f7-975a-6500464238d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:03.113437 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff669f81-b163-4d12-a639-7aaa20597cb4 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:03.182451 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b63c2-d080-4cd4-bb16-1ab42de34268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:03.183136 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b63c2-d080-4cd4-bb16-1ab42de34268 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:03.183344 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b63c2-d080-4cd4-bb16-1ab42de34268 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:03.183813 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b63c2-d080-4cd4-bb16-1ab42de34268 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:03.184661 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63b63c2-d080-4cd4-bb16-1ab42de34268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:03.186485 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63b63c2-d080-4cd4-bb16-1ab42de34268 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:03.198371 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 948/1897] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:21:02 2021] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:21:03.202022 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b63c2-d080-4cd4-bb16-1ab42de34268 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:03.214924 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 950/1898] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:21:03 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:21:03.217535 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b63c2-d080-4cd4-bb16-1ab42de34268 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:03.222840 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59371d30-49b5-4b19-8080-aeabdf8c2f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:03.223831 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59371d30-49b5-4b19-8080-aeabdf8c2f67 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:03.224116 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59371d30-49b5-4b19-8080-aeabdf8c2f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:03.225106 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59371d30-49b5-4b19-8080-aeabdf8c2f67 admin admin] PATH_INFO: `/v3/projects/6f76cdd5e94b4b89abb2f6185ed55b97/users/a0d0570a796340e7ab1e68d9ae222fd6/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:03.227199 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66046f-3791-43f7-975a-6500464238d0 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:03.228672 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-bd66046f-3791-43f7-975a-6500464238d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:03.232557 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59371d30-49b5-4b19-8080-aeabdf8c2f67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f76cdd5e94b4b89abb2f6185ed55b97, user_id=a0d0570a796340e7ab1e68d9ae222fd6, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:03.236224 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59371d30-49b5-4b19-8080-aeabdf8c2f67 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:03.257753 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 949/1899] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:21:03 2021] PUT /identity/v3/projects/6f76cdd5e94b4b89abb2f6185ed55b97/users/a0d0570a796340e7ab1e68d9ae222fd6/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:21:03.259266 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2506d-4640-49ca-8499-a01060455d98 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:03.259557 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2506d-4640-49ca-8499-a01060455d98 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:03.259839 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2506d-4640-49ca-8499-a01060455d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:03.313493 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-65c2506d-4640-49ca-8499-a01060455d98 None None] MFA Rules not processed for user `a0d0570a796340e7ab1e68d9ae222fd6`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:21:03.316005 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-65c2506d-4640-49ca-8499-a01060455d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:03.344005 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66046f-3791-43f7-975a-6500464238d0 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:03.414093 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c2fbb-3d26-4019-b658-4344234345a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:03.414747 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c2fbb-3d26-4019-b658-4344234345a2 service cinder] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:03.415053 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c2fbb-3d26-4019-b658-4344234345a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:03.415596 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c2fbb-3d26-4019-b658-4344234345a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:03.447718 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 950/1900] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:21:03 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:21:03.458468 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c2506d-4640-49ca-8499-a01060455d98 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:03.472243 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c2506d-4640-49ca-8499-a01060455d98 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:03.481324 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16111462-5087-442e-8abf-9d3a1cb82964 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:03.482018 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16111462-5087-442e-8abf-9d3a1cb82964 service cinder] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:03.482295 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16111462-5087-442e-8abf-9d3a1cb82964 service cinder] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:03.482560 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16111462-5087-442e-8abf-9d3a1cb82964 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:03.496950 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3c2fbb-3d26-4019-b658-4344234345a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:03.498599 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3c2fbb-3d26-4019-b658-4344234345a2 service cinder] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:03.521601 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 951/1901] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:21:03 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:21:03.568273 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16111462-5087-442e-8abf-9d3a1cb82964 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:03.569928 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16111462-5087-442e-8abf-9d3a1cb82964 service cinder] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:03.601473 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 951/1902] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:21:03 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 29 20:21:03.961129 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c2fbb-3d26-4019-b658-4344234345a2 service cinder] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:03.977454 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c2fbb-3d26-4019-b658-4344234345a2 service cinder] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:03.993188 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da970d0c-0960-4272-a739-1c1637f4d97c tempest-VolumeQuotaClassesTest-407806306 tempest-VolumeQuotaClassesTest-407806306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2eeeaa3b20384faba2ff693e46ffb6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc479600f714cc29751122e3a17eabb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:03.996125 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da970d0c-0960-4272-a739-1c1637f4d97c tempest-VolumeQuotaClassesTest-407806306 tempest-VolumeQuotaClassesTest-407806306-project-admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:03.998830 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da970d0c-0960-4272-a739-1c1637f4d97c tempest-VolumeQuotaClassesTest-407806306 tempest-VolumeQuotaClassesTest-407806306-project-admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:03.999262 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da970d0c-0960-4272-a739-1c1637f4d97c tempest-VolumeQuotaClassesTest-407806306 tempest-VolumeQuotaClassesTest-407806306-project-admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:04.000665 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da970d0c-0960-4272-a739-1c1637f4d97c tempest-VolumeQuotaClassesTest-407806306 tempest-VolumeQuotaClassesTest-407806306-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:21:04.002136 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da970d0c-0960-4272-a739-1c1637f4d97c tempest-VolumeQuotaClassesTest-407806306 tempest-VolumeQuotaClassesTest-407806306-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:04.007963 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da970d0c-0960-4272-a739-1c1637f4d97c tempest-VolumeQuotaClassesTest-407806306 tempest-VolumeQuotaClassesTest-407806306-project-admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:04.049461 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 952/1903] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:21:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:21:04.051752 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16111462-5087-442e-8abf-9d3a1cb82964 service cinder] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:04.077380 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16111462-5087-442e-8abf-9d3a1cb82964 service cinder] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:04.088510 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939ab19-0249-4b93-a071-735e35018b38 tempest-VolumeQuotaClassesTest-407806306 tempest-VolumeQuotaClassesTest-407806306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2eeeaa3b20384faba2ff693e46ffb6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc479600f714cc29751122e3a17eabb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:04.090602 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939ab19-0249-4b93-a071-735e35018b38 tempest-VolumeQuotaClassesTest-407806306 tempest-VolumeQuotaClassesTest-407806306-project-admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:04.092328 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939ab19-0249-4b93-a071-735e35018b38 tempest-VolumeQuotaClassesTest-407806306 tempest-VolumeQuotaClassesTest-407806306-project-admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:04.092650 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939ab19-0249-4b93-a071-735e35018b38 tempest-VolumeQuotaClassesTest-407806306 tempest-VolumeQuotaClassesTest-407806306-project-admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:04.095028 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5939ab19-0249-4b93-a071-735e35018b38 tempest-VolumeQuotaClassesTest-407806306 tempest-VolumeQuotaClassesTest-407806306-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:04.102447 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5939ab19-0249-4b93-a071-735e35018b38 tempest-VolumeQuotaClassesTest-407806306 tempest-VolumeQuotaClassesTest-407806306-project-admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:04.175536 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 952/1904] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:21:04 2021] POST /identity/v3/projects => generated 353 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:21:04.176845 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da970d0c-0960-4272-a739-1c1637f4d97c tempest-VolumeQuotaClassesTest-407806306 tempest-VolumeQuotaClassesTest-407806306-project-admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:04.198585 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da970d0c-0960-4272-a739-1c1637f4d97c tempest-VolumeQuotaClassesTest-407806306 tempest-VolumeQuotaClassesTest-407806306-project-admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:04.347637 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec5893-b9f3-45a8-888a-ab92d54c04d8 tempest-VolumeQuotaClassesTest-407806306 tempest-VolumeQuotaClassesTest-407806306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2eeeaa3b20384faba2ff693e46ffb6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc479600f714cc29751122e3a17eabb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:04.348327 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec5893-b9f3-45a8-888a-ab92d54c04d8 tempest-VolumeQuotaClassesTest-407806306 tempest-VolumeQuotaClassesTest-407806306-project-admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:04.348614 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec5893-b9f3-45a8-888a-ab92d54c04d8 tempest-VolumeQuotaClassesTest-407806306 tempest-VolumeQuotaClassesTest-407806306-project-admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:04.355077 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec5893-b9f3-45a8-888a-ab92d54c04d8 tempest-VolumeQuotaClassesTest-407806306 tempest-VolumeQuotaClassesTest-407806306-project-admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:04.355911 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec5893-b9f3-45a8-888a-ab92d54c04d8 tempest-VolumeQuotaClassesTest-407806306 tempest-VolumeQuotaClassesTest-407806306-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:21:04.356241 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec5893-b9f3-45a8-888a-ab92d54c04d8 tempest-VolumeQuotaClassesTest-407806306 tempest-VolumeQuotaClassesTest-407806306-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:04.357939 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec5893-b9f3-45a8-888a-ab92d54c04d8 tempest-VolumeQuotaClassesTest-407806306 tempest-VolumeQuotaClassesTest-407806306-project-admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:04.377755 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 953/1905] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:21:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:21:04.459976 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939ab19-0249-4b93-a071-735e35018b38 tempest-VolumeQuotaClassesTest-407806306 tempest-VolumeQuotaClassesTest-407806306-project-admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:04.473557 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939ab19-0249-4b93-a071-735e35018b38 tempest-VolumeQuotaClassesTest-407806306 tempest-VolumeQuotaClassesTest-407806306-project-admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:04.485880 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fae67d-7b32-4f3a-b6cc-6db8935c23a1 tempest-VolumeQuotaClassesTest-407806306 tempest-VolumeQuotaClassesTest-407806306-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2eeeaa3b20384faba2ff693e46ffb6e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc479600f714cc29751122e3a17eabb', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:04.487110 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fae67d-7b32-4f3a-b6cc-6db8935c23a1 tempest-VolumeQuotaClassesTest-407806306 tempest-VolumeQuotaClassesTest-407806306-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:04.487386 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fae67d-7b32-4f3a-b6cc-6db8935c23a1 tempest-VolumeQuotaClassesTest-407806306 tempest-VolumeQuotaClassesTest-407806306-project-admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:04.487664 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fae67d-7b32-4f3a-b6cc-6db8935c23a1 tempest-VolumeQuotaClassesTest-407806306 tempest-VolumeQuotaClassesTest-407806306-project-admin] PATH_INFO: `/v3/projects/49262e4cdd064013ada73642bb39c595` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:04.489035 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fae67d-7b32-4f3a-b6cc-6db8935c23a1 tempest-VolumeQuotaClassesTest-407806306 tempest-VolumeQuotaClassesTest-407806306-project-admin] RBAC: Authorizing `identity:delete_project(project_id=49262e4cdd064013ada73642bb39c595)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:04.491146 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fae67d-7b32-4f3a-b6cc-6db8935c23a1 tempest-VolumeQuotaClassesTest-407806306 tempest-VolumeQuotaClassesTest-407806306-project-admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:04.600565 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-12fae67d-7b32-4f3a-b6cc-6db8935c23a1 tempest-VolumeQuotaClassesTest-407806306 tempest-VolumeQuotaClassesTest-407806306-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49262e4cdd064013ada73642bb39c595', 'request_id': 'req-12fae67d-7b32-4f3a-b6cc-6db8935c23a1'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:04.615806 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-12fae67d-7b32-4f3a-b6cc-6db8935c23a1 tempest-VolumeQuotaClassesTest-407806306 tempest-VolumeQuotaClassesTest-407806306-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49262e4cdd064013ada73642bb39c595', 'request_id': 'req-12fae67d-7b32-4f3a-b6cc-6db8935c23a1'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:04.630719 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-12fae67d-7b32-4f3a-b6cc-6db8935c23a1 tempest-VolumeQuotaClassesTest-407806306 tempest-VolumeQuotaClassesTest-407806306-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49262e4cdd064013ada73642bb39c595', 'request_id': 'req-12fae67d-7b32-4f3a-b6cc-6db8935c23a1'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:04.658168 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-12fae67d-7b32-4f3a-b6cc-6db8935c23a1 tempest-VolumeQuotaClassesTest-407806306 tempest-VolumeQuotaClassesTest-407806306-project-admin] The token cache is being invalidate because project 49262e4cdd064013ada73642bb39c595 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:21:04.658462 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-12fae67d-7b32-4f3a-b6cc-6db8935c23a1 tempest-VolumeQuotaClassesTest-407806306 tempest-VolumeQuotaClassesTest-407806306-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:04.660018 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-12fae67d-7b32-4f3a-b6cc-6db8935c23a1 tempest-VolumeQuotaClassesTest-407806306 tempest-VolumeQuotaClassesTest-407806306-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:04.662626 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 953/1906] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:21:04 2021] DELETE /identity/v3/projects/49262e4cdd064013ada73642bb39c595 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:21:04.999211 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec5893-b9f3-45a8-888a-ab92d54c04d8 tempest-VolumeQuotaClassesTest-407806306 tempest-VolumeQuotaClassesTest-407806306-project-admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:05.002739 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-80ec5893-b9f3-45a8-888a-ab92d54c04d8 tempest-VolumeQuotaClassesTest-407806306 tempest-VolumeQuotaClassesTest-407806306-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:05.074447 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec5893-b9f3-45a8-888a-ab92d54c04d8 tempest-VolumeQuotaClassesTest-407806306 tempest-VolumeQuotaClassesTest-407806306-project-admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:05.166715 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52abf8-e42c-44f8-a016-149547f19002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:05.167691 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52abf8-e42c-44f8-a016-149547f19002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:05.171305 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52abf8-e42c-44f8-a016-149547f19002 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:05.171604 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52abf8-e42c-44f8-a016-149547f19002 admin admin] PATH_INFO: `/v3/users/662ee30ff3ee4e4d90349f2ee42922d5` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:05.172986 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd52abf8-e42c-44f8-a016-149547f19002 admin admin] RBAC: Authorizing `identity:delete_user(user_id=662ee30ff3ee4e4d90349f2ee42922d5)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:05.175348 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd52abf8-e42c-44f8-a016-149547f19002 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:05.227630 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-fd52abf8-e42c-44f8-a016-149547f19002 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '662ee30ff3ee4e4d90349f2ee42922d5'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:05.236699 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-fd52abf8-e42c-44f8-a016-149547f19002 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '662ee30ff3ee4e4d90349f2ee42922d5'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:05.247397 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-fd52abf8-e42c-44f8-a016-149547f19002 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '662ee30ff3ee4e4d90349f2ee42922d5'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:05.262374 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-fd52abf8-e42c-44f8-a016-149547f19002 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '662ee30ff3ee4e4d90349f2ee42922d5'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:05.263103 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-fd52abf8-e42c-44f8-a016-149547f19002 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '662ee30ff3ee4e4d90349f2ee42922d5'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:05.270502 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 954/1907] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:21:04 2021] DELETE /identity/v3/users/662ee30ff3ee4e4d90349f2ee42922d5 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:21:05.274892 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379dc66-8e7d-435a-a804-c84382d257a4 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:05.275066 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379dc66-8e7d-435a-a804-c84382d257a4 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:05.275335 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379dc66-8e7d-435a-a804-c84382d257a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:05.292815 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-a379dc66-8e7d-435a-a804-c84382d257a4 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:21:05.294027 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-a379dc66-8e7d-435a-a804-c84382d257a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:05.351488 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 954/1908] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:21:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:21:05.361635 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52abf8-e42c-44f8-a016-149547f19002 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:05.363321 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-fd52abf8-e42c-44f8-a016-149547f19002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:05.420578 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52abf8-e42c-44f8-a016-149547f19002 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:05.425859 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025820c-8f25-4234-8dee-49e2d32f4d5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:05.426630 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025820c-8f25-4234-8dee-49e2d32f4d5e service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:05.427016 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025820c-8f25-4234-8dee-49e2d32f4d5e service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:05.427294 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025820c-8f25-4234-8dee-49e2d32f4d5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:05.437801 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0025820c-8f25-4234-8dee-49e2d32f4d5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:05.439279 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0025820c-8f25-4234-8dee-49e2d32f4d5e service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:05.449055 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 955/1909] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:21:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:21:05.713798 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379dc66-8e7d-435a-a804-c84382d257a4 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:05.715428 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-a379dc66-8e7d-435a-a804-c84382d257a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:05.728184 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379dc66-8e7d-435a-a804-c84382d257a4 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:05.741821 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36de95c-48fd-47f7-908d-8d24924c5419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:05.743112 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36de95c-48fd-47f7-908d-8d24924c5419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:05.743417 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36de95c-48fd-47f7-908d-8d24924c5419 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:05.743793 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36de95c-48fd-47f7-908d-8d24924c5419 admin admin] PATH_INFO: `/v3/projects/4ebcaf445a6847009f1d74674522a62a` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:05.745376 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36de95c-48fd-47f7-908d-8d24924c5419 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ebcaf445a6847009f1d74674522a62a)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:05.747443 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36de95c-48fd-47f7-908d-8d24924c5419 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:05.794153 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-b36de95c-48fd-47f7-908d-8d24924c5419 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ebcaf445a6847009f1d74674522a62a', 'request_id': 'req-b36de95c-48fd-47f7-908d-8d24924c5419'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:05.800385 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-b36de95c-48fd-47f7-908d-8d24924c5419 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ebcaf445a6847009f1d74674522a62a', 'request_id': 'req-b36de95c-48fd-47f7-908d-8d24924c5419'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:05.805817 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-b36de95c-48fd-47f7-908d-8d24924c5419 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ebcaf445a6847009f1d74674522a62a', 'request_id': 'req-b36de95c-48fd-47f7-908d-8d24924c5419'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:05.819870 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-b36de95c-48fd-47f7-908d-8d24924c5419 admin admin] The token cache is being invalidate because project 4ebcaf445a6847009f1d74674522a62a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:21:05.820160 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-b36de95c-48fd-47f7-908d-8d24924c5419 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:05.820788 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-b36de95c-48fd-47f7-908d-8d24924c5419 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:05.822450 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 955/1910] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:21:05 2021] DELETE /identity/v3/projects/4ebcaf445a6847009f1d74674522a62a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:21:05.826373 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025820c-8f25-4234-8dee-49e2d32f4d5e service neutron] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:05.839439 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025820c-8f25-4234-8dee-49e2d32f4d5e service neutron] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:05.896375 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc62fcd-908f-4fe2-8794-c65e062ab7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:05.897256 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc62fcd-908f-4fe2-8794-c65e062ab7f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:05.897536 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc62fcd-908f-4fe2-8794-c65e062ab7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:05.897809 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc62fcd-908f-4fe2-8794-c65e062ab7f4 admin admin] PATH_INFO: `/v3/users/2eeeaa3b20384faba2ff693e46ffb6e9` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:05.899061 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc62fcd-908f-4fe2-8794-c65e062ab7f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eeeaa3b20384faba2ff693e46ffb6e9)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:05.901028 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc62fcd-908f-4fe2-8794-c65e062ab7f4 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:05.947139 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ccc62fcd-908f-4fe2-8794-c65e062ab7f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eeeaa3b20384faba2ff693e46ffb6e9'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:05.953979 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ccc62fcd-908f-4fe2-8794-c65e062ab7f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eeeaa3b20384faba2ff693e46ffb6e9'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:05.963098 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ccc62fcd-908f-4fe2-8794-c65e062ab7f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eeeaa3b20384faba2ff693e46ffb6e9'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:05.975590 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ccc62fcd-908f-4fe2-8794-c65e062ab7f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eeeaa3b20384faba2ff693e46ffb6e9'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:05.976195 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ccc62fcd-908f-4fe2-8794-c65e062ab7f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eeeaa3b20384faba2ff693e46ffb6e9'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:05.982880 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 956/1911] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:21:05 2021] DELETE /identity/v3/users/2eeeaa3b20384faba2ff693e46ffb6e9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:21:06.357601 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36de95c-48fd-47f7-908d-8d24924c5419 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:06.359643 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-b36de95c-48fd-47f7-908d-8d24924c5419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:06.378436 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36de95c-48fd-47f7-908d-8d24924c5419 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:06.440046 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac1db67-b47e-4c3e-bf77-b51fc748a758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:06.440918 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1db67-b47e-4c3e-bf77-b51fc748a758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:06.441194 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1db67-b47e-4c3e-bf77-b51fc748a758 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:06.441463 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1db67-b47e-4c3e-bf77-b51fc748a758 admin admin] PATH_INFO: `/v3/projects/0bc479600f714cc29751122e3a17eabb` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:06.442643 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac1db67-b47e-4c3e-bf77-b51fc748a758 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bc479600f714cc29751122e3a17eabb)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:06.444734 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac1db67-b47e-4c3e-bf77-b51fc748a758 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:06.490164 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-5ac1db67-b47e-4c3e-bf77-b51fc748a758 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bc479600f714cc29751122e3a17eabb', 'request_id': 'req-5ac1db67-b47e-4c3e-bf77-b51fc748a758'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:06.496099 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-5ac1db67-b47e-4c3e-bf77-b51fc748a758 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bc479600f714cc29751122e3a17eabb', 'request_id': 'req-5ac1db67-b47e-4c3e-bf77-b51fc748a758'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:06.501703 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-5ac1db67-b47e-4c3e-bf77-b51fc748a758 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bc479600f714cc29751122e3a17eabb', 'request_id': 'req-5ac1db67-b47e-4c3e-bf77-b51fc748a758'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:06.515263 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-5ac1db67-b47e-4c3e-bf77-b51fc748a758 admin admin] The token cache is being invalidate because project 0bc479600f714cc29751122e3a17eabb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:21:06.515551 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-5ac1db67-b47e-4c3e-bf77-b51fc748a758 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:06.516162 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-5ac1db67-b47e-4c3e-bf77-b51fc748a758 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:06.517740 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 956/1912] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:21:06 2021] DELETE /identity/v3/projects/0bc479600f714cc29751122e3a17eabb => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:21:06.524144 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13392315-ce30-46b1-9869-272ebada8190 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:06.524612 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13392315-ce30-46b1-9869-272ebada8190 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:06.524714 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13392315-ce30-46b1-9869-272ebada8190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:06.542636 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-13392315-ce30-46b1-9869-272ebada8190 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:21:06.543867 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-13392315-ce30-46b1-9869-272ebada8190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:06.606986 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 957/1913] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:21:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:21:06.615198 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a41b4-3247-48ef-9d6a-dd158df23a82 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:06.615494 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a41b4-3247-48ef-9d6a-dd158df23a82 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:06.615774 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a41b4-3247-48ef-9d6a-dd158df23a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:06.634077 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-eb4a41b4-3247-48ef-9d6a-dd158df23a82 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:21:06.635326 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-eb4a41b4-3247-48ef-9d6a-dd158df23a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:06.644098 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 957/1914] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:21:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:21:06.648402 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13392315-ce30-46b1-9869-272ebada8190 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:06.658334 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13392315-ce30-46b1-9869-272ebada8190 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:06.663162 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a524f-dea8-450d-a955-72e66507d3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:06.663825 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a524f-dea8-450d-a955-72e66507d3cb admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:06.664094 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a524f-dea8-450d-a955-72e66507d3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:06.664364 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a524f-dea8-450d-a955-72e66507d3cb admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:06.665099 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a524f-dea8-450d-a955-72e66507d3cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:21:06.665401 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a524f-dea8-450d-a955-72e66507d3cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:06.667008 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0a524f-dea8-450d-a955-72e66507d3cb admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:06.678959 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 958/1915] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:21:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:21:06.683302 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4a41b4-3247-48ef-9d6a-dd158df23a82 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:06.692312 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4a41b4-3247-48ef-9d6a-dd158df23a82 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:06.697069 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a628c-4976-4885-ad48-7e57f5a184ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:06.697720 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a628c-4976-4885-ad48-7e57f5a184ff admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:06.698000 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a628c-4976-4885-ad48-7e57f5a184ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:06.698270 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899a628c-4976-4885-ad48-7e57f5a184ff admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:06.698998 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a628c-4976-4885-ad48-7e57f5a184ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:06.700873 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899a628c-4976-4885-ad48-7e57f5a184ff admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:06.727667 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 958/1916] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:21:06 2021] POST /identity/v3/projects => generated 409 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 29 20:21:06.731919 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a524f-dea8-450d-a955-72e66507d3cb admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:06.741815 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a524f-dea8-450d-a955-72e66507d3cb admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:06.796576 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038d9e1-73ae-4716-9905-46b8ffb08570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:06.797229 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038d9e1-73ae-4716-9905-46b8ffb08570 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:06.797511 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038d9e1-73ae-4716-9905-46b8ffb08570 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:06.797783 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038d9e1-73ae-4716-9905-46b8ffb08570 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:06.798470 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6038d9e1-73ae-4716-9905-46b8ffb08570 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:06.800395 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6038d9e1-73ae-4716-9905-46b8ffb08570 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:06.824244 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 959/1917] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:21:06 2021] POST /identity/v3/users => generated 305 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 29 20:21:06.828576 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a628c-4976-4885-ad48-7e57f5a184ff admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:06.839167 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899a628c-4976-4885-ad48-7e57f5a184ff admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:06.844337 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18c96c-2e99-4490-866b-7b90b87122fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:06.845000 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18c96c-2e99-4490-866b-7b90b87122fe admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:06.846697 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18c96c-2e99-4490-866b-7b90b87122fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:06.846697 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba18c96c-2e99-4490-866b-7b90b87122fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:06.846697 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba18c96c-2e99-4490-866b-7b90b87122fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:06.848060 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba18c96c-2e99-4490-866b-7b90b87122fe admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:06.859128 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 959/1918] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:21:06 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:21:06.863119 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038d9e1-73ae-4716-9905-46b8ffb08570 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:06.873362 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038d9e1-73ae-4716-9905-46b8ffb08570 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:06.878333 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977e92e-b1f7-434d-a1bc-f079eaa535f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:06.879038 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977e92e-b1f7-434d-a1bc-f079eaa535f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:06.879324 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977e92e-b1f7-434d-a1bc-f079eaa535f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:06.879827 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977e92e-b1f7-434d-a1bc-f079eaa535f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:06.880564 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d977e92e-b1f7-434d-a1bc-f079eaa535f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:06.882146 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d977e92e-b1f7-434d-a1bc-f079eaa535f7 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:06.892090 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 960/1919] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:21:06 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:21:06.896789 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18c96c-2e99-4490-866b-7b90b87122fe admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:06.907472 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba18c96c-2e99-4490-866b-7b90b87122fe admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:06.913190 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac2473-b969-41fa-b202-7c259e18c0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:06.914093 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac2473-b969-41fa-b202-7c259e18c0aa admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:06.914378 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac2473-b969-41fa-b202-7c259e18c0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:06.914650 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac2473-b969-41fa-b202-7c259e18c0aa admin admin] PATH_INFO: `/v3/projects/c1354989ca764f3caa466805c468d493/users/4341fd73877945e88df90abac7e90f81/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:06.930605 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac2473-b969-41fa-b202-7c259e18c0aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1354989ca764f3caa466805c468d493, user_id=4341fd73877945e88df90abac7e90f81, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:06.933310 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac2473-b969-41fa-b202-7c259e18c0aa admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:06.948947 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 960/1920] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:21:06 2021] PUT /identity/v3/projects/c1354989ca764f3caa466805c468d493/users/4341fd73877945e88df90abac7e90f81/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:21:06.959035 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0a0bd-8a3c-4362-8b51-a6fdd9224c3c None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:06.959324 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0a0bd-8a3c-4362-8b51-a6fdd9224c3c None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:06.959604 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c0a0bd-8a3c-4362-8b51-a6fdd9224c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:06.985454 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-23c0a0bd-8a3c-4362-8b51-a6fdd9224c3c None None] MFA Rules not processed for user `4341fd73877945e88df90abac7e90f81`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:21:06.986670 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-23c0a0bd-8a3c-4362-8b51-a6fdd9224c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:07.050043 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 961/1921] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:21:06 2021] POST /identity/v3/auth/tokens => generated 3276 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:21:07.054369 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac2473-b969-41fa-b202-7c259e18c0aa admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:07.117545 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac2473-b969-41fa-b202-7c259e18c0aa admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:07.122275 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e874c-9554-4476-b355-e052ef712c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:07.122965 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e874c-9554-4476-b355-e052ef712c8d admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:07.123309 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e874c-9554-4476-b355-e052ef712c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:07.123592 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e874c-9554-4476-b355-e052ef712c8d admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:07.124295 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74e874c-9554-4476-b355-e052ef712c8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:07.126222 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74e874c-9554-4476-b355-e052ef712c8d admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:07.152721 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 961/1922] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:21:07 2021] POST /identity/v3/projects => generated 407 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:21:07.156913 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c0a0bd-8a3c-4362-8b51-a6fdd9224c3c None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:07.168251 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c0a0bd-8a3c-4362-8b51-a6fdd9224c3c None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:07.224171 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfbd3b-a4ba-43e7-af98-8f070ca35960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:07.224848 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfbd3b-a4ba-43e7-af98-8f070ca35960 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:07.225124 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfbd3b-a4ba-43e7-af98-8f070ca35960 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:07.225372 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfbd3b-a4ba-43e7-af98-8f070ca35960 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:07.226071 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dfbd3b-a4ba-43e7-af98-8f070ca35960 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:07.228008 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dfbd3b-a4ba-43e7-af98-8f070ca35960 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:07.254295 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 962/1923] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:21:07 2021] POST /identity/v3/users => generated 310 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:21:07.258175 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e874c-9554-4476-b355-e052ef712c8d admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:07.270078 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e874c-9554-4476-b355-e052ef712c8d admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:07.274734 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aae686-cf42-49e1-849b-db324d6120e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:07.275433 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aae686-cf42-49e1-849b-db324d6120e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:07.275713 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aae686-cf42-49e1-849b-db324d6120e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:07.275989 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aae686-cf42-49e1-849b-db324d6120e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:07.276842 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aae686-cf42-49e1-849b-db324d6120e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:07.278439 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aae686-cf42-49e1-849b-db324d6120e5 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:07.289780 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 962/1924] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:21:07 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:21:07.294202 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfbd3b-a4ba-43e7-af98-8f070ca35960 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:07.304187 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfbd3b-a4ba-43e7-af98-8f070ca35960 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:07.309044 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e6902-0f07-499c-ab70-417ae3ff1e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:07.309939 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e6902-0f07-499c-ab70-417ae3ff1e0b admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:07.310215 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e6902-0f07-499c-ab70-417ae3ff1e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:07.310488 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e6902-0f07-499c-ab70-417ae3ff1e0b admin admin] PATH_INFO: `/v3/projects/7c56d6e29fc643b8a427257fd65a9124/users/36580541c90b4ba7988e021352d2d015/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:07.327957 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e6902-0f07-499c-ab70-417ae3ff1e0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c56d6e29fc643b8a427257fd65a9124, user_id=36580541c90b4ba7988e021352d2d015, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:07.330654 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e6902-0f07-499c-ab70-417ae3ff1e0b admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:07.345521 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 963/1925] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:21:07 2021] PUT /identity/v3/projects/7c56d6e29fc643b8a427257fd65a9124/users/36580541c90b4ba7988e021352d2d015/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:21:07.349404 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aae686-cf42-49e1-849b-db324d6120e5 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:07.359706 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aae686-cf42-49e1-849b-db324d6120e5 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:07.418443 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2598cde5-7645-40ae-89ab-9dfb4466c7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:07.419145 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2598cde5-7645-40ae-89ab-9dfb4466c7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:07.419426 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2598cde5-7645-40ae-89ab-9dfb4466c7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:07.419696 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2598cde5-7645-40ae-89ab-9dfb4466c7c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:07.420503 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2598cde5-7645-40ae-89ab-9dfb4466c7c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:07.422097 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2598cde5-7645-40ae-89ab-9dfb4466c7c8 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:07.432617 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 963/1926] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:21:07 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:21:07.436893 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e6902-0f07-499c-ab70-417ae3ff1e0b admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:07.447137 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e6902-0f07-499c-ab70-417ae3ff1e0b admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:07.451984 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6047a-31f9-437b-aa80-3a77351c7bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:07.452866 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6047a-31f9-437b-aa80-3a77351c7bcf admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:07.453149 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6047a-31f9-437b-aa80-3a77351c7bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:07.453422 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6047a-31f9-437b-aa80-3a77351c7bcf admin admin] PATH_INFO: `/v3/projects/7c56d6e29fc643b8a427257fd65a9124/users/36580541c90b4ba7988e021352d2d015/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:07.455423 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e6047a-31f9-437b-aa80-3a77351c7bcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c56d6e29fc643b8a427257fd65a9124, user_id=36580541c90b4ba7988e021352d2d015, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:07.458059 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e6047a-31f9-437b-aa80-3a77351c7bcf admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:07.468731 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 964/1927] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:21:07 2021] PUT /identity/v3/projects/7c56d6e29fc643b8a427257fd65a9124/users/36580541c90b4ba7988e021352d2d015/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:21:07.483098 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55357b18-2e3c-4b50-9c91-72b6d2df8448 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:07.483389 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55357b18-2e3c-4b50-9c91-72b6d2df8448 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:07.483667 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55357b18-2e3c-4b50-9c91-72b6d2df8448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:07.511131 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-55357b18-2e3c-4b50-9c91-72b6d2df8448 None None] MFA Rules not processed for user `36580541c90b4ba7988e021352d2d015`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:21:07.512282 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-55357b18-2e3c-4b50-9c91-72b6d2df8448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:07.583983 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 964/1928] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:21:07 2021] POST /identity/v3/auth/tokens => generated 3341 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:21:07.594533 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6047a-31f9-437b-aa80-3a77351c7bcf admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:07.596760 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-83e6047a-31f9-437b-aa80-3a77351c7bcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:07.663376 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6047a-31f9-437b-aa80-3a77351c7bcf admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:07.667309 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1505589f-2ac0-4bd4-81e2-70477a15f39e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:07.667954 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505589f-2ac0-4bd4-81e2-70477a15f39e service cinder] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:07.668232 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505589f-2ac0-4bd4-81e2-70477a15f39e service cinder] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:07.668505 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505589f-2ac0-4bd4-81e2-70477a15f39e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:07.677429 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1505589f-2ac0-4bd4-81e2-70477a15f39e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:07.678873 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1505589f-2ac0-4bd4-81e2-70477a15f39e service cinder] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:07.688493 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 965/1929] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:21:07 2021] GET /identity/v3/auth/tokens => generated 3341 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:21:07.847219 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55357b18-2e3c-4b50-9c91-72b6d2df8448 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:07.857154 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55357b18-2e3c-4b50-9c91-72b6d2df8448 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:07.861560 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7951f6-d289-467b-8ada-4d57b255f8f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:07.862199 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7951f6-d289-467b-8ada-4d57b255f8f0 service cinder] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:07.862475 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7951f6-d289-467b-8ada-4d57b255f8f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:07.862758 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7951f6-d289-467b-8ada-4d57b255f8f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:07.921363 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7951f6-d289-467b-8ada-4d57b255f8f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:07.923592 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7951f6-d289-467b-8ada-4d57b255f8f0 service cinder] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:07.937416 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 965/1930] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:21:07 2021] GET /identity/v3/auth/tokens => generated 3276 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:21:13.646554 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1505589f-2ac0-4bd4-81e2-70477a15f39e service cinder] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:13.654417 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-1505589f-2ac0-4bd4-81e2-70477a15f39e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:13.688430 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7951f6-d289-467b-8ada-4d57b255f8f0 service cinder] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:13.689955 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-0c7951f6-d289-467b-8ada-4d57b255f8f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:13.743570 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1505589f-2ac0-4bd4-81e2-70477a15f39e service cinder] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:13.749733 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca122de6-8c75-40d6-92ee-ca487703f74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:13.750726 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca122de6-8c75-40d6-92ee-ca487703f74c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:13.751034 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca122de6-8c75-40d6-92ee-ca487703f74c admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:13.751322 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca122de6-8c75-40d6-92ee-ca487703f74c admin admin] PATH_INFO: `/v3/users/2c3b66e6fc1c40dba4c871927a632448` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:13.752549 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca122de6-8c75-40d6-92ee-ca487703f74c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c3b66e6fc1c40dba4c871927a632448)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:13.755436 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca122de6-8c75-40d6-92ee-ca487703f74c admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:13.778405 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7951f6-d289-467b-8ada-4d57b255f8f0 service cinder] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:13.789283 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192339e4-4e2f-46c3-a34a-930062122b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:13.791062 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192339e4-4e2f-46c3-a34a-930062122b11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:13.791597 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192339e4-4e2f-46c3-a34a-930062122b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:13.792231 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192339e4-4e2f-46c3-a34a-930062122b11 admin admin] PATH_INFO: `/v3/users/12594eb212cb44e2a2aa066e1c66d9b7` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:13.794326 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192339e4-4e2f-46c3-a34a-930062122b11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12594eb212cb44e2a2aa066e1c66d9b7)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:13.796851 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192339e4-4e2f-46c3-a34a-930062122b11 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:13.809957 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ca122de6-8c75-40d6-92ee-ca487703f74c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c3b66e6fc1c40dba4c871927a632448'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:13.817366 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ca122de6-8c75-40d6-92ee-ca487703f74c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c3b66e6fc1c40dba4c871927a632448'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:13.827805 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ca122de6-8c75-40d6-92ee-ca487703f74c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c3b66e6fc1c40dba4c871927a632448'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:13.846101 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ca122de6-8c75-40d6-92ee-ca487703f74c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c3b66e6fc1c40dba4c871927a632448'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:13.846951 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ca122de6-8c75-40d6-92ee-ca487703f74c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c3b66e6fc1c40dba4c871927a632448'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:13.856773 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 966/1931] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:21:13 2021] DELETE /identity/v3/users/2c3b66e6fc1c40dba4c871927a632448 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:21:13.859667 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c731af-071b-45c2-ae78-6478a4b9b103 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:13.859948 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c731af-071b-45c2-ae78-6478a4b9b103 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:13.860219 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c731af-071b-45c2-ae78-6478a4b9b103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:13.863760 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-192339e4-4e2f-46c3-a34a-930062122b11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12594eb212cb44e2a2aa066e1c66d9b7'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:13.871185 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-192339e4-4e2f-46c3-a34a-930062122b11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12594eb212cb44e2a2aa066e1c66d9b7'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:13.878449 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-07c731af-071b-45c2-ae78-6478a4b9b103 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:21:13.879675 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-07c731af-071b-45c2-ae78-6478a4b9b103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:13.883815 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-192339e4-4e2f-46c3-a34a-930062122b11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12594eb212cb44e2a2aa066e1c66d9b7'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:13.884887 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-192339e4-4e2f-46c3-a34a-930062122b11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12594eb212cb44e2a2aa066e1c66d9b7'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:13.885854 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-192339e4-4e2f-46c3-a34a-930062122b11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12594eb212cb44e2a2aa066e1c66d9b7'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:13.907496 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 966/1932] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:21:13 2021] DELETE /identity/v3/users/12594eb212cb44e2a2aa066e1c66d9b7 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:21:13.911557 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8c44a-7c00-4cd1-8648-2c7e35480b1e None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:13.911831 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8c44a-7c00-4cd1-8648-2c7e35480b1e None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:13.912114 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8c44a-7c00-4cd1-8648-2c7e35480b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:13.933827 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-4bc8c44a-7c00-4cd1-8648-2c7e35480b1e None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:21:13.935462 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-4bc8c44a-7c00-4cd1-8648-2c7e35480b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:13.950883 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 967/1933] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:21:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:21:13.965485 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c731af-071b-45c2-ae78-6478a4b9b103 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:13.967955 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-07c731af-071b-45c2-ae78-6478a4b9b103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:14.009087 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 967/1934] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:21:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:21:14.021090 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc8c44a-7c00-4cd1-8648-2c7e35480b1e None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:14.022622 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-4bc8c44a-7c00-4cd1-8648-2c7e35480b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:14.037448 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c731af-071b-45c2-ae78-6478a4b9b103 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:14.085128 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc8c44a-7c00-4cd1-8648-2c7e35480b1e None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:14.089569 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f026de-bcb4-4f3c-b233-0d83c4d2bc2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:14.090259 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f026de-bcb4-4f3c-b233-0d83c4d2bc2d service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:14.090571 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f026de-bcb4-4f3c-b233-0d83c4d2bc2d service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:14.090965 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f026de-bcb4-4f3c-b233-0d83c4d2bc2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:14.096664 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd4dfe-ca73-4a9b-a3b0-55cafc1becbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:14.097587 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd4dfe-ca73-4a9b-a3b0-55cafc1becbc service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:14.098035 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd4dfe-ca73-4a9b-a3b0-55cafc1becbc service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:14.098471 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd4dfe-ca73-4a9b-a3b0-55cafc1becbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:14.101169 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f026de-bcb4-4f3c-b233-0d83c4d2bc2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:14.102755 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f026de-bcb4-4f3c-b233-0d83c4d2bc2d service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:14.109555 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fd4dfe-ca73-4a9b-a3b0-55cafc1becbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:14.111510 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fd4dfe-ca73-4a9b-a3b0-55cafc1becbc service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:14.113819 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 968/1935] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:21:14 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 29 20:21:14.122070 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 968/1936] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:21:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:21:14.653980 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f026de-bcb4-4f3c-b233-0d83c4d2bc2d service neutron] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:14.655530 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-31f026de-bcb4-4f3c-b233-0d83c4d2bc2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:14.668999 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd4dfe-ca73-4a9b-a3b0-55cafc1becbc service neutron] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:14.671636 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-13fd4dfe-ca73-4a9b-a3b0-55cafc1becbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:14.684942 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd4dfe-ca73-4a9b-a3b0-55cafc1becbc service neutron] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:14.688452 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f026de-bcb4-4f3c-b233-0d83c4d2bc2d service neutron] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:14.695399 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06fe2fe-3bb2-427f-bc39-934eff50726b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:14.696830 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fe2fe-3bb2-427f-bc39-934eff50726b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:14.697512 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fe2fe-3bb2-427f-bc39-934eff50726b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:14.697766 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47c1dc-1e10-457e-bf33-55236444bfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:14.697895 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06fe2fe-3bb2-427f-bc39-934eff50726b admin admin] PATH_INFO: `/v3/projects/8f97606ad0ff47edb7c25c7bea31d281` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:14.698731 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47c1dc-1e10-457e-bf33-55236444bfae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:14.699061 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47c1dc-1e10-457e-bf33-55236444bfae admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:14.699319 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee47c1dc-1e10-457e-bf33-55236444bfae admin admin] PATH_INFO: `/v3/projects/65eb05cde6454c5a8a0db9ec8b84428a` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:14.699532 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06fe2fe-3bb2-427f-bc39-934eff50726b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f97606ad0ff47edb7c25c7bea31d281)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:14.700527 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee47c1dc-1e10-457e-bf33-55236444bfae admin admin] RBAC: Authorizing `identity:delete_project(project_id=65eb05cde6454c5a8a0db9ec8b84428a)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:14.701802 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06fe2fe-3bb2-427f-bc39-934eff50726b admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:14.702626 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee47c1dc-1e10-457e-bf33-55236444bfae admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:14.761042 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-ee47c1dc-1e10-457e-bf33-55236444bfae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65eb05cde6454c5a8a0db9ec8b84428a', 'request_id': 'req-ee47c1dc-1e10-457e-bf33-55236444bfae'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:14.764187 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-a06fe2fe-3bb2-427f-bc39-934eff50726b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f97606ad0ff47edb7c25c7bea31d281', 'request_id': 'req-a06fe2fe-3bb2-427f-bc39-934eff50726b'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:14.767459 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-ee47c1dc-1e10-457e-bf33-55236444bfae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65eb05cde6454c5a8a0db9ec8b84428a', 'request_id': 'req-ee47c1dc-1e10-457e-bf33-55236444bfae'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:14.771631 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-a06fe2fe-3bb2-427f-bc39-934eff50726b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f97606ad0ff47edb7c25c7bea31d281', 'request_id': 'req-a06fe2fe-3bb2-427f-bc39-934eff50726b'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:14.773751 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-ee47c1dc-1e10-457e-bf33-55236444bfae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65eb05cde6454c5a8a0db9ec8b84428a', 'request_id': 'req-ee47c1dc-1e10-457e-bf33-55236444bfae'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:14.780022 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-a06fe2fe-3bb2-427f-bc39-934eff50726b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f97606ad0ff47edb7c25c7bea31d281', 'request_id': 'req-a06fe2fe-3bb2-427f-bc39-934eff50726b'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:14.788679 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-ee47c1dc-1e10-457e-bf33-55236444bfae admin admin] The token cache is being invalidate because project 65eb05cde6454c5a8a0db9ec8b84428a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:21:14.788989 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-ee47c1dc-1e10-457e-bf33-55236444bfae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:14.789594 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-ee47c1dc-1e10-457e-bf33-55236444bfae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:14.791747 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 969/1937] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:21:14 2021] DELETE /identity/v3/projects/65eb05cde6454c5a8a0db9ec8b84428a => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:21:14.792470 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-a06fe2fe-3bb2-427f-bc39-934eff50726b admin admin] The token cache is being invalidate because project 8f97606ad0ff47edb7c25c7bea31d281 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:21:14.792766 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-a06fe2fe-3bb2-427f-bc39-934eff50726b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:14.793555 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-a06fe2fe-3bb2-427f-bc39-934eff50726b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:14.795501 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 969/1938] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:21:14 2021] DELETE /identity/v3/projects/8f97606ad0ff47edb7c25c7bea31d281 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:21:14.795634 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47c1dc-1e10-457e-bf33-55236444bfae admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:14.797118 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-ee47c1dc-1e10-457e-bf33-55236444bfae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:14.801400 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f9f5a-6b3c-4841-880f-79c2c8845954 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:14.801691 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f9f5a-6b3c-4841-880f-79c2c8845954 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:14.801962 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f9f5a-6b3c-4841-880f-79c2c8845954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:14.822215 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-1f2f9f5a-6b3c-4841-880f-79c2c8845954 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:21:14.823933 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-1f2f9f5a-6b3c-4841-880f-79c2c8845954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:14.865581 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee47c1dc-1e10-457e-bf33-55236444bfae admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:14.870887 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a978a-485d-4f36-98b1-cfe67df7e639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:14.871765 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a978a-485d-4f36-98b1-cfe67df7e639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:14.872119 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a978a-485d-4f36-98b1-cfe67df7e639 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:14.872339 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a978a-485d-4f36-98b1-cfe67df7e639 admin admin] PATH_INFO: `/v3/users/a0d0570a796340e7ab1e68d9ae222fd6` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:14.873647 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a978a-485d-4f36-98b1-cfe67df7e639 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0d0570a796340e7ab1e68d9ae222fd6)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:14.875668 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a978a-485d-4f36-98b1-cfe67df7e639 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:14.888370 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 970/1939] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:21:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:21:14.896621 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c07db-928e-42c2-954c-9bbd22056a76 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:14.896907 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c07db-928e-42c2-954c-9bbd22056a76 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:14.897279 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7c07db-928e-42c2-954c-9bbd22056a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:14.917811 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-6d7c07db-928e-42c2-954c-9bbd22056a76 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:21:14.919055 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-6d7c07db-928e-42c2-954c-9bbd22056a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:14.928374 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 971/1940] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:21:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:21:14.929402 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-7c6a978a-485d-4f36-98b1-cfe67df7e639 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0d0570a796340e7ab1e68d9ae222fd6'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:14.932512 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c07db-928e-42c2-954c-9bbd22056a76 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:14.937261 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-7c6a978a-485d-4f36-98b1-cfe67df7e639 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0d0570a796340e7ab1e68d9ae222fd6'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:14.941721 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7c07db-928e-42c2-954c-9bbd22056a76 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:14.947072 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee541d53-3fee-47bf-bc4b-bd801b82f4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:14.947758 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee541d53-3fee-47bf-bc4b-bd801b82f4e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:14.948082 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee541d53-3fee-47bf-bc4b-bd801b82f4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:14.948351 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee541d53-3fee-47bf-bc4b-bd801b82f4e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:14.949127 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee541d53-3fee-47bf-bc4b-bd801b82f4e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:21:14.949315 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-7c6a978a-485d-4f36-98b1-cfe67df7e639 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0d0570a796340e7ab1e68d9ae222fd6'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:14.949479 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee541d53-3fee-47bf-bc4b-bd801b82f4e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:14.949991 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-7c6a978a-485d-4f36-98b1-cfe67df7e639 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0d0570a796340e7ab1e68d9ae222fd6'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:14.950627 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-7c6a978a-485d-4f36-98b1-cfe67df7e639 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0d0570a796340e7ab1e68d9ae222fd6'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:14.951093 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee541d53-3fee-47bf-bc4b-bd801b82f4e9 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:14.966528 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 972/1941] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:21:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:21:14.966735 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 970/1942] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:21:14 2021] DELETE /identity/v3/users/a0d0570a796340e7ab1e68d9ae222fd6 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:21:14.967593 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee541d53-3fee-47bf-bc4b-bd801b82f4e9 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:14.969421 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-ee541d53-3fee-47bf-bc4b-bd801b82f4e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:14.981991 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee541d53-3fee-47bf-bc4b-bd801b82f4e9 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:15.050207 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b4f48-458e-4771-b1c2-422e2ca2a531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:15.050978 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b4f48-458e-4771-b1c2-422e2ca2a531 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:15.051393 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b4f48-458e-4771-b1c2-422e2ca2a531 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:15.051890 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b4f48-458e-4771-b1c2-422e2ca2a531 admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:15.052710 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b4f48-458e-4771-b1c2-422e2ca2a531 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:15.054870 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b4f48-458e-4771-b1c2-422e2ca2a531 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:15.095066 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 973/1943] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:21:14 2021] POST /identity/v3/projects => generated 367 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:21:15.099351 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a978a-485d-4f36-98b1-cfe67df7e639 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:15.114653 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a978a-485d-4f36-98b1-cfe67df7e639 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:15.205201 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f4fe5-d925-407c-b66a-509a077980e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:15.205881 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f4fe5-d925-407c-b66a-509a077980e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:15.206162 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f4fe5-d925-407c-b66a-509a077980e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:15.206430 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f4fe5-d925-407c-b66a-509a077980e4 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:15.207320 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f4fe5-d925-407c-b66a-509a077980e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:15.209242 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f4fe5-d925-407c-b66a-509a077980e4 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:15.235833 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 971/1944] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:21:15 2021] POST /identity/v3/users => generated 284 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:21:15.237646 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b4f48-458e-4771-b1c2-422e2ca2a531 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:15.249870 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b4f48-458e-4771-b1c2-422e2ca2a531 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:15.255429 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a9da44-8212-495f-bf12-d1ce06bc5549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:15.256247 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9da44-8212-495f-bf12-d1ce06bc5549 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:15.256526 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9da44-8212-495f-bf12-d1ce06bc5549 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:15.256797 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9da44-8212-495f-bf12-d1ce06bc5549 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:15.257534 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a9da44-8212-495f-bf12-d1ce06bc5549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:15.259228 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a9da44-8212-495f-bf12-d1ce06bc5549 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:15.274324 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 974/1945] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:21:15 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:21:15.276319 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f4fe5-d925-407c-b66a-509a077980e4 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:15.284341 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a9da44-8212-495f-bf12-d1ce06bc5549 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:15.286203 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-75a9da44-8212-495f-bf12-d1ce06bc5549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:15.288073 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f4fe5-d925-407c-b66a-509a077980e4 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:15.294381 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d023edd-7e91-49f0-9d18-5d800aada17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:15.295191 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d023edd-7e91-49f0-9d18-5d800aada17c admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:15.295461 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d023edd-7e91-49f0-9d18-5d800aada17c admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:15.295731 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d023edd-7e91-49f0-9d18-5d800aada17c admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:15.296473 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d023edd-7e91-49f0-9d18-5d800aada17c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:15.298522 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d023edd-7e91-49f0-9d18-5d800aada17c admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:15.306518 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a9da44-8212-495f-bf12-d1ce06bc5549 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:15.320044 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b729de-5784-4af5-a2e6-e5fd5811612d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:15.321218 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b729de-5784-4af5-a2e6-e5fd5811612d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:15.321687 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b729de-5784-4af5-a2e6-e5fd5811612d admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:15.322146 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b729de-5784-4af5-a2e6-e5fd5811612d admin admin] PATH_INFO: `/v3/projects/6f76cdd5e94b4b89abb2f6185ed55b97` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:15.322954 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 972/1946] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:21:15 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:21:15.323838 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d023edd-7e91-49f0-9d18-5d800aada17c admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:15.324464 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b729de-5784-4af5-a2e6-e5fd5811612d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f76cdd5e94b4b89abb2f6185ed55b97)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:15.326933 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b729de-5784-4af5-a2e6-e5fd5811612d admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:15.334041 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d023edd-7e91-49f0-9d18-5d800aada17c admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:15.341322 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd334c8-5148-4c71-bc4e-e431048281b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:15.342294 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd334c8-5148-4c71-bc4e-e431048281b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:15.342570 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd334c8-5148-4c71-bc4e-e431048281b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:15.342837 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd334c8-5148-4c71-bc4e-e431048281b9 admin admin] PATH_INFO: `/v3/projects/b78af647c6564dba9ca715fa3053763a/users/16ab49b5fda7473392bbefb4594581be/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:15.358689 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd334c8-5148-4c71-bc4e-e431048281b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b78af647c6564dba9ca715fa3053763a, user_id=16ab49b5fda7473392bbefb4594581be, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:15.361378 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd334c8-5148-4c71-bc4e-e431048281b9 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:15.378942 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 973/1947] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:21:15 2021] PUT /identity/v3/projects/b78af647c6564dba9ca715fa3053763a/users/16ab49b5fda7473392bbefb4594581be/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:21:15.386498 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d2f2d-ab1c-4ff0-963f-d81eac0e4b6a None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:15.386833 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d2f2d-ab1c-4ff0-963f-d81eac0e4b6a None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:15.387100 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d2f2d-ab1c-4ff0-963f-d81eac0e4b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:15.389567 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-81b729de-5784-4af5-a2e6-e5fd5811612d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f76cdd5e94b4b89abb2f6185ed55b97', 'request_id': 'req-81b729de-5784-4af5-a2e6-e5fd5811612d'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:15.396957 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-81b729de-5784-4af5-a2e6-e5fd5811612d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f76cdd5e94b4b89abb2f6185ed55b97', 'request_id': 'req-81b729de-5784-4af5-a2e6-e5fd5811612d'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:15.406523 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-81b729de-5784-4af5-a2e6-e5fd5811612d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f76cdd5e94b4b89abb2f6185ed55b97', 'request_id': 'req-81b729de-5784-4af5-a2e6-e5fd5811612d'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:15.418005 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-81b729de-5784-4af5-a2e6-e5fd5811612d admin admin] The token cache is being invalidate because project 6f76cdd5e94b4b89abb2f6185ed55b97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:21:15.418360 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-81b729de-5784-4af5-a2e6-e5fd5811612d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:15.419031 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-81b729de-5784-4af5-a2e6-e5fd5811612d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:15.419588 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-f00d2f2d-ab1c-4ff0-963f-d81eac0e4b6a None None] MFA Rules not processed for user `16ab49b5fda7473392bbefb4594581be`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:21:15.420748 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 975/1948] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:21:15 2021] DELETE /identity/v3/projects/6f76cdd5e94b4b89abb2f6185ed55b97 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:21:15.425441 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-f00d2f2d-ab1c-4ff0-963f-d81eac0e4b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:15.426901 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f49d15-85ef-4484-b678-f69c32719128 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:15.427199 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f49d15-85ef-4484-b678-f69c32719128 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:15.427480 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f49d15-85ef-4484-b678-f69c32719128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:15.451165 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-34f49d15-85ef-4484-b678-f69c32719128 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:21:15.452397 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-34f49d15-85ef-4484-b678-f69c32719128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:15.507134 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 974/1949] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:21:15 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:21:15.517978 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d2f2d-ab1c-4ff0-963f-d81eac0e4b6a None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:15.520131 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-f00d2f2d-ab1c-4ff0-963f-d81eac0e4b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:15.538450 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 976/1950] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:21:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:21:15.540500 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94fe40-290d-4d57-ba7f-4a1528854e49 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:15.540791 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94fe40-290d-4d57-ba7f-4a1528854e49 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:15.541066 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94fe40-290d-4d57-ba7f-4a1528854e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:15.576897 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-0e94fe40-290d-4d57-ba7f-4a1528854e49 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:21:15.578046 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-0e94fe40-290d-4d57-ba7f-4a1528854e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:15.596736 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 977/1951] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:21:15 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:21:15.600730 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e94fe40-290d-4d57-ba7f-4a1528854e49 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:15.602355 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d2f2d-ab1c-4ff0-963f-d81eac0e4b6a None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:15.613724 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e94fe40-290d-4d57-ba7f-4a1528854e49 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:15.616732 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13467a0-56d8-4378-8c5f-dca9a1686c26 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcc415af1f5a42febbdbd187e066cf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:15.617497 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13467a0-56d8-4378-8c5f-dca9a1686c26 service glance] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:15.617752 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13467a0-56d8-4378-8c5f-dca9a1686c26 service glance] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:15.617930 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13467a0-56d8-4378-8c5f-dca9a1686c26 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:15.631957 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee547d-1c68-41e3-bcb7-ad6cd09bfef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:15.632668 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee547d-1c68-41e3-bcb7-ad6cd09bfef3 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:15.632966 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee547d-1c68-41e3-bcb7-ad6cd09bfef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:15.634696 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13467a0-56d8-4378-8c5f-dca9a1686c26 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:15.636955 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13467a0-56d8-4378-8c5f-dca9a1686c26 service glance] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:15.640976 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee547d-1c68-41e3-bcb7-ad6cd09bfef3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:15.641905 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee547d-1c68-41e3-bcb7-ad6cd09bfef3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:21:15.642215 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee547d-1c68-41e3-bcb7-ad6cd09bfef3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:15.646269 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee547d-1c68-41e3-bcb7-ad6cd09bfef3 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:15.651103 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 975/1952] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:21:15 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 29 20:21:15.674399 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13467a0-56d8-4378-8c5f-dca9a1686c26 service glance] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:15.682634 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 978/1953] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:21:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:21:15.687128 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13467a0-56d8-4378-8c5f-dca9a1686c26 service glance] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:15.692075 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3511d-882d-43ec-8aae-e3c3cfeb3e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:15.692929 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3511d-882d-43ec-8aae-e3c3cfeb3e3f admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:15.693245 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3511d-882d-43ec-8aae-e3c3cfeb3e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:15.693481 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3511d-882d-43ec-8aae-e3c3cfeb3e3f admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:15.694250 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae3511d-882d-43ec-8aae-e3c3cfeb3e3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:15.696460 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae3511d-882d-43ec-8aae-e3c3cfeb3e3f admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:15.727738 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 976/1954] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:21:15 2021] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:21:15.734163 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee547d-1c68-41e3-bcb7-ad6cd09bfef3 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:15.746753 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee547d-1c68-41e3-bcb7-ad6cd09bfef3 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:15.833769 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a83bb-8033-487b-af5c-eb0c9b2bf40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:15.834536 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a83bb-8033-487b-af5c-eb0c9b2bf40a admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:15.836056 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a83bb-8033-487b-af5c-eb0c9b2bf40a admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:15.836418 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a83bb-8033-487b-af5c-eb0c9b2bf40a admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:15.837146 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a83bb-8033-487b-af5c-eb0c9b2bf40a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:15.839172 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a83bb-8033-487b-af5c-eb0c9b2bf40a admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:15.867968 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 979/1955] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:21:15 2021] POST /identity/v3/users => generated 285 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:21:15.871885 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3511d-882d-43ec-8aae-e3c3cfeb3e3f admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:15.884462 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3511d-882d-43ec-8aae-e3c3cfeb3e3f admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:15.891097 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b765482-1f6f-49c8-b743-02667ddd3042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:15.891830 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b765482-1f6f-49c8-b743-02667ddd3042 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:15.892054 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b765482-1f6f-49c8-b743-02667ddd3042 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:15.892486 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b765482-1f6f-49c8-b743-02667ddd3042 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:15.893379 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b765482-1f6f-49c8-b743-02667ddd3042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:15.896460 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b765482-1f6f-49c8-b743-02667ddd3042 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:15.909083 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 977/1956] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:21:15 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:21:15.912532 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a83bb-8033-487b-af5c-eb0c9b2bf40a admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:15.922833 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a83bb-8033-487b-af5c-eb0c9b2bf40a admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:15.928367 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ced20-d871-47ec-8cb5-c329b955a4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:15.929201 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ced20-d871-47ec-8cb5-c329b955a4a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:15.929310 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ced20-d871-47ec-8cb5-c329b955a4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:15.929579 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ced20-d871-47ec-8cb5-c329b955a4a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:15.930384 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75ced20-d871-47ec-8cb5-c329b955a4a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:15.932561 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75ced20-d871-47ec-8cb5-c329b955a4a9 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:15.942621 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 980/1957] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:21:15 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 29 20:21:15.946648 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b765482-1f6f-49c8-b743-02667ddd3042 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:15.956708 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b765482-1f6f-49c8-b743-02667ddd3042 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:15.961714 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f23f7-d1f2-4779-907d-5655c48bb2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:15.962712 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f23f7-d1f2-4779-907d-5655c48bb2f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:15.963140 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f23f7-d1f2-4779-907d-5655c48bb2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:15.963516 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00f23f7-d1f2-4779-907d-5655c48bb2f7 admin admin] PATH_INFO: `/v3/projects/64a53acf48c84ed582e67115a2f88b68/users/36a89f1ee53d40ed953c09d3184f9df9/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:15.985834 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00f23f7-d1f2-4779-907d-5655c48bb2f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64a53acf48c84ed582e67115a2f88b68, user_id=36a89f1ee53d40ed953c09d3184f9df9, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:15.988853 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00f23f7-d1f2-4779-907d-5655c48bb2f7 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:16.006969 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 978/1958] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:21:15 2021] PUT /identity/v3/projects/64a53acf48c84ed582e67115a2f88b68/users/36a89f1ee53d40ed953c09d3184f9df9/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:21:16.016404 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3457cc-8568-4c1d-877a-86d754d91abc None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:16.016838 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3457cc-8568-4c1d-877a-86d754d91abc None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:16.017188 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3457cc-8568-4c1d-877a-86d754d91abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:16.048303 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-ef3457cc-8568-4c1d-877a-86d754d91abc None None] MFA Rules not processed for user `36a89f1ee53d40ed953c09d3184f9df9`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:21:16.049800 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-ef3457cc-8568-4c1d-877a-86d754d91abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:16.135285 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 981/1959] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:21:16 2021] POST /identity/v3/auth/tokens => generated 3236 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:21:16.148953 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f23f7-d1f2-4779-907d-5655c48bb2f7 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:16.237625 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00f23f7-d1f2-4779-907d-5655c48bb2f7 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:16.248220 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d308cbd0-c842-42bd-85d8-b6aec60d118c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcc415af1f5a42febbdbd187e066cf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:16.249261 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308cbd0-c842-42bd-85d8-b6aec60d118c service glance] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:16.249644 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308cbd0-c842-42bd-85d8-b6aec60d118c service glance] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:16.249982 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308cbd0-c842-42bd-85d8-b6aec60d118c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:16.267556 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d308cbd0-c842-42bd-85d8-b6aec60d118c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:16.269432 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d308cbd0-c842-42bd-85d8-b6aec60d118c service glance] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:16.279651 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 979/1960] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:21:16 2021] GET /identity/v3/auth/tokens => generated 3236 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:21:21.821742 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3457cc-8568-4c1d-877a-86d754d91abc None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:21.824479 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-ef3457cc-8568-4c1d-877a-86d754d91abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:21.928288 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3457cc-8568-4c1d-877a-86d754d91abc None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:21.932687 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68bc89-01dc-4e72-9594-2cb7413a6786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:21.933565 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68bc89-01dc-4e72-9594-2cb7413a6786 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:21.933834 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68bc89-01dc-4e72-9594-2cb7413a6786 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:21.934103 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68bc89-01dc-4e72-9594-2cb7413a6786 admin admin] PATH_INFO: `/v3/users/4341fd73877945e88df90abac7e90f81` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:21.935400 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab68bc89-01dc-4e72-9594-2cb7413a6786 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4341fd73877945e88df90abac7e90f81)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:21.937359 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab68bc89-01dc-4e72-9594-2cb7413a6786 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:22.013672 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ab68bc89-01dc-4e72-9594-2cb7413a6786 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4341fd73877945e88df90abac7e90f81'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:22.021603 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ab68bc89-01dc-4e72-9594-2cb7413a6786 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4341fd73877945e88df90abac7e90f81'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:22.038463 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ab68bc89-01dc-4e72-9594-2cb7413a6786 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4341fd73877945e88df90abac7e90f81'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:22.053358 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ab68bc89-01dc-4e72-9594-2cb7413a6786 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4341fd73877945e88df90abac7e90f81'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:22.054095 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ab68bc89-01dc-4e72-9594-2cb7413a6786 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4341fd73877945e88df90abac7e90f81'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:22.064259 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 982/1961] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:21:21 2021] DELETE /identity/v3/users/4341fd73877945e88df90abac7e90f81 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:21:22.066217 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2125e7-4dee-49d9-9b58-9111b4f0947a None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:22.066736 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2125e7-4dee-49d9-9b58-9111b4f0947a None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:22.066827 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2125e7-4dee-49d9-9b58-9111b4f0947a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:22.090492 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-9c2125e7-4dee-49d9-9b58-9111b4f0947a None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:21:22.092300 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-9c2125e7-4dee-49d9-9b58-9111b4f0947a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:22.163842 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 980/1962] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:21:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:21:22.173841 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68bc89-01dc-4e72-9594-2cb7413a6786 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:22.175306 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-ab68bc89-01dc-4e72-9594-2cb7413a6786 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:22.232680 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68bc89-01dc-4e72-9594-2cb7413a6786 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:22.237742 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45f22a-e447-454c-a885-ac774ddfe19f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:22.238408 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45f22a-e447-454c-a885-ac774ddfe19f service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:22.238690 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45f22a-e447-454c-a885-ac774ddfe19f service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:22.238992 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45f22a-e447-454c-a885-ac774ddfe19f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:22.254019 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c45f22a-e447-454c-a885-ac774ddfe19f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:22.255458 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c45f22a-e447-454c-a885-ac774ddfe19f service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:22.265691 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 983/1963] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:21:22 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:21:23.066758 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2125e7-4dee-49d9-9b58-9111b4f0947a None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:23.068625 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-9c2125e7-4dee-49d9-9b58-9111b4f0947a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:23.081139 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2125e7-4dee-49d9-9b58-9111b4f0947a None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:23.086034 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c3c3dc-6dca-4b72-b6e8-c578121a2196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:23.086836 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3c3dc-6dca-4b72-b6e8-c578121a2196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:23.087148 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3c3dc-6dca-4b72-b6e8-c578121a2196 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:23.087419 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c3c3dc-6dca-4b72-b6e8-c578121a2196 admin admin] PATH_INFO: `/v3/projects/c1354989ca764f3caa466805c468d493` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:23.088734 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c3c3dc-6dca-4b72-b6e8-c578121a2196 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1354989ca764f3caa466805c468d493)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:23.090691 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c3c3dc-6dca-4b72-b6e8-c578121a2196 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:23.142941 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-03c3c3dc-6dca-4b72-b6e8-c578121a2196 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1354989ca764f3caa466805c468d493', 'request_id': 'req-03c3c3dc-6dca-4b72-b6e8-c578121a2196'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:23.149471 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-03c3c3dc-6dca-4b72-b6e8-c578121a2196 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1354989ca764f3caa466805c468d493', 'request_id': 'req-03c3c3dc-6dca-4b72-b6e8-c578121a2196'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:23.154637 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-03c3c3dc-6dca-4b72-b6e8-c578121a2196 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1354989ca764f3caa466805c468d493', 'request_id': 'req-03c3c3dc-6dca-4b72-b6e8-c578121a2196'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:23.168435 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-03c3c3dc-6dca-4b72-b6e8-c578121a2196 admin admin] The token cache is being invalidate because project c1354989ca764f3caa466805c468d493 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:21:23.168724 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-03c3c3dc-6dca-4b72-b6e8-c578121a2196 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:23.169346 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-03c3c3dc-6dca-4b72-b6e8-c578121a2196 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:23.171376 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 981/1964] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:21:23 2021] DELETE /identity/v3/projects/c1354989ca764f3caa466805c468d493 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:21:23.175111 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45f22a-e447-454c-a885-ac774ddfe19f service neutron] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:23.184603 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45f22a-e447-454c-a885-ac774ddfe19f service neutron] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:23.243321 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba517f-daa9-47e6-83fb-fe85f2e8e7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:23.244225 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba517f-daa9-47e6-83fb-fe85f2e8e7cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:23.244494 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba517f-daa9-47e6-83fb-fe85f2e8e7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:23.244770 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba517f-daa9-47e6-83fb-fe85f2e8e7cb admin admin] PATH_INFO: `/v3/users/36580541c90b4ba7988e021352d2d015` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:23.246044 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba517f-daa9-47e6-83fb-fe85f2e8e7cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=36580541c90b4ba7988e021352d2d015)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:23.248687 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba517f-daa9-47e6-83fb-fe85f2e8e7cb admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:23.319431 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-59ba517f-daa9-47e6-83fb-fe85f2e8e7cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36580541c90b4ba7988e021352d2d015'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:23.327006 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-59ba517f-daa9-47e6-83fb-fe85f2e8e7cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36580541c90b4ba7988e021352d2d015'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:23.335789 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-59ba517f-daa9-47e6-83fb-fe85f2e8e7cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36580541c90b4ba7988e021352d2d015'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:23.348954 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-59ba517f-daa9-47e6-83fb-fe85f2e8e7cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36580541c90b4ba7988e021352d2d015'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:23.349591 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-59ba517f-daa9-47e6-83fb-fe85f2e8e7cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36580541c90b4ba7988e021352d2d015'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:23.356259 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 984/1965] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:21:23 2021] DELETE /identity/v3/users/36580541c90b4ba7988e021352d2d015 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:21:23.708898 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c3c3dc-6dca-4b72-b6e8-c578121a2196 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:23.710627 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-03c3c3dc-6dca-4b72-b6e8-c578121a2196 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:23.726115 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c3c3dc-6dca-4b72-b6e8-c578121a2196 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:23.787388 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc9bb14-eb31-4261-b9e6-717bef237d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:23.788259 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9bb14-eb31-4261-b9e6-717bef237d3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:23.788541 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9bb14-eb31-4261-b9e6-717bef237d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:23.788813 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc9bb14-eb31-4261-b9e6-717bef237d3c admin admin] PATH_INFO: `/v3/projects/7c56d6e29fc643b8a427257fd65a9124` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:23.790086 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9bb14-eb31-4261-b9e6-717bef237d3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c56d6e29fc643b8a427257fd65a9124)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:23.792006 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc9bb14-eb31-4261-b9e6-717bef237d3c admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:23.841848 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-dfc9bb14-eb31-4261-b9e6-717bef237d3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c56d6e29fc643b8a427257fd65a9124', 'request_id': 'req-dfc9bb14-eb31-4261-b9e6-717bef237d3c'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:23.848725 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-dfc9bb14-eb31-4261-b9e6-717bef237d3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c56d6e29fc643b8a427257fd65a9124', 'request_id': 'req-dfc9bb14-eb31-4261-b9e6-717bef237d3c'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:23.854075 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-dfc9bb14-eb31-4261-b9e6-717bef237d3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c56d6e29fc643b8a427257fd65a9124', 'request_id': 'req-dfc9bb14-eb31-4261-b9e6-717bef237d3c'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:23.868502 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-dfc9bb14-eb31-4261-b9e6-717bef237d3c admin admin] The token cache is being invalidate because project 7c56d6e29fc643b8a427257fd65a9124 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:21:23.868791 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-dfc9bb14-eb31-4261-b9e6-717bef237d3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:23.871084 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-dfc9bb14-eb31-4261-b9e6-717bef237d3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:23.878040 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 982/1966] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:21:23 2021] DELETE /identity/v3/projects/7c56d6e29fc643b8a427257fd65a9124 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:21:23.879933 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd3907-9ebe-4472-88a0-05e0238f3d6a None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:23.880217 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd3907-9ebe-4472-88a0-05e0238f3d6a None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:23.880493 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd3907-9ebe-4472-88a0-05e0238f3d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:23.903722 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-c0fd3907-9ebe-4472-88a0-05e0238f3d6a None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:21:23.904702 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-c0fd3907-9ebe-4472-88a0-05e0238f3d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:23.967010 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 985/1967] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:21:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:21:23.970728 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f79b4-f3d7-4cc4-bf8a-1f70295989ae None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:23.971045 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f79b4-f3d7-4cc4-bf8a-1f70295989ae None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:23.971360 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f79b4-f3d7-4cc4-bf8a-1f70295989ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:23.993037 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-3f9f79b4-f3d7-4cc4-bf8a-1f70295989ae None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:21:23.994251 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-3f9f79b4-f3d7-4cc4-bf8a-1f70295989ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:24.002914 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 983/1968] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:21:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:21:24.007061 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd3907-9ebe-4472-88a0-05e0238f3d6a None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:24.016968 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd3907-9ebe-4472-88a0-05e0238f3d6a None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:24.022411 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0fe17b-9f5f-4434-a509-f799d5a7e66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:24.023126 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fe17b-9f5f-4434-a509-f799d5a7e66f admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:24.023414 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fe17b-9f5f-4434-a509-f799d5a7e66f admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:24.023686 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0fe17b-9f5f-4434-a509-f799d5a7e66f admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:24.024438 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0fe17b-9f5f-4434-a509-f799d5a7e66f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:21:24.024740 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0fe17b-9f5f-4434-a509-f799d5a7e66f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:24.026341 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0fe17b-9f5f-4434-a509-f799d5a7e66f admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:24.039082 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 986/1969] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:21:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:21:24.043868 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f79b4-f3d7-4cc4-bf8a-1f70295989ae None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:24.053974 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f79b4-f3d7-4cc4-bf8a-1f70295989ae None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:24.059631 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a2f17-e5b2-401c-bddb-8e3ebc3b8906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:24.060540 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a2f17-e5b2-401c-bddb-8e3ebc3b8906 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:24.060857 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a2f17-e5b2-401c-bddb-8e3ebc3b8906 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:24.061198 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a2f17-e5b2-401c-bddb-8e3ebc3b8906 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:24.061922 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a2f17-e5b2-401c-bddb-8e3ebc3b8906 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:24.063950 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a2f17-e5b2-401c-bddb-8e3ebc3b8906 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:24.095055 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 984/1970] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:21:24 2021] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:21:24.099073 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0fe17b-9f5f-4434-a509-f799d5a7e66f admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:24.109951 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0fe17b-9f5f-4434-a509-f799d5a7e66f admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:24.166612 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914a36f-8abf-4836-aef3-dc11ace5d632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:24.167322 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914a36f-8abf-4836-aef3-dc11ace5d632 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:24.167606 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914a36f-8abf-4836-aef3-dc11ace5d632 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:24.167885 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914a36f-8abf-4836-aef3-dc11ace5d632 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:24.168586 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0914a36f-8abf-4836-aef3-dc11ace5d632 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:24.170553 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0914a36f-8abf-4836-aef3-dc11ace5d632 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:24.195565 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 987/1971] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:21:24 2021] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:21:24.200653 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a2f17-e5b2-401c-bddb-8e3ebc3b8906 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:24.218036 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a2f17-e5b2-401c-bddb-8e3ebc3b8906 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:24.223748 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8007be-e086-425e-b42f-22d6fd4490b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:24.224460 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8007be-e086-425e-b42f-22d6fd4490b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:24.224738 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8007be-e086-425e-b42f-22d6fd4490b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:24.225007 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8007be-e086-425e-b42f-22d6fd4490b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:24.225749 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8007be-e086-425e-b42f-22d6fd4490b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:24.227428 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8007be-e086-425e-b42f-22d6fd4490b8 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:24.238910 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 985/1972] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:21:24 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:21:24.243195 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914a36f-8abf-4836-aef3-dc11ace5d632 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:24.253061 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914a36f-8abf-4836-aef3-dc11ace5d632 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:24.257905 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7651ddf2-3e71-4813-8eaf-37320dd10577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:24.258579 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651ddf2-3e71-4813-8eaf-37320dd10577 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:24.258878 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651ddf2-3e71-4813-8eaf-37320dd10577 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:24.259156 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651ddf2-3e71-4813-8eaf-37320dd10577 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:24.259897 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7651ddf2-3e71-4813-8eaf-37320dd10577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:24.261540 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7651ddf2-3e71-4813-8eaf-37320dd10577 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:24.272722 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 988/1973] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:21:24 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:21:24.276969 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8007be-e086-425e-b42f-22d6fd4490b8 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:24.286917 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8007be-e086-425e-b42f-22d6fd4490b8 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:24.291797 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e728d42-2811-4cf4-a7a6-e2f746050ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:24.292725 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e728d42-2811-4cf4-a7a6-e2f746050ca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:24.293193 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e728d42-2811-4cf4-a7a6-e2f746050ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:24.293474 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e728d42-2811-4cf4-a7a6-e2f746050ca7 admin admin] PATH_INFO: `/v3/projects/9af655acc32b439c9940ec885ead893c/users/e47f63ef3fd64fbc972e6197a39c0f90/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:24.307638 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e728d42-2811-4cf4-a7a6-e2f746050ca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9af655acc32b439c9940ec885ead893c, user_id=e47f63ef3fd64fbc972e6197a39c0f90, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:24.310271 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e728d42-2811-4cf4-a7a6-e2f746050ca7 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:24.324038 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 986/1974] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:21:24 2021] PUT /identity/v3/projects/9af655acc32b439c9940ec885ead893c/users/e47f63ef3fd64fbc972e6197a39c0f90/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:21:24.335492 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5b9b7-60b0-4bed-9b54-dd78605c2dfe None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:24.335934 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5b9b7-60b0-4bed-9b54-dd78605c2dfe None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:24.336332 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5b9b7-60b0-4bed-9b54-dd78605c2dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:24.362766 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-2bb5b9b7-60b0-4bed-9b54-dd78605c2dfe None None] MFA Rules not processed for user `e47f63ef3fd64fbc972e6197a39c0f90`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:21:24.363919 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-2bb5b9b7-60b0-4bed-9b54-dd78605c2dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:24.427404 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 989/1975] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:21:24 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:21:24.431861 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e728d42-2811-4cf4-a7a6-e2f746050ca7 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:24.497416 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e728d42-2811-4cf4-a7a6-e2f746050ca7 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:24.502427 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e81f1a3-b0c7-4130-bae7-78cb27b957ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:24.503211 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81f1a3-b0c7-4130-bae7-78cb27b957ea admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:24.503484 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81f1a3-b0c7-4130-bae7-78cb27b957ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:24.503749 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81f1a3-b0c7-4130-bae7-78cb27b957ea admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:24.504504 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e81f1a3-b0c7-4130-bae7-78cb27b957ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:24.506401 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e81f1a3-b0c7-4130-bae7-78cb27b957ea admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:24.539288 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 987/1976] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:21:24 2021] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 29 20:21:24.543894 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5b9b7-60b0-4bed-9b54-dd78605c2dfe None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:24.566696 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5b9b7-60b0-4bed-9b54-dd78605c2dfe None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:24.625278 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe8444f-4423-4e92-bf4f-3d4170bb8b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:24.625980 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8444f-4423-4e92-bf4f-3d4170bb8b4a admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:24.626256 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8444f-4423-4e92-bf4f-3d4170bb8b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:24.626523 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8444f-4423-4e92-bf4f-3d4170bb8b4a admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:24.627304 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe8444f-4423-4e92-bf4f-3d4170bb8b4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:24.629208 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe8444f-4423-4e92-bf4f-3d4170bb8b4a admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:24.655407 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 990/1977] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:21:24 2021] POST /identity/v3/users => generated 297 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:21:24.659199 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e81f1a3-b0c7-4130-bae7-78cb27b957ea admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:24.670277 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e81f1a3-b0c7-4130-bae7-78cb27b957ea admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:24.675167 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3acc3d3-c704-4d34-ae16-ac0d23c717f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:24.675848 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3acc3d3-c704-4d34-ae16-ac0d23c717f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:24.676129 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3acc3d3-c704-4d34-ae16-ac0d23c717f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:24.676408 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3acc3d3-c704-4d34-ae16-ac0d23c717f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:24.677149 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3acc3d3-c704-4d34-ae16-ac0d23c717f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:24.679796 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3acc3d3-c704-4d34-ae16-ac0d23c717f6 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:24.690435 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 988/1978] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:21:24 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:21:24.694581 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe8444f-4423-4e92-bf4f-3d4170bb8b4a admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:24.705492 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe8444f-4423-4e92-bf4f-3d4170bb8b4a admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:24.711039 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c59fb6-cd9e-415b-aa5d-8568a0814cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:24.711954 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c59fb6-cd9e-415b-aa5d-8568a0814cae admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:24.712237 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c59fb6-cd9e-415b-aa5d-8568a0814cae admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:24.712585 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c59fb6-cd9e-415b-aa5d-8568a0814cae admin admin] PATH_INFO: `/v3/projects/21c6f3360f57407d9e53b84bef85d07e/users/03fc3c34748f4c01b660fdb4f5d6f952/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:24.740676 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c59fb6-cd9e-415b-aa5d-8568a0814cae admin admin] RBAC: Authorizing `identity:create_grant(project_id=21c6f3360f57407d9e53b84bef85d07e, user_id=03fc3c34748f4c01b660fdb4f5d6f952, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:24.743873 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c59fb6-cd9e-415b-aa5d-8568a0814cae admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:24.761034 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 991/1979] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:21:24 2021] PUT /identity/v3/projects/21c6f3360f57407d9e53b84bef85d07e/users/03fc3c34748f4c01b660fdb4f5d6f952/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:21:24.765672 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3acc3d3-c704-4d34-ae16-ac0d23c717f6 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:24.777298 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3acc3d3-c704-4d34-ae16-ac0d23c717f6 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:24.851038 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c1ce37-5c30-4af5-8816-1517cf194f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:24.851840 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1ce37-5c30-4af5-8816-1517cf194f73 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:24.852194 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1ce37-5c30-4af5-8816-1517cf194f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:24.852537 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1ce37-5c30-4af5-8816-1517cf194f73 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:24.853359 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c1ce37-5c30-4af5-8816-1517cf194f73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:24.855070 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c1ce37-5c30-4af5-8816-1517cf194f73 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:24.866957 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 989/1980] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:21:24 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:21:24.870980 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c59fb6-cd9e-415b-aa5d-8568a0814cae admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:24.883653 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c59fb6-cd9e-415b-aa5d-8568a0814cae admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:24.888614 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b7386-cca1-45a7-b8c8-5804816b6238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:24.889564 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b7386-cca1-45a7-b8c8-5804816b6238 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:24.889845 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b7386-cca1-45a7-b8c8-5804816b6238 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:24.890122 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b7386-cca1-45a7-b8c8-5804816b6238 admin admin] PATH_INFO: `/v3/projects/21c6f3360f57407d9e53b84bef85d07e/users/03fc3c34748f4c01b660fdb4f5d6f952/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:24.894249 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b7386-cca1-45a7-b8c8-5804816b6238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21c6f3360f57407d9e53b84bef85d07e, user_id=03fc3c34748f4c01b660fdb4f5d6f952, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:24.897029 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b7386-cca1-45a7-b8c8-5804816b6238 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:24.916136 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 992/1981] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:21:24 2021] PUT /identity/v3/projects/21c6f3360f57407d9e53b84bef85d07e/users/03fc3c34748f4c01b660fdb4f5d6f952/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:21:24.932600 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3768f4-bcc7-4a85-9b77-905d1d70abbf None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:24.932600 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3768f4-bcc7-4a85-9b77-905d1d70abbf None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:24.932600 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3768f4-bcc7-4a85-9b77-905d1d70abbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:24.958533 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-bc3768f4-bcc7-4a85-9b77-905d1d70abbf None None] MFA Rules not processed for user `03fc3c34748f4c01b660fdb4f5d6f952`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:21:24.959925 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-bc3768f4-bcc7-4a85-9b77-905d1d70abbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:25.029884 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 990/1982] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:21:24 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:21:25.041043 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b7386-cca1-45a7-b8c8-5804816b6238 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:25.043594 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-a59b7386-cca1-45a7-b8c8-5804816b6238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:25.098811 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b7386-cca1-45a7-b8c8-5804816b6238 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:25.102710 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed54fa0-255d-4a0c-b4d3-e85a454e78f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:25.103383 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed54fa0-255d-4a0c-b4d3-e85a454e78f5 service cinder] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:25.103658 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed54fa0-255d-4a0c-b4d3-e85a454e78f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:25.103949 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed54fa0-255d-4a0c-b4d3-e85a454e78f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:25.112954 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed54fa0-255d-4a0c-b4d3-e85a454e78f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:25.115130 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed54fa0-255d-4a0c-b4d3-e85a454e78f5 service cinder] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:25.124790 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 993/1983] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:21:25 2021] GET /identity/v3/auth/tokens => generated 3315 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:21:25.219850 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3768f4-bcc7-4a85-9b77-905d1d70abbf None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:25.221288 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-bc3768f4-bcc7-4a85-9b77-905d1d70abbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:25.233370 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3768f4-bcc7-4a85-9b77-905d1d70abbf None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:25.237130 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8f8d9-b9b2-42e2-8e23-9e269f30add2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:25.237778 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8f8d9-b9b2-42e2-8e23-9e269f30add2 service cinder] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:25.238061 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8f8d9-b9b2-42e2-8e23-9e269f30add2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:25.238337 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8f8d9-b9b2-42e2-8e23-9e269f30add2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:25.295075 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e8f8d9-b9b2-42e2-8e23-9e269f30add2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:25.296629 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e8f8d9-b9b2-42e2-8e23-9e269f30add2 service cinder] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:25.305333 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 991/1984] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:21:25 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:21:25.550199 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed54fa0-255d-4a0c-b4d3-e85a454e78f5 service cinder] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:25.620276 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed54fa0-255d-4a0c-b4d3-e85a454e78f5 service cinder] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:25.625502 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ad561-a137-42b9-8ffb-03236009e6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:25.626588 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ad561-a137-42b9-8ffb-03236009e6bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:25.626783 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ad561-a137-42b9-8ffb-03236009e6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:25.627120 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ad561-a137-42b9-8ffb-03236009e6bf admin admin] PATH_INFO: `/v3/users/e47f63ef3fd64fbc972e6197a39c0f90` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:25.628391 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8ad561-a137-42b9-8ffb-03236009e6bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e47f63ef3fd64fbc972e6197a39c0f90)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:25.630305 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8ad561-a137-42b9-8ffb-03236009e6bf admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:25.688269 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-2a8ad561-a137-42b9-8ffb-03236009e6bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e47f63ef3fd64fbc972e6197a39c0f90'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:25.695163 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-2a8ad561-a137-42b9-8ffb-03236009e6bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e47f63ef3fd64fbc972e6197a39c0f90'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:25.703377 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-2a8ad561-a137-42b9-8ffb-03236009e6bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e47f63ef3fd64fbc972e6197a39c0f90'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:25.715799 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-2a8ad561-a137-42b9-8ffb-03236009e6bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e47f63ef3fd64fbc972e6197a39c0f90'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:25.716563 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-2a8ad561-a137-42b9-8ffb-03236009e6bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e47f63ef3fd64fbc972e6197a39c0f90'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:25.722280 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 994/1985] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:21:25 2021] DELETE /identity/v3/users/e47f63ef3fd64fbc972e6197a39c0f90 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:21:25.726812 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ea394-37c5-4ac7-92c3-3f1b3f75be33 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:25.728042 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ea394-37c5-4ac7-92c3-3f1b3f75be33 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:25.728333 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ea394-37c5-4ac7-92c3-3f1b3f75be33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:25.746070 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-025ea394-37c5-4ac7-92c3-3f1b3f75be33 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:21:25.747301 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-025ea394-37c5-4ac7-92c3-3f1b3f75be33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:25.805448 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 992/1986] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:21:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:21:25.815741 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ad561-a137-42b9-8ffb-03236009e6bf admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:25.817349 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-2a8ad561-a137-42b9-8ffb-03236009e6bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:25.876005 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ad561-a137-42b9-8ffb-03236009e6bf admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:25.880115 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71359a6d-6e6e-4200-8c82-b194a46f9aa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:25.880698 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71359a6d-6e6e-4200-8c82-b194a46f9aa8 service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:25.880976 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71359a6d-6e6e-4200-8c82-b194a46f9aa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:25.881250 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71359a6d-6e6e-4200-8c82-b194a46f9aa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:25.892674 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71359a6d-6e6e-4200-8c82-b194a46f9aa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:25.894476 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71359a6d-6e6e-4200-8c82-b194a46f9aa8 service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:25.905042 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 995/1987] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:21:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:21:26.171063 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ea394-37c5-4ac7-92c3-3f1b3f75be33 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:26.172514 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-025ea394-37c5-4ac7-92c3-3f1b3f75be33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:26.184510 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ea394-37c5-4ac7-92c3-3f1b3f75be33 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:26.189562 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09669a7-90ac-40ca-9239-301d25f9e1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:26.190485 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09669a7-90ac-40ca-9239-301d25f9e1b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:26.190711 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09669a7-90ac-40ca-9239-301d25f9e1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:26.191017 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09669a7-90ac-40ca-9239-301d25f9e1b0 admin admin] PATH_INFO: `/v3/projects/9af655acc32b439c9940ec885ead893c` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:26.192440 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09669a7-90ac-40ca-9239-301d25f9e1b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9af655acc32b439c9940ec885ead893c)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:26.194345 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09669a7-90ac-40ca-9239-301d25f9e1b0 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:26.259523 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-d09669a7-90ac-40ca-9239-301d25f9e1b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9af655acc32b439c9940ec885ead893c', 'request_id': 'req-d09669a7-90ac-40ca-9239-301d25f9e1b0'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:26.265806 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-d09669a7-90ac-40ca-9239-301d25f9e1b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9af655acc32b439c9940ec885ead893c', 'request_id': 'req-d09669a7-90ac-40ca-9239-301d25f9e1b0'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:26.271422 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-d09669a7-90ac-40ca-9239-301d25f9e1b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9af655acc32b439c9940ec885ead893c', 'request_id': 'req-d09669a7-90ac-40ca-9239-301d25f9e1b0'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:26.284025 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-d09669a7-90ac-40ca-9239-301d25f9e1b0 admin admin] The token cache is being invalidate because project 9af655acc32b439c9940ec885ead893c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:21:26.284309 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-d09669a7-90ac-40ca-9239-301d25f9e1b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:26.284926 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-d09669a7-90ac-40ca-9239-301d25f9e1b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:26.286465 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 993/1988] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:21:26 2021] DELETE /identity/v3/projects/9af655acc32b439c9940ec885ead893c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:21:26.290486 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71359a6d-6e6e-4200-8c82-b194a46f9aa8 service neutron] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:26.300282 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71359a6d-6e6e-4200-8c82-b194a46f9aa8 service neutron] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:26.358117 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef73d7-d5bd-4cb5-8ace-8e95737f4cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:26.359016 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef73d7-d5bd-4cb5-8ace-8e95737f4cb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:26.359297 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef73d7-d5bd-4cb5-8ace-8e95737f4cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:26.359574 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef73d7-d5bd-4cb5-8ace-8e95737f4cb9 admin admin] PATH_INFO: `/v3/users/03fc3c34748f4c01b660fdb4f5d6f952` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:26.360784 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef73d7-d5bd-4cb5-8ace-8e95737f4cb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03fc3c34748f4c01b660fdb4f5d6f952)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:26.362705 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef73d7-d5bd-4cb5-8ace-8e95737f4cb9 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:26.415023 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-d7ef73d7-d5bd-4cb5-8ace-8e95737f4cb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03fc3c34748f4c01b660fdb4f5d6f952'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:26.421668 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-d7ef73d7-d5bd-4cb5-8ace-8e95737f4cb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03fc3c34748f4c01b660fdb4f5d6f952'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:26.431813 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-d7ef73d7-d5bd-4cb5-8ace-8e95737f4cb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03fc3c34748f4c01b660fdb4f5d6f952'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:26.443793 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-d7ef73d7-d5bd-4cb5-8ace-8e95737f4cb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03fc3c34748f4c01b660fdb4f5d6f952'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:26.444435 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-d7ef73d7-d5bd-4cb5-8ace-8e95737f4cb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03fc3c34748f4c01b660fdb4f5d6f952'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:26.450277 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 996/1989] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:21:26 2021] DELETE /identity/v3/users/03fc3c34748f4c01b660fdb4f5d6f952 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:21:26.733984 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09669a7-90ac-40ca-9239-301d25f9e1b0 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:26.735603 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-d09669a7-90ac-40ca-9239-301d25f9e1b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:26.754185 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09669a7-90ac-40ca-9239-301d25f9e1b0 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:26.817550 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a78bb-b283-488e-9d30-94b1117790f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:26.818708 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a78bb-b283-488e-9d30-94b1117790f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:26.819029 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a78bb-b283-488e-9d30-94b1117790f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:26.819306 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a78bb-b283-488e-9d30-94b1117790f7 admin admin] PATH_INFO: `/v3/projects/21c6f3360f57407d9e53b84bef85d07e` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:26.820640 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a78bb-b283-488e-9d30-94b1117790f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21c6f3360f57407d9e53b84bef85d07e)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:26.822535 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a78bb-b283-488e-9d30-94b1117790f7 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:26.868540 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-b37a78bb-b283-488e-9d30-94b1117790f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21c6f3360f57407d9e53b84bef85d07e', 'request_id': 'req-b37a78bb-b283-488e-9d30-94b1117790f7'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:26.875778 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-b37a78bb-b283-488e-9d30-94b1117790f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21c6f3360f57407d9e53b84bef85d07e', 'request_id': 'req-b37a78bb-b283-488e-9d30-94b1117790f7'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:26.881994 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-b37a78bb-b283-488e-9d30-94b1117790f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21c6f3360f57407d9e53b84bef85d07e', 'request_id': 'req-b37a78bb-b283-488e-9d30-94b1117790f7'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:26.895583 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-b37a78bb-b283-488e-9d30-94b1117790f7 admin admin] The token cache is being invalidate because project 21c6f3360f57407d9e53b84bef85d07e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:21:26.895871 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-b37a78bb-b283-488e-9d30-94b1117790f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:26.896504 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-b37a78bb-b283-488e-9d30-94b1117790f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:26.898288 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 994/1990] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:21:26 2021] DELETE /identity/v3/projects/21c6f3360f57407d9e53b84bef85d07e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:21:26.904320 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a4ab4-1506-4152-a6ed-20fdf6a95a8d None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:26.904843 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a4ab4-1506-4152-a6ed-20fdf6a95a8d None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:26.905134 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a4ab4-1506-4152-a6ed-20fdf6a95a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:26.923285 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-fc1a4ab4-1506-4152-a6ed-20fdf6a95a8d None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:21:26.924530 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-fc1a4ab4-1506-4152-a6ed-20fdf6a95a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:26.983587 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 997/1991] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:21:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:21:26.991567 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb80484-b3b1-45b3-9919-d2bdd33706c1 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:26.991834 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb80484-b3b1-45b3-9919-d2bdd33706c1 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:26.992135 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb80484-b3b1-45b3-9919-d2bdd33706c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:27.010842 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-0eb80484-b3b1-45b3-9919-d2bdd33706c1 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:21:27.012128 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-0eb80484-b3b1-45b3-9919-d2bdd33706c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:27.021520 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 995/1992] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:21:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:21:27.025905 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a4ab4-1506-4152-a6ed-20fdf6a95a8d None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:27.035766 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a4ab4-1506-4152-a6ed-20fdf6a95a8d None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:27.040574 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409e406-2556-496e-8cc9-634ca4e1b2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:27.041261 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409e406-2556-496e-8cc9-634ca4e1b2c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:27.041544 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409e406-2556-496e-8cc9-634ca4e1b2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:27.041818 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409e406-2556-496e-8cc9-634ca4e1b2c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:27.042564 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c409e406-2556-496e-8cc9-634ca4e1b2c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:21:27.042885 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c409e406-2556-496e-8cc9-634ca4e1b2c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:27.044494 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c409e406-2556-496e-8cc9-634ca4e1b2c8 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:27.056149 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 998/1993] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:21:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:21:27.060477 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb80484-b3b1-45b3-9919-d2bdd33706c1 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:27.070042 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb80484-b3b1-45b3-9919-d2bdd33706c1 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:27.077119 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1359b9-5d78-43f4-8e78-9ad4a8fa7032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:27.077827 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1359b9-5d78-43f4-8e78-9ad4a8fa7032 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:27.078106 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1359b9-5d78-43f4-8e78-9ad4a8fa7032 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:27.078378 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1359b9-5d78-43f4-8e78-9ad4a8fa7032 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:27.079126 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1359b9-5d78-43f4-8e78-9ad4a8fa7032 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:27.081074 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1359b9-5d78-43f4-8e78-9ad4a8fa7032 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:27.109586 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 996/1994] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:21:27 2021] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:21:27.115374 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409e406-2556-496e-8cc9-634ca4e1b2c8 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:27.125901 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409e406-2556-496e-8cc9-634ca4e1b2c8 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:27.183611 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195742d-25ed-44e5-999d-89110b9e7bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:27.184295 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195742d-25ed-44e5-999d-89110b9e7bd3 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:27.184595 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195742d-25ed-44e5-999d-89110b9e7bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:27.184854 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195742d-25ed-44e5-999d-89110b9e7bd3 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:27.185619 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195742d-25ed-44e5-999d-89110b9e7bd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:27.187645 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195742d-25ed-44e5-999d-89110b9e7bd3 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:27.213036 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 999/1995] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:21:27 2021] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 29 20:21:27.216894 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1359b9-5d78-43f4-8e78-9ad4a8fa7032 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:27.228455 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1359b9-5d78-43f4-8e78-9ad4a8fa7032 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:27.234237 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6dabde-9f3d-4f3d-90d9-c1df0aaba6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:27.234835 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6dabde-9f3d-4f3d-90d9-c1df0aaba6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:27.235151 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6dabde-9f3d-4f3d-90d9-c1df0aaba6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:27.235422 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6dabde-9f3d-4f3d-90d9-c1df0aaba6a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:27.236199 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6dabde-9f3d-4f3d-90d9-c1df0aaba6a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:27.237814 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6dabde-9f3d-4f3d-90d9-c1df0aaba6a3 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:27.248373 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 997/1996] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:21:27 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:21:27.252427 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195742d-25ed-44e5-999d-89110b9e7bd3 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:27.263138 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195742d-25ed-44e5-999d-89110b9e7bd3 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:27.272129 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8287028-bad4-427b-96b2-8a6cfd0ac979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:27.273113 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8287028-bad4-427b-96b2-8a6cfd0ac979 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:27.273113 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8287028-bad4-427b-96b2-8a6cfd0ac979 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:27.273711 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8287028-bad4-427b-96b2-8a6cfd0ac979 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:27.274178 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8287028-bad4-427b-96b2-8a6cfd0ac979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:27.276328 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8287028-bad4-427b-96b2-8a6cfd0ac979 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:27.287257 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1000/1997] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:21:27 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 29 20:21:27.291575 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6dabde-9f3d-4f3d-90d9-c1df0aaba6a3 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:27.301984 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6dabde-9f3d-4f3d-90d9-c1df0aaba6a3 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:27.307543 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098f6ab-20a4-4444-bbcf-862dfdd87674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:27.308473 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098f6ab-20a4-4444-bbcf-862dfdd87674 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:27.308720 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098f6ab-20a4-4444-bbcf-862dfdd87674 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:27.308987 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098f6ab-20a4-4444-bbcf-862dfdd87674 admin admin] PATH_INFO: `/v3/projects/770eb21f0c934209b158d0b9f0cd9337/users/8d19eb79ca084c18acd5f645874cc197/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:27.323720 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b098f6ab-20a4-4444-bbcf-862dfdd87674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=770eb21f0c934209b158d0b9f0cd9337, user_id=8d19eb79ca084c18acd5f645874cc197, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:27.326353 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b098f6ab-20a4-4444-bbcf-862dfdd87674 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:27.340856 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 998/1998] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:21:27 2021] PUT /identity/v3/projects/770eb21f0c934209b158d0b9f0cd9337/users/8d19eb79ca084c18acd5f645874cc197/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:21:27.351866 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfefae-d04d-4175-b791-cecdaaa52aa3 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:27.352151 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfefae-d04d-4175-b791-cecdaaa52aa3 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:27.352425 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cfefae-d04d-4175-b791-cecdaaa52aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:27.378898 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-39cfefae-d04d-4175-b791-cecdaaa52aa3 None None] MFA Rules not processed for user `8d19eb79ca084c18acd5f645874cc197`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:21:27.380172 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-39cfefae-d04d-4175-b791-cecdaaa52aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:27.452000 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1001/1999] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:21:27 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:21:27.461985 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098f6ab-20a4-4444-bbcf-862dfdd87674 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:27.463897 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-b098f6ab-20a4-4444-bbcf-862dfdd87674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:27.524484 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098f6ab-20a4-4444-bbcf-862dfdd87674 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:27.528281 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e5542-6473-49a2-a40a-a4e799fd776d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:27.528931 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e5542-6473-49a2-a40a-a4e799fd776d service cinder] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:27.529207 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e5542-6473-49a2-a40a-a4e799fd776d service cinder] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:27.529475 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e5542-6473-49a2-a40a-a4e799fd776d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:27.537919 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3e5542-6473-49a2-a40a-a4e799fd776d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:27.539381 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3e5542-6473-49a2-a40a-a4e799fd776d service cinder] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:27.548433 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 999/2000] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:21:27 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:21:34.877755 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cfefae-d04d-4175-b791-cecdaaa52aa3 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:34.880177 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-39cfefae-d04d-4175-b791-cecdaaa52aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:34.945803 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cfefae-d04d-4175-b791-cecdaaa52aa3 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:34.950555 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c55ce-7d70-4fdd-8e12-695248073f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:34.952064 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c55ce-7d70-4fdd-8e12-695248073f58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:34.952330 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c55ce-7d70-4fdd-8e12-695248073f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:34.952608 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36c55ce-7d70-4fdd-8e12-695248073f58 admin admin] PATH_INFO: `/v3/users/8dc249f525ac4b74a033158838bd2257` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:34.953984 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c55ce-7d70-4fdd-8e12-695248073f58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dc249f525ac4b74a033158838bd2257)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:34.956001 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36c55ce-7d70-4fdd-8e12-695248073f58 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:35.006554 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-d36c55ce-7d70-4fdd-8e12-695248073f58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dc249f525ac4b74a033158838bd2257'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:35.013392 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-d36c55ce-7d70-4fdd-8e12-695248073f58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dc249f525ac4b74a033158838bd2257'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:35.021640 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-d36c55ce-7d70-4fdd-8e12-695248073f58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dc249f525ac4b74a033158838bd2257'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:35.034502 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-d36c55ce-7d70-4fdd-8e12-695248073f58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dc249f525ac4b74a033158838bd2257'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:35.035275 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-d36c55ce-7d70-4fdd-8e12-695248073f58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dc249f525ac4b74a033158838bd2257'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:35.041467 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1002/2001] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:21:34 2021] DELETE /identity/v3/users/8dc249f525ac4b74a033158838bd2257 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:21:35.046167 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbaae2-e428-4150-98e8-1c61c146241c None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:35.046704 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbaae2-e428-4150-98e8-1c61c146241c None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:35.046704 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbaae2-e428-4150-98e8-1c61c146241c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:35.064885 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-33dbaae2-e428-4150-98e8-1c61c146241c None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:21:35.066209 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-33dbaae2-e428-4150-98e8-1c61c146241c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:35.126501 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1000/2002] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:21:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:21:35.136955 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c55ce-7d70-4fdd-8e12-695248073f58 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:35.138583 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-d36c55ce-7d70-4fdd-8e12-695248073f58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:35.204544 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36c55ce-7d70-4fdd-8e12-695248073f58 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:35.208954 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef0fdb-5147-4dfb-a732-93329cacafeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:35.210291 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef0fdb-5147-4dfb-a732-93329cacafeb service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:35.210765 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef0fdb-5147-4dfb-a732-93329cacafeb service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:35.211343 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef0fdb-5147-4dfb-a732-93329cacafeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:35.225607 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ef0fdb-5147-4dfb-a732-93329cacafeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:35.227376 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ef0fdb-5147-4dfb-a732-93329cacafeb service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:35.237389 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1003/2003] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:21:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:21:35.538022 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbaae2-e428-4150-98e8-1c61c146241c None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:35.539635 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-33dbaae2-e428-4150-98e8-1c61c146241c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:35.553068 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbaae2-e428-4150-98e8-1c61c146241c None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:35.558981 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669192a-9d16-4d81-be93-1acbd0fe7bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:35.559868 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669192a-9d16-4d81-be93-1acbd0fe7bf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:35.560149 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669192a-9d16-4d81-be93-1acbd0fe7bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:35.560425 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669192a-9d16-4d81-be93-1acbd0fe7bf5 admin admin] PATH_INFO: `/v3/projects/a78ec33eb7764617864b019f22ae49f6` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:35.561745 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669192a-9d16-4d81-be93-1acbd0fe7bf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a78ec33eb7764617864b019f22ae49f6)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:35.564089 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669192a-9d16-4d81-be93-1acbd0fe7bf5 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:35.613184 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-4669192a-9d16-4d81-be93-1acbd0fe7bf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a78ec33eb7764617864b019f22ae49f6', 'request_id': 'req-4669192a-9d16-4d81-be93-1acbd0fe7bf5'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:35.619637 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-4669192a-9d16-4d81-be93-1acbd0fe7bf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a78ec33eb7764617864b019f22ae49f6', 'request_id': 'req-4669192a-9d16-4d81-be93-1acbd0fe7bf5'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:35.625711 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-4669192a-9d16-4d81-be93-1acbd0fe7bf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a78ec33eb7764617864b019f22ae49f6', 'request_id': 'req-4669192a-9d16-4d81-be93-1acbd0fe7bf5'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:35.639771 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-4669192a-9d16-4d81-be93-1acbd0fe7bf5 admin admin] The token cache is being invalidate because project a78ec33eb7764617864b019f22ae49f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:21:35.640061 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-4669192a-9d16-4d81-be93-1acbd0fe7bf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:35.640702 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-4669192a-9d16-4d81-be93-1acbd0fe7bf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:35.642419 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1001/2004] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:21:35 2021] DELETE /identity/v3/projects/a78ec33eb7764617864b019f22ae49f6 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:21:35.646720 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef0fdb-5147-4dfb-a732-93329cacafeb service neutron] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:35.657251 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef0fdb-5147-4dfb-a732-93329cacafeb service neutron] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:35.726800 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83a0114-8e18-4968-aa8c-a21123e56ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:35.727916 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a0114-8e18-4968-aa8c-a21123e56ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:35.728200 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a0114-8e18-4968-aa8c-a21123e56ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:35.728474 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a0114-8e18-4968-aa8c-a21123e56ffb admin admin] PATH_INFO: `/v3/users/2950f7b85e4c4ac2bd4795428a6af60a` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:35.730558 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83a0114-8e18-4968-aa8c-a21123e56ffb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2950f7b85e4c4ac2bd4795428a6af60a)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:35.732509 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83a0114-8e18-4968-aa8c-a21123e56ffb admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:35.788297 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-e83a0114-8e18-4968-aa8c-a21123e56ffb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2950f7b85e4c4ac2bd4795428a6af60a'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:35.795575 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-e83a0114-8e18-4968-aa8c-a21123e56ffb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2950f7b85e4c4ac2bd4795428a6af60a'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:35.805191 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-e83a0114-8e18-4968-aa8c-a21123e56ffb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2950f7b85e4c4ac2bd4795428a6af60a'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:35.820242 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-e83a0114-8e18-4968-aa8c-a21123e56ffb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2950f7b85e4c4ac2bd4795428a6af60a'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:35.821012 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-e83a0114-8e18-4968-aa8c-a21123e56ffb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2950f7b85e4c4ac2bd4795428a6af60a'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:35.827694 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1004/2005] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:21:35 2021] DELETE /identity/v3/users/2950f7b85e4c4ac2bd4795428a6af60a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:21:36.139683 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669192a-9d16-4d81-be93-1acbd0fe7bf5 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:36.141441 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-4669192a-9d16-4d81-be93-1acbd0fe7bf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:36.157360 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669192a-9d16-4d81-be93-1acbd0fe7bf5 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:36.215109 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aad86f-e9e0-48c0-a06c-1a2eb01d6a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:36.215981 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aad86f-e9e0-48c0-a06c-1a2eb01d6a5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:36.216394 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aad86f-e9e0-48c0-a06c-1a2eb01d6a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:36.216686 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aad86f-e9e0-48c0-a06c-1a2eb01d6a5d admin admin] PATH_INFO: `/v3/projects/d3c399b606864aa384e23e3b35f9ecc3` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:36.217896 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aad86f-e9e0-48c0-a06c-1a2eb01d6a5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3c399b606864aa384e23e3b35f9ecc3)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:36.219864 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aad86f-e9e0-48c0-a06c-1a2eb01d6a5d admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:36.270890 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-b1aad86f-e9e0-48c0-a06c-1a2eb01d6a5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3c399b606864aa384e23e3b35f9ecc3', 'request_id': 'req-b1aad86f-e9e0-48c0-a06c-1a2eb01d6a5d'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:36.276874 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-b1aad86f-e9e0-48c0-a06c-1a2eb01d6a5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3c399b606864aa384e23e3b35f9ecc3', 'request_id': 'req-b1aad86f-e9e0-48c0-a06c-1a2eb01d6a5d'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:36.282062 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-b1aad86f-e9e0-48c0-a06c-1a2eb01d6a5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3c399b606864aa384e23e3b35f9ecc3', 'request_id': 'req-b1aad86f-e9e0-48c0-a06c-1a2eb01d6a5d'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:36.295850 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-b1aad86f-e9e0-48c0-a06c-1a2eb01d6a5d admin admin] The token cache is being invalidate because project d3c399b606864aa384e23e3b35f9ecc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:21:36.296138 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-b1aad86f-e9e0-48c0-a06c-1a2eb01d6a5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:36.296804 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-b1aad86f-e9e0-48c0-a06c-1a2eb01d6a5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:36.298454 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1002/2006] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:21:36 2021] DELETE /identity/v3/projects/d3c399b606864aa384e23e3b35f9ecc3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:21:36.305501 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a7a9a-246e-47d1-a38c-5da4efc688b3 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:36.305967 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a7a9a-246e-47d1-a38c-5da4efc688b3 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:36.306237 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7a7a9a-246e-47d1-a38c-5da4efc688b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:36.325100 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-ea7a7a9a-246e-47d1-a38c-5da4efc688b3 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:21:36.326289 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-ea7a7a9a-246e-47d1-a38c-5da4efc688b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:36.385966 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1005/2007] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:21:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:21:36.394523 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3938e1-1d62-4440-acac-917b1a176562 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:36.394770 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3938e1-1d62-4440-acac-917b1a176562 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:36.395101 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3938e1-1d62-4440-acac-917b1a176562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:36.418191 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-7a3938e1-1d62-4440-acac-917b1a176562 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:21:36.419501 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-7a3938e1-1d62-4440-acac-917b1a176562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:36.429778 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1003/2008] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:21:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:21:36.434148 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a7a9a-246e-47d1-a38c-5da4efc688b3 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:36.444898 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7a7a9a-246e-47d1-a38c-5da4efc688b3 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:36.450209 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e136908-3483-4a31-bca8-15ecdef29643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:36.451108 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e136908-3483-4a31-bca8-15ecdef29643 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:36.451391 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e136908-3483-4a31-bca8-15ecdef29643 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:36.451664 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e136908-3483-4a31-bca8-15ecdef29643 admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:36.452416 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e136908-3483-4a31-bca8-15ecdef29643 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:21:36.452722 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e136908-3483-4a31-bca8-15ecdef29643 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:36.454454 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e136908-3483-4a31-bca8-15ecdef29643 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:36.467642 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1006/2009] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:21:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:21:36.472140 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3938e1-1d62-4440-acac-917b1a176562 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:36.481648 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3938e1-1d62-4440-acac-917b1a176562 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:36.486571 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c9ee1d-fd6d-44cd-a88f-4cd22c722dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:36.487255 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9ee1d-fd6d-44cd-a88f-4cd22c722dc8 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:36.487536 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9ee1d-fd6d-44cd-a88f-4cd22c722dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:36.487812 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9ee1d-fd6d-44cd-a88f-4cd22c722dc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:36.488547 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c9ee1d-fd6d-44cd-a88f-4cd22c722dc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:36.490453 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c9ee1d-fd6d-44cd-a88f-4cd22c722dc8 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:36.517958 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1004/2010] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:21:36 2021] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:21:36.522775 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e136908-3483-4a31-bca8-15ecdef29643 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:36.532716 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e136908-3483-4a31-bca8-15ecdef29643 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:36.591947 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140b83c-067e-439d-a6ad-36dce6ecdef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:36.592620 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140b83c-067e-439d-a6ad-36dce6ecdef1 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:36.592894 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140b83c-067e-439d-a6ad-36dce6ecdef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:36.593169 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140b83c-067e-439d-a6ad-36dce6ecdef1 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:36.593894 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d140b83c-067e-439d-a6ad-36dce6ecdef1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:36.595919 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d140b83c-067e-439d-a6ad-36dce6ecdef1 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:36.622771 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1007/2011] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:21:36 2021] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:21:36.624421 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c9ee1d-fd6d-44cd-a88f-4cd22c722dc8 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:36.635233 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c9ee1d-fd6d-44cd-a88f-4cd22c722dc8 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:36.640780 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375f12a-37bc-4419-8c05-26e4bf0596f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:36.641434 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375f12a-37bc-4419-8c05-26e4bf0596f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:36.641702 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375f12a-37bc-4419-8c05-26e4bf0596f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:36.641938 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375f12a-37bc-4419-8c05-26e4bf0596f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:36.642663 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b375f12a-37bc-4419-8c05-26e4bf0596f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:36.644651 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b375f12a-37bc-4419-8c05-26e4bf0596f0 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:36.655155 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1005/2012] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:21:36 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:21:36.659480 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140b83c-067e-439d-a6ad-36dce6ecdef1 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:36.669857 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140b83c-067e-439d-a6ad-36dce6ecdef1 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:36.675947 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215649fe-32f1-4be3-9f68-b9cdac71be32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:36.676604 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215649fe-32f1-4be3-9f68-b9cdac71be32 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:36.676883 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215649fe-32f1-4be3-9f68-b9cdac71be32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:36.677155 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215649fe-32f1-4be3-9f68-b9cdac71be32 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:36.677890 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215649fe-32f1-4be3-9f68-b9cdac71be32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:36.679525 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215649fe-32f1-4be3-9f68-b9cdac71be32 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:36.689906 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1008/2013] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:21:36 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:21:36.694742 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375f12a-37bc-4419-8c05-26e4bf0596f0 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:36.709983 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375f12a-37bc-4419-8c05-26e4bf0596f0 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:36.715720 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656a9bb-6b74-4be2-a61c-a004ac3c539b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:36.716609 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656a9bb-6b74-4be2-a61c-a004ac3c539b admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:36.716847 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656a9bb-6b74-4be2-a61c-a004ac3c539b admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:36.717152 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656a9bb-6b74-4be2-a61c-a004ac3c539b admin admin] PATH_INFO: `/v3/projects/f0df881498cb4d6b9c5e215ac6888720/users/e398d8224a6646fdab1614e877cba66f/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:36.733334 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656a9bb-6b74-4be2-a61c-a004ac3c539b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0df881498cb4d6b9c5e215ac6888720, user_id=e398d8224a6646fdab1614e877cba66f, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:36.735956 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7656a9bb-6b74-4be2-a61c-a004ac3c539b admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:36.750413 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1006/2014] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:21:36 2021] PUT /identity/v3/projects/f0df881498cb4d6b9c5e215ac6888720/users/e398d8224a6646fdab1614e877cba66f/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:21:36.761206 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec86e9-1efe-4a6a-a8ad-4ea190d0dbb4 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:36.761580 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec86e9-1efe-4a6a-a8ad-4ea190d0dbb4 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:36.761922 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec86e9-1efe-4a6a-a8ad-4ea190d0dbb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:36.789541 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-47ec86e9-1efe-4a6a-a8ad-4ea190d0dbb4 None None] MFA Rules not processed for user `e398d8224a6646fdab1614e877cba66f`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:21:36.790759 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-47ec86e9-1efe-4a6a-a8ad-4ea190d0dbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:36.863184 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1009/2015] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:21:36 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:21:36.867967 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656a9bb-6b74-4be2-a61c-a004ac3c539b admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:36.932243 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656a9bb-6b74-4be2-a61c-a004ac3c539b admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:36.937353 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762c2f4-20db-4f82-a52c-1abd9c9ef569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:36.938061 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762c2f4-20db-4f82-a52c-1abd9c9ef569 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:36.938379 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762c2f4-20db-4f82-a52c-1abd9c9ef569 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:36.938657 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762c2f4-20db-4f82-a52c-1abd9c9ef569 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:36.939910 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e762c2f4-20db-4f82-a52c-1abd9c9ef569 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:36.941829 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e762c2f4-20db-4f82-a52c-1abd9c9ef569 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:36.969192 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1007/2016] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:21:36 2021] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:21:36.973459 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec86e9-1efe-4a6a-a8ad-4ea190d0dbb4 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:36.984144 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec86e9-1efe-4a6a-a8ad-4ea190d0dbb4 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:37.016992 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762c2f4-20db-4f82-a52c-1abd9c9ef569 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:37.019152 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-e762c2f4-20db-4f82-a52c-1abd9c9ef569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:37.042406 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5eb60-2fc0-4729-b4e9-5d0072ce99d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:37.043118 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5eb60-2fc0-4729-b4e9-5d0072ce99d8 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:37.043429 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5eb60-2fc0-4729-b4e9-5d0072ce99d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:37.043701 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5eb60-2fc0-4729-b4e9-5d0072ce99d8 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:37.044446 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b5eb60-2fc0-4729-b4e9-5d0072ce99d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:37.046394 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b5eb60-2fc0-4729-b4e9-5d0072ce99d8 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:37.069174 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1010/2017] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:21:36 2021] POST /identity/v3/users => generated 297 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:21:37.073135 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5eb60-2fc0-4729-b4e9-5d0072ce99d8 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:37.083447 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5eb60-2fc0-4729-b4e9-5d0072ce99d8 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:37.088612 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3fd1df-b7f2-4282-9751-5de7711096b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:37.089277 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3fd1df-b7f2-4282-9751-5de7711096b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:37.089569 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3fd1df-b7f2-4282-9751-5de7711096b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:37.089681 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762c2f4-20db-4f82-a52c-1abd9c9ef569 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:37.089848 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3fd1df-b7f2-4282-9751-5de7711096b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:37.090679 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3fd1df-b7f2-4282-9751-5de7711096b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:37.092492 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3fd1df-b7f2-4282-9751-5de7711096b8 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:37.097680 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feaaedc-266e-40f5-b831-2c580adcebfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:37.098914 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feaaedc-266e-40f5-b831-2c580adcebfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:37.099027 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feaaedc-266e-40f5-b831-2c580adcebfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:37.099226 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feaaedc-266e-40f5-b831-2c580adcebfa admin admin] PATH_INFO: `/v3/users/8d19eb79ca084c18acd5f645874cc197` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:37.100608 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feaaedc-266e-40f5-b831-2c580adcebfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d19eb79ca084c18acd5f645874cc197)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:37.102764 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feaaedc-266e-40f5-b831-2c580adcebfa admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:37.103800 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1011/2018] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:21:37 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:21:37.107718 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3fd1df-b7f2-4282-9751-5de7711096b8 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:37.118090 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3fd1df-b7f2-4282-9751-5de7711096b8 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:37.122791 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67fd37-52a5-443a-b043-8432bca2a8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:37.123708 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67fd37-52a5-443a-b043-8432bca2a8bb admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:37.123992 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67fd37-52a5-443a-b043-8432bca2a8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:37.124271 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f67fd37-52a5-443a-b043-8432bca2a8bb admin admin] PATH_INFO: `/v3/projects/214e64aeab3e4cabbff6671f939417b4/users/4d54d0f0d2ef45eca6b78bf49e5bd6f0/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:37.141954 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67fd37-52a5-443a-b043-8432bca2a8bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=214e64aeab3e4cabbff6671f939417b4, user_id=4d54d0f0d2ef45eca6b78bf49e5bd6f0, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:37.145193 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f67fd37-52a5-443a-b043-8432bca2a8bb admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:37.153935 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-9feaaedc-266e-40f5-b831-2c580adcebfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d19eb79ca084c18acd5f645874cc197'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:37.161221 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1012/2019] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:21:37 2021] PUT /identity/v3/projects/214e64aeab3e4cabbff6671f939417b4/users/4d54d0f0d2ef45eca6b78bf49e5bd6f0/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:21:37.164428 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-9feaaedc-266e-40f5-b831-2c580adcebfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d19eb79ca084c18acd5f645874cc197'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:37.165531 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67fd37-52a5-443a-b043-8432bca2a8bb admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:37.176220 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-9feaaedc-266e-40f5-b831-2c580adcebfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d19eb79ca084c18acd5f645874cc197'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:37.177209 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-9feaaedc-266e-40f5-b831-2c580adcebfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d19eb79ca084c18acd5f645874cc197'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:37.177879 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-9feaaedc-266e-40f5-b831-2c580adcebfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d19eb79ca084c18acd5f645874cc197'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:37.198949 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1008/2020] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:21:37 2021] DELETE /identity/v3/users/8d19eb79ca084c18acd5f645874cc197 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:21:37.203399 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ed086-e1a6-4958-a0d8-0ab554eea034 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:37.203886 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ed086-e1a6-4958-a0d8-0ab554eea034 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:37.204463 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ed086-e1a6-4958-a0d8-0ab554eea034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:37.221938 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-128ed086-e1a6-4958-a0d8-0ab554eea034 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:21:37.223228 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-128ed086-e1a6-4958-a0d8-0ab554eea034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:37.238529 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f67fd37-52a5-443a-b043-8432bca2a8bb admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:37.286156 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1009/2021] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:21:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:21:37.297688 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ed086-e1a6-4958-a0d8-0ab554eea034 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:37.299282 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-128ed086-e1a6-4958-a0d8-0ab554eea034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:37.316761 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a6c5c-1a56-48af-8715-40dc6f5516b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:37.317442 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a6c5c-1a56-48af-8715-40dc6f5516b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:37.317723 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a6c5c-1a56-48af-8715-40dc6f5516b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:37.317997 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a6c5c-1a56-48af-8715-40dc6f5516b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:37.318745 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3a6c5c-1a56-48af-8715-40dc6f5516b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:37.322898 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3a6c5c-1a56-48af-8715-40dc6f5516b8 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:37.336868 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1013/2022] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:21:37 2021] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:21:37.337926 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a6c5c-1a56-48af-8715-40dc6f5516b8 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:37.339683 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-4b3a6c5c-1a56-48af-8715-40dc6f5516b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:37.351689 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a6c5c-1a56-48af-8715-40dc6f5516b8 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:37.356497 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74643f03-76e2-4188-baa8-ff3ec3c672ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:37.356929 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ed086-e1a6-4958-a0d8-0ab554eea034 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:37.357380 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74643f03-76e2-4188-baa8-ff3ec3c672ce admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:37.357657 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74643f03-76e2-4188-baa8-ff3ec3c672ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:37.357929 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74643f03-76e2-4188-baa8-ff3ec3c672ce admin admin] PATH_INFO: `/v3/projects/214e64aeab3e4cabbff6671f939417b4/users/4d54d0f0d2ef45eca6b78bf49e5bd6f0/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:37.359938 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74643f03-76e2-4188-baa8-ff3ec3c672ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=214e64aeab3e4cabbff6671f939417b4, user_id=4d54d0f0d2ef45eca6b78bf49e5bd6f0, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:37.360610 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8bc834-ef59-45c2-9af9-346d159a5a9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:37.361251 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bc834-ef59-45c2-9af9-346d159a5a9f service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:37.361529 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bc834-ef59-45c2-9af9-346d159a5a9f service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:37.361801 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8bc834-ef59-45c2-9af9-346d159a5a9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:37.362692 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74643f03-76e2-4188-baa8-ff3ec3c672ce admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:37.371445 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8bc834-ef59-45c2-9af9-346d159a5a9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:37.373058 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8bc834-ef59-45c2-9af9-346d159a5a9f service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:37.378138 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1014/2023] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:21:37 2021] PUT /identity/v3/projects/214e64aeab3e4cabbff6671f939417b4/users/4d54d0f0d2ef45eca6b78bf49e5bd6f0/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:21:37.383527 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1010/2024] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:21:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 29 20:21:37.389338 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d676df-db61-454f-8fc6-1dc3120e783e None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:37.389629 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d676df-db61-454f-8fc6-1dc3120e783e None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:37.389908 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d676df-db61-454f-8fc6-1dc3120e783e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:37.416344 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-a0d676df-db61-454f-8fc6-1dc3120e783e None None] MFA Rules not processed for user `4d54d0f0d2ef45eca6b78bf49e5bd6f0`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:21:37.417572 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-a0d676df-db61-454f-8fc6-1dc3120e783e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:37.501650 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1015/2025] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:21:37 2021] POST /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:21:37.508229 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8bc834-ef59-45c2-9af9-346d159a5a9f service neutron] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:37.518964 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8bc834-ef59-45c2-9af9-346d159a5a9f service neutron] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:37.580314 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089a291-d259-455f-8289-dce8afca0711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:37.581201 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089a291-d259-455f-8289-dce8afca0711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:37.581524 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089a291-d259-455f-8289-dce8afca0711 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:37.581799 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089a291-d259-455f-8289-dce8afca0711 admin admin] PATH_INFO: `/v3/users/e398d8224a6646fdab1614e877cba66f` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:37.583060 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1089a291-d259-455f-8289-dce8afca0711 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e398d8224a6646fdab1614e877cba66f)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:37.585042 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1089a291-d259-455f-8289-dce8afca0711 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:37.631949 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-1089a291-d259-455f-8289-dce8afca0711 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e398d8224a6646fdab1614e877cba66f'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:37.638564 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-1089a291-d259-455f-8289-dce8afca0711 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e398d8224a6646fdab1614e877cba66f'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:37.650951 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-1089a291-d259-455f-8289-dce8afca0711 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e398d8224a6646fdab1614e877cba66f'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:37.651412 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-1089a291-d259-455f-8289-dce8afca0711 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e398d8224a6646fdab1614e877cba66f'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:37.652047 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-1089a291-d259-455f-8289-dce8afca0711 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e398d8224a6646fdab1614e877cba66f'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:37.654367 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d676df-db61-454f-8fc6-1dc3120e783e None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:37.655820 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-a0d676df-db61-454f-8fc6-1dc3120e783e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:37.670089 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1011/2026] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:21:37 2021] DELETE /identity/v3/users/e398d8224a6646fdab1614e877cba66f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:21:37.675121 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7657de-432a-46fb-be47-184244a3f420 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:37.675449 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7657de-432a-46fb-be47-184244a3f420 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:37.675684 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7657de-432a-46fb-be47-184244a3f420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:37.680289 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d676df-db61-454f-8fc6-1dc3120e783e None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:37.695333 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-2b7657de-432a-46fb-be47-184244a3f420 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:21:37.696549 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-2b7657de-432a-46fb-be47-184244a3f420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:37.737177 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62e73f-d4a3-4e42-8662-ebe065d4e21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:37.738053 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62e73f-d4a3-4e42-8662-ebe065d4e21a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:37.738338 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62e73f-d4a3-4e42-8662-ebe065d4e21a admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:37.738674 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62e73f-d4a3-4e42-8662-ebe065d4e21a admin admin] PATH_INFO: `/v3/projects/770eb21f0c934209b158d0b9f0cd9337` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:37.740048 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f62e73f-d4a3-4e42-8662-ebe065d4e21a admin admin] RBAC: Authorizing `identity:delete_project(project_id=770eb21f0c934209b158d0b9f0cd9337)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:37.742268 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f62e73f-d4a3-4e42-8662-ebe065d4e21a admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:37.757987 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1012/2027] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:21:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:21:37.768014 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7657de-432a-46fb-be47-184244a3f420 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:37.770008 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-2b7657de-432a-46fb-be47-184244a3f420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:37.798504 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-0f62e73f-d4a3-4e42-8662-ebe065d4e21a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '770eb21f0c934209b158d0b9f0cd9337', 'request_id': 'req-0f62e73f-d4a3-4e42-8662-ebe065d4e21a'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:37.817438 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-0f62e73f-d4a3-4e42-8662-ebe065d4e21a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '770eb21f0c934209b158d0b9f0cd9337', 'request_id': 'req-0f62e73f-d4a3-4e42-8662-ebe065d4e21a'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:37.830537 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7657de-432a-46fb-be47-184244a3f420 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:37.832026 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-0f62e73f-d4a3-4e42-8662-ebe065d4e21a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '770eb21f0c934209b158d0b9f0cd9337', 'request_id': 'req-0f62e73f-d4a3-4e42-8662-ebe065d4e21a'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:37.842981 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-0f62e73f-d4a3-4e42-8662-ebe065d4e21a admin admin] The token cache is being invalidate because project 770eb21f0c934209b158d0b9f0cd9337 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:21:37.843317 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-0f62e73f-d4a3-4e42-8662-ebe065d4e21a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:37.843954 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-0f62e73f-d4a3-4e42-8662-ebe065d4e21a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:37.845584 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1016/2028] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:21:37 2021] DELETE /identity/v3/projects/770eb21f0c934209b158d0b9f0cd9337 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:21:37.851234 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16886f45-0e86-4b09-8343-10f88641847d None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:37.851524 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16886f45-0e86-4b09-8343-10f88641847d None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:37.851806 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16886f45-0e86-4b09-8343-10f88641847d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:37.869488 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-16886f45-0e86-4b09-8343-10f88641847d None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:21:37.872287 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-16886f45-0e86-4b09-8343-10f88641847d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:37.880523 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1da28-28a6-4eed-9e5b-ad751a383c07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:37.881197 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1da28-28a6-4eed-9e5b-ad751a383c07 service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:37.881480 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1da28-28a6-4eed-9e5b-ad751a383c07 service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:37.881785 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1da28-28a6-4eed-9e5b-ad751a383c07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:37.884138 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-0ea1da28-28a6-4eed-9e5b-ad751a383c07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:37.931671 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1017/2029] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:21:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:21:37.939762 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68e369-dcf2-49e6-8bf9-11bf562c9217 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:37.940049 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68e369-dcf2-49e6-8bf9-11bf562c9217 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:37.940321 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68e369-dcf2-49e6-8bf9-11bf562c9217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:37.945840 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea1da28-28a6-4eed-9e5b-ad751a383c07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:37.947628 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea1da28-28a6-4eed-9e5b-ad751a383c07 service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:37.957815 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1013/2030] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:21:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:21:37.963954 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-4f68e369-dcf2-49e6-8bf9-11bf562c9217 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:21:37.965199 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-4f68e369-dcf2-49e6-8bf9-11bf562c9217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:37.973869 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1018/2031] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:21:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:21:37.978036 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1da28-28a6-4eed-9e5b-ad751a383c07 service neutron] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:37.987421 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1da28-28a6-4eed-9e5b-ad751a383c07 service neutron] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:37.993295 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1d83a-7c38-4629-ac7d-be0917a3a03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:37.993956 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1d83a-7c38-4629-ac7d-be0917a3a03c admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:37.994236 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1d83a-7c38-4629-ac7d-be0917a3a03c admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:37.994510 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1d83a-7c38-4629-ac7d-be0917a3a03c admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:37.995283 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a1d83a-7c38-4629-ac7d-be0917a3a03c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:21:37.995589 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a1d83a-7c38-4629-ac7d-be0917a3a03c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:37.997189 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a1d83a-7c38-4629-ac7d-be0917a3a03c admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:38.009646 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1014/2032] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:21:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:21:38.014291 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68e369-dcf2-49e6-8bf9-11bf562c9217 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:38.024682 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68e369-dcf2-49e6-8bf9-11bf562c9217 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:38.043019 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee1327-6b4e-4a45-8052-ee5b234eab32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:38.044735 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee1327-6b4e-4a45-8052-ee5b234eab32 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:38.045218 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee1327-6b4e-4a45-8052-ee5b234eab32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:38.046020 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee1327-6b4e-4a45-8052-ee5b234eab32 admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:38.046563 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee1327-6b4e-4a45-8052-ee5b234eab32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:38.049237 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee1327-6b4e-4a45-8052-ee5b234eab32 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:38.089260 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1019/2033] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:21:38 2021] POST /identity/v3/projects => generated 375 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:21:38.090447 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1d83a-7c38-4629-ac7d-be0917a3a03c admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:38.100420 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1d83a-7c38-4629-ac7d-be0917a3a03c admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:38.163102 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a8cfa-02d4-44d9-938f-14ca3e78f357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:38.163794 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a8cfa-02d4-44d9-938f-14ca3e78f357 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:38.164056 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a8cfa-02d4-44d9-938f-14ca3e78f357 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:38.164327 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702a8cfa-02d4-44d9-938f-14ca3e78f357 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:38.165043 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702a8cfa-02d4-44d9-938f-14ca3e78f357 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:38.167036 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702a8cfa-02d4-44d9-938f-14ca3e78f357 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:38.188466 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1015/2034] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:21:38 2021] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 29 20:21:38.192626 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee1327-6b4e-4a45-8052-ee5b234eab32 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:38.208692 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee1327-6b4e-4a45-8052-ee5b234eab32 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:38.213496 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d3079-9a40-4f95-a3ff-23ed93119646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:38.214188 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d3079-9a40-4f95-a3ff-23ed93119646 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:38.214465 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d3079-9a40-4f95-a3ff-23ed93119646 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:38.214736 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d3079-9a40-4f95-a3ff-23ed93119646 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:38.215516 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d3079-9a40-4f95-a3ff-23ed93119646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:38.217105 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d3079-9a40-4f95-a3ff-23ed93119646 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:38.227568 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1020/2035] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:21:38 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:21:38.231932 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a8cfa-02d4-44d9-938f-14ca3e78f357 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:38.242227 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702a8cfa-02d4-44d9-938f-14ca3e78f357 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:38.248014 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d598a-1c14-4c27-95e2-df5635ff543c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:38.249125 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d598a-1c14-4c27-95e2-df5635ff543c admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:38.249397 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d598a-1c14-4c27-95e2-df5635ff543c admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:38.249671 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d598a-1c14-4c27-95e2-df5635ff543c admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:38.250417 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17d598a-1c14-4c27-95e2-df5635ff543c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:38.252107 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17d598a-1c14-4c27-95e2-df5635ff543c admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:38.255627 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d3079-9a40-4f95-a3ff-23ed93119646 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:38.257321 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-d51d3079-9a40-4f95-a3ff-23ed93119646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:38.269798 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1016/2036] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:21:38 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:21:38.273665 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d598a-1c14-4c27-95e2-df5635ff543c admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:38.284823 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d3079-9a40-4f95-a3ff-23ed93119646 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:38.285400 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d598a-1c14-4c27-95e2-df5635ff543c admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:38.290829 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b5698-864c-4399-8e64-96bcf346559e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:38.292046 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b5698-864c-4399-8e64-96bcf346559e admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:38.292495 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b5698-864c-4399-8e64-96bcf346559e admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:38.292894 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b5698-864c-4399-8e64-96bcf346559e admin admin] PATH_INFO: `/v3/projects/643f88b7748942d093bdf4af9760721f/users/c30163e06ae34eb7b099b1437cda0300/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:38.307902 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c6dd5-55c5-4961-87b8-cc6976d3d612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:38.309017 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c6dd5-55c5-4961-87b8-cc6976d3d612 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:38.309550 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c6dd5-55c5-4961-87b8-cc6976d3d612 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:38.310037 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b5698-864c-4399-8e64-96bcf346559e admin admin] RBAC: Authorizing `identity:create_grant(project_id=643f88b7748942d093bdf4af9760721f, user_id=c30163e06ae34eb7b099b1437cda0300, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:38.310142 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c6dd5-55c5-4961-87b8-cc6976d3d612 admin admin] PATH_INFO: `/v3/projects/f0df881498cb4d6b9c5e215ac6888720` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:38.311390 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c6dd5-55c5-4961-87b8-cc6976d3d612 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0df881498cb4d6b9c5e215ac6888720)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:38.312841 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b5698-864c-4399-8e64-96bcf346559e admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:38.313498 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c6dd5-55c5-4961-87b8-cc6976d3d612 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:38.339465 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1017/2037] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:21:38 2021] PUT /identity/v3/projects/643f88b7748942d093bdf4af9760721f/users/c30163e06ae34eb7b099b1437cda0300/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:21:38.351000 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79617fc3-8415-428b-88ef-a18405d08e16 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:38.351839 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79617fc3-8415-428b-88ef-a18405d08e16 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:38.352176 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79617fc3-8415-428b-88ef-a18405d08e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:38.396459 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-b90c6dd5-55c5-4961-87b8-cc6976d3d612 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0df881498cb4d6b9c5e215ac6888720', 'request_id': 'req-b90c6dd5-55c5-4961-87b8-cc6976d3d612'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:38.397150 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-79617fc3-8415-428b-88ef-a18405d08e16 None None] MFA Rules not processed for user `c30163e06ae34eb7b099b1437cda0300`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:21:38.398366 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-79617fc3-8415-428b-88ef-a18405d08e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:38.404940 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-b90c6dd5-55c5-4961-87b8-cc6976d3d612 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0df881498cb4d6b9c5e215ac6888720', 'request_id': 'req-b90c6dd5-55c5-4961-87b8-cc6976d3d612'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:38.415940 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-b90c6dd5-55c5-4961-87b8-cc6976d3d612 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0df881498cb4d6b9c5e215ac6888720', 'request_id': 'req-b90c6dd5-55c5-4961-87b8-cc6976d3d612'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:38.430296 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-b90c6dd5-55c5-4961-87b8-cc6976d3d612 admin admin] The token cache is being invalidate because project f0df881498cb4d6b9c5e215ac6888720 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:21:38.430715 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-b90c6dd5-55c5-4961-87b8-cc6976d3d612 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:38.432316 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-b90c6dd5-55c5-4961-87b8-cc6976d3d612 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:38.441037 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1021/2038] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:21:38 2021] DELETE /identity/v3/projects/f0df881498cb4d6b9c5e215ac6888720 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:21:38.445272 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c6dd5-55c5-4961-87b8-cc6976d3d612 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:38.447252 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-b90c6dd5-55c5-4961-87b8-cc6976d3d612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:38.470891 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1018/2039] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:21:38 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:21:38.481246 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79617fc3-8415-428b-88ef-a18405d08e16 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:38.482573 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-79617fc3-8415-428b-88ef-a18405d08e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:38.508287 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c6dd5-55c5-4961-87b8-cc6976d3d612 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:38.512903 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff48aa-b0ab-4a6b-a3b3-fe2df465d8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:38.513720 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff48aa-b0ab-4a6b-a3b3-fe2df465d8ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:38.513992 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff48aa-b0ab-4a6b-a3b3-fe2df465d8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:38.514258 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff48aa-b0ab-4a6b-a3b3-fe2df465d8ba admin admin] PATH_INFO: `/v3/users/4d54d0f0d2ef45eca6b78bf49e5bd6f0` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:38.515472 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff48aa-b0ab-4a6b-a3b3-fe2df465d8ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d54d0f0d2ef45eca6b78bf49e5bd6f0)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:38.517835 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff48aa-b0ab-4a6b-a3b3-fe2df465d8ba admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:38.537402 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79617fc3-8415-428b-88ef-a18405d08e16 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:38.541273 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125b665-7aeb-4b78-9acd-0ac197c89638 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:38.541926 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125b665-7aeb-4b78-9acd-0ac197c89638 service cinder] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:38.542192 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125b665-7aeb-4b78-9acd-0ac197c89638 service cinder] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:38.542464 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125b665-7aeb-4b78-9acd-0ac197c89638 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:38.551907 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5125b665-7aeb-4b78-9acd-0ac197c89638 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:38.553383 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5125b665-7aeb-4b78-9acd-0ac197c89638 service cinder] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:38.562367 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1019/2040] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:21:38 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 29 20:21:38.564823 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-d6ff48aa-b0ab-4a6b-a3b3-fe2df465d8ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d54d0f0d2ef45eca6b78bf49e5bd6f0'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:38.573283 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-d6ff48aa-b0ab-4a6b-a3b3-fe2df465d8ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d54d0f0d2ef45eca6b78bf49e5bd6f0'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:38.581758 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-d6ff48aa-b0ab-4a6b-a3b3-fe2df465d8ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d54d0f0d2ef45eca6b78bf49e5bd6f0'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:38.593382 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-d6ff48aa-b0ab-4a6b-a3b3-fe2df465d8ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d54d0f0d2ef45eca6b78bf49e5bd6f0'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:38.594038 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-d6ff48aa-b0ab-4a6b-a3b3-fe2df465d8ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d54d0f0d2ef45eca6b78bf49e5bd6f0'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:38.599817 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1022/2041] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:21:38 2021] DELETE /identity/v3/users/4d54d0f0d2ef45eca6b78bf49e5bd6f0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:21:38.890314 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125b665-7aeb-4b78-9acd-0ac197c89638 service cinder] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:38.905571 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125b665-7aeb-4b78-9acd-0ac197c89638 service cinder] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:38.960129 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f5fce-eeaa-4040-9dfb-9a1d3fd660e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:38.961020 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f5fce-eeaa-4040-9dfb-9a1d3fd660e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:38.961298 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f5fce-eeaa-4040-9dfb-9a1d3fd660e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:38.961578 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f5fce-eeaa-4040-9dfb-9a1d3fd660e0 admin admin] PATH_INFO: `/v3/projects/214e64aeab3e4cabbff6671f939417b4` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:38.962773 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22f5fce-eeaa-4040-9dfb-9a1d3fd660e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=214e64aeab3e4cabbff6671f939417b4)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:38.964794 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22f5fce-eeaa-4040-9dfb-9a1d3fd660e0 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:39.012918 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-e22f5fce-eeaa-4040-9dfb-9a1d3fd660e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '214e64aeab3e4cabbff6671f939417b4', 'request_id': 'req-e22f5fce-eeaa-4040-9dfb-9a1d3fd660e0'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:39.019622 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-e22f5fce-eeaa-4040-9dfb-9a1d3fd660e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '214e64aeab3e4cabbff6671f939417b4', 'request_id': 'req-e22f5fce-eeaa-4040-9dfb-9a1d3fd660e0'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:39.025766 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-e22f5fce-eeaa-4040-9dfb-9a1d3fd660e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '214e64aeab3e4cabbff6671f939417b4', 'request_id': 'req-e22f5fce-eeaa-4040-9dfb-9a1d3fd660e0'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:39.043398 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-e22f5fce-eeaa-4040-9dfb-9a1d3fd660e0 admin admin] The token cache is being invalidate because project 214e64aeab3e4cabbff6671f939417b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:21:39.043755 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-e22f5fce-eeaa-4040-9dfb-9a1d3fd660e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:39.044583 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-e22f5fce-eeaa-4040-9dfb-9a1d3fd660e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:21:39.046864 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1020/2042] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:21:38 2021] DELETE /identity/v3/projects/214e64aeab3e4cabbff6671f939417b4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:21:39.054441 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79567316-4194-483b-84ff-c076e9107e13 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:39.054729 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79567316-4194-483b-84ff-c076e9107e13 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:39.055018 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79567316-4194-483b-84ff-c076e9107e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:39.073575 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-79567316-4194-483b-84ff-c076e9107e13 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:21:39.074790 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-79567316-4194-483b-84ff-c076e9107e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:39.135972 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1023/2043] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:21:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:21:39.144594 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df99ae-4870-455b-916d-b467e4449235 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:39.144957 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df99ae-4870-455b-916d-b467e4449235 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:39.145455 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df99ae-4870-455b-916d-b467e4449235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:39.165793 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-b5df99ae-4870-455b-916d-b467e4449235 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:21:39.167048 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-b5df99ae-4870-455b-916d-b467e4449235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:39.176416 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1021/2044] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:21:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:21:39.180963 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79567316-4194-483b-84ff-c076e9107e13 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:39.190993 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79567316-4194-483b-84ff-c076e9107e13 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:39.196668 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bcf268-869d-4fd3-a5e5-cd68a1d15b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:39.197381 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcf268-869d-4fd3-a5e5-cd68a1d15b9b admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:39.197654 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcf268-869d-4fd3-a5e5-cd68a1d15b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:39.197904 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcf268-869d-4fd3-a5e5-cd68a1d15b9b admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:39.198670 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bcf268-869d-4fd3-a5e5-cd68a1d15b9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:21:39.199014 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bcf268-869d-4fd3-a5e5-cd68a1d15b9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:39.200625 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bcf268-869d-4fd3-a5e5-cd68a1d15b9b admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:39.212995 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1024/2045] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:21:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:21:39.217511 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df99ae-4870-455b-916d-b467e4449235 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:39.226868 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df99ae-4870-455b-916d-b467e4449235 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:39.232255 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03599e2d-b0f0-4f02-b1ae-3adc2cbc3add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:39.233008 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03599e2d-b0f0-4f02-b1ae-3adc2cbc3add admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:39.233248 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03599e2d-b0f0-4f02-b1ae-3adc2cbc3add admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:39.233517 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03599e2d-b0f0-4f02-b1ae-3adc2cbc3add admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:39.234264 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03599e2d-b0f0-4f02-b1ae-3adc2cbc3add admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:39.236283 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03599e2d-b0f0-4f02-b1ae-3adc2cbc3add admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:39.265643 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1022/2046] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:21:39 2021] POST /identity/v3/projects => generated 355 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:21:39.270499 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bcf268-869d-4fd3-a5e5-cd68a1d15b9b admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:39.280675 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bcf268-869d-4fd3-a5e5-cd68a1d15b9b admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:39.346941 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87659f81-71ef-4c28-864a-6aa72ea6e156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:39.347640 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87659f81-71ef-4c28-864a-6aa72ea6e156 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:39.347917 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87659f81-71ef-4c28-864a-6aa72ea6e156 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:39.348201 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87659f81-71ef-4c28-864a-6aa72ea6e156 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:39.348920 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87659f81-71ef-4c28-864a-6aa72ea6e156 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:39.350837 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87659f81-71ef-4c28-864a-6aa72ea6e156 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:39.371977 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1025/2047] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:21:39 2021] POST /identity/v3/users => generated 278 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:21:39.375994 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03599e2d-b0f0-4f02-b1ae-3adc2cbc3add admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:39.386119 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03599e2d-b0f0-4f02-b1ae-3adc2cbc3add admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:39.391655 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b39b8d-d558-4aee-85c7-6ed8ec598d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:39.392331 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b39b8d-d558-4aee-85c7-6ed8ec598d24 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:39.392613 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b39b8d-d558-4aee-85c7-6ed8ec598d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:39.392897 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b39b8d-d558-4aee-85c7-6ed8ec598d24 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:39.393962 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b39b8d-d558-4aee-85c7-6ed8ec598d24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:39.395622 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b39b8d-d558-4aee-85c7-6ed8ec598d24 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:39.407580 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1023/2048] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:21:39 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:21:39.411548 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87659f81-71ef-4c28-864a-6aa72ea6e156 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:39.421613 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87659f81-71ef-4c28-864a-6aa72ea6e156 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:39.426773 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f53d8-1528-4279-a1c4-29a88c8cdfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:39.427569 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f53d8-1528-4279-a1c4-29a88c8cdfd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:39.427765 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f53d8-1528-4279-a1c4-29a88c8cdfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:39.428032 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f53d8-1528-4279-a1c4-29a88c8cdfd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:39.428731 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1f53d8-1528-4279-a1c4-29a88c8cdfd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:39.430310 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1f53d8-1528-4279-a1c4-29a88c8cdfd5 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:39.440587 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1026/2049] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:21:39 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 29 20:21:39.444862 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b39b8d-d558-4aee-85c7-6ed8ec598d24 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:39.454812 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b39b8d-d558-4aee-85c7-6ed8ec598d24 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:39.459624 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45071313-888b-49f9-bc5d-d732db930b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:39.460511 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45071313-888b-49f9-bc5d-d732db930b92 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:39.460759 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45071313-888b-49f9-bc5d-d732db930b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:39.461046 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45071313-888b-49f9-bc5d-d732db930b92 admin admin] PATH_INFO: `/v3/projects/de86d54055b14a2f96292fc9ad45d8ba/users/3bd1071628e54862899f88c0e243a954/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:39.477313 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45071313-888b-49f9-bc5d-d732db930b92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de86d54055b14a2f96292fc9ad45d8ba, user_id=3bd1071628e54862899f88c0e243a954, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:39.481599 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45071313-888b-49f9-bc5d-d732db930b92 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:39.499992 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1024/2050] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:21:39 2021] PUT /identity/v3/projects/de86d54055b14a2f96292fc9ad45d8ba/users/3bd1071628e54862899f88c0e243a954/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:21:39.510486 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460bed0a-fc6b-4415-a630-73b6622ebaeb None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:39.510770 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460bed0a-fc6b-4415-a630-73b6622ebaeb None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:39.511117 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460bed0a-fc6b-4415-a630-73b6622ebaeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:39.538218 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-460bed0a-fc6b-4415-a630-73b6622ebaeb None None] MFA Rules not processed for user `3bd1071628e54862899f88c0e243a954`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:21:39.539361 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-460bed0a-fc6b-4415-a630-73b6622ebaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:39.606046 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1027/2051] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:21:39 2021] POST /identity/v3/auth/tokens => generated 3222 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:21:39.610991 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45071313-888b-49f9-bc5d-d732db930b92 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:39.677495 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45071313-888b-49f9-bc5d-d732db930b92 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:39.685301 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f1ddb-8d73-49aa-9e45-698c557a5e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:39.686267 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f1ddb-8d73-49aa-9e45-698c557a5e92 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:39.686722 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f1ddb-8d73-49aa-9e45-698c557a5e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:39.687053 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f1ddb-8d73-49aa-9e45-698c557a5e92 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:39.688212 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f1ddb-8d73-49aa-9e45-698c557a5e92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:39.690129 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f1ddb-8d73-49aa-9e45-698c557a5e92 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:39.719188 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1025/2052] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:21:39 2021] POST /identity/v3/projects => generated 357 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:21:39.723398 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460bed0a-fc6b-4415-a630-73b6622ebaeb None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:39.733916 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460bed0a-fc6b-4415-a630-73b6622ebaeb None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:39.794292 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c21ae4-9f3c-4b40-ba9e-f84d11158815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:39.794865 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c21ae4-9f3c-4b40-ba9e-f84d11158815 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:39.795178 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c21ae4-9f3c-4b40-ba9e-f84d11158815 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:39.795449 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c21ae4-9f3c-4b40-ba9e-f84d11158815 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:39.796144 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c21ae4-9f3c-4b40-ba9e-f84d11158815 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:39.798131 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c21ae4-9f3c-4b40-ba9e-f84d11158815 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:39.819785 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1028/2053] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:21:39 2021] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:21:39.823874 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f1ddb-8d73-49aa-9e45-698c557a5e92 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:39.835039 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f1ddb-8d73-49aa-9e45-698c557a5e92 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:39.840858 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97047377-6e63-4fbe-bc07-53b0eea24442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:39.841518 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97047377-6e63-4fbe-bc07-53b0eea24442 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:39.841797 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97047377-6e63-4fbe-bc07-53b0eea24442 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:39.842066 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97047377-6e63-4fbe-bc07-53b0eea24442 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:39.842800 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97047377-6e63-4fbe-bc07-53b0eea24442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:39.844472 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97047377-6e63-4fbe-bc07-53b0eea24442 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:39.855214 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1026/2054] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:21:39 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 29 20:21:39.859607 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c21ae4-9f3c-4b40-ba9e-f84d11158815 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:39.870340 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c21ae4-9f3c-4b40-ba9e-f84d11158815 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:39.876197 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6af2c-eba6-4046-96c5-76c843428ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:39.877123 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6af2c-eba6-4046-96c5-76c843428ddf admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:39.877405 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6af2c-eba6-4046-96c5-76c843428ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:39.877683 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6af2c-eba6-4046-96c5-76c843428ddf admin admin] PATH_INFO: `/v3/projects/18815b1bdce444ef9efe7c2bd9ff814b/users/01f913d3297445d2982a0de3b0afa048/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:39.896384 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6af2c-eba6-4046-96c5-76c843428ddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=18815b1bdce444ef9efe7c2bd9ff814b, user_id=01f913d3297445d2982a0de3b0afa048, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:39.899416 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6af2c-eba6-4046-96c5-76c843428ddf admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:39.923145 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1029/2055] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:21:39 2021] PUT /identity/v3/projects/18815b1bdce444ef9efe7c2bd9ff814b/users/01f913d3297445d2982a0de3b0afa048/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:21:39.927545 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97047377-6e63-4fbe-bc07-53b0eea24442 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:39.938607 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97047377-6e63-4fbe-bc07-53b0eea24442 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:39.996204 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34822519-6b0b-4ebf-ad1b-c0983d2f9225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:39.996904 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34822519-6b0b-4ebf-ad1b-c0983d2f9225 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:39.997184 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34822519-6b0b-4ebf-ad1b-c0983d2f9225 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:39.997459 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34822519-6b0b-4ebf-ad1b-c0983d2f9225 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:39.998189 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34822519-6b0b-4ebf-ad1b-c0983d2f9225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:39.999997 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34822519-6b0b-4ebf-ad1b-c0983d2f9225 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:40.011046 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1027/2056] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:21:39 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:21:40.015156 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6af2c-eba6-4046-96c5-76c843428ddf admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:40.026554 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6af2c-eba6-4046-96c5-76c843428ddf admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:40.031277 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c80b1-a4ec-454f-87ea-5ca53caa3222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:40.032198 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c80b1-a4ec-454f-87ea-5ca53caa3222 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:40.032478 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c80b1-a4ec-454f-87ea-5ca53caa3222 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:40.032757 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c80b1-a4ec-454f-87ea-5ca53caa3222 admin admin] PATH_INFO: `/v3/projects/18815b1bdce444ef9efe7c2bd9ff814b/users/01f913d3297445d2982a0de3b0afa048/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:40.035095 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327c80b1-a4ec-454f-87ea-5ca53caa3222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18815b1bdce444ef9efe7c2bd9ff814b, user_id=01f913d3297445d2982a0de3b0afa048, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:40.038230 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327c80b1-a4ec-454f-87ea-5ca53caa3222 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:40.049733 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1030/2057] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:21:40 2021] PUT /identity/v3/projects/18815b1bdce444ef9efe7c2bd9ff814b/users/01f913d3297445d2982a0de3b0afa048/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:21:40.060707 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4d20e-72b0-4e64-9030-ce99d06dde23 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:40.061172 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4d20e-72b0-4e64-9030-ce99d06dde23 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:40.061448 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4d20e-72b0-4e64-9030-ce99d06dde23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:40.092927 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-8bd4d20e-72b0-4e64-9030-ce99d06dde23 None None] MFA Rules not processed for user `01f913d3297445d2982a0de3b0afa048`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:21:40.099294 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-8bd4d20e-72b0-4e64-9030-ce99d06dde23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:40.166828 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1028/2058] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:21:40 2021] POST /identity/v3/auth/tokens => generated 3291 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:21:40.177890 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c80b1-a4ec-454f-87ea-5ca53caa3222 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:40.179750 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-327c80b1-a4ec-454f-87ea-5ca53caa3222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:21:40.238876 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327c80b1-a4ec-454f-87ea-5ca53caa3222 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:40.243267 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e85e0-c972-4ff3-ab56-07a194ea6c17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:40.243893 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e85e0-c972-4ff3-ab56-07a194ea6c17 service cinder] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:40.244172 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e85e0-c972-4ff3-ab56-07a194ea6c17 service cinder] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:40.244439 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66e85e0-c972-4ff3-ab56-07a194ea6c17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:40.253980 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e85e0-c972-4ff3-ab56-07a194ea6c17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:40.255447 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66e85e0-c972-4ff3-ab56-07a194ea6c17 service cinder] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:40.264667 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1031/2059] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:21:40 2021] GET /identity/v3/auth/tokens => generated 3291 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:21:40.352880 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4d20e-72b0-4e64-9030-ce99d06dde23 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:21:40.365242 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4d20e-72b0-4e64-9030-ce99d06dde23 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:21:40.369471 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd7ee42-1557-4106-b853-cbdd4b0c6e3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:21:40.370262 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7ee42-1557-4106-b853-cbdd4b0c6e3f service cinder] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:21:40.370546 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7ee42-1557-4106-b853-cbdd4b0c6e3f service cinder] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:21:40.370819 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd7ee42-1557-4106-b853-cbdd4b0c6e3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:21:40.431654 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd7ee42-1557-4106-b853-cbdd4b0c6e3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:21:40.433229 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd7ee42-1557-4106-b853-cbdd4b0c6e3f service cinder] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:21:40.442726 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1029/2060] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:21:40 2021] GET /identity/v3/auth/tokens => generated 3222 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:22:02.300694 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e85e0-c972-4ff3-ab56-07a194ea6c17 service cinder] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:02.302937 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-c66e85e0-c972-4ff3-ab56-07a194ea6c17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:02.381615 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66e85e0-c972-4ff3-ab56-07a194ea6c17 service cinder] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:02.386720 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef6d66e-eb38-4699-accd-a56192819313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:02.387685 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6d66e-eb38-4699-accd-a56192819313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:02.387958 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6d66e-eb38-4699-accd-a56192819313 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:02.388230 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6d66e-eb38-4699-accd-a56192819313 admin admin] PATH_INFO: `/v3/users/c30163e06ae34eb7b099b1437cda0300` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:02.389567 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef6d66e-eb38-4699-accd-a56192819313 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c30163e06ae34eb7b099b1437cda0300)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:02.391609 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef6d66e-eb38-4699-accd-a56192819313 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:02.445402 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-0ef6d66e-eb38-4699-accd-a56192819313 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c30163e06ae34eb7b099b1437cda0300'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:02.452768 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-0ef6d66e-eb38-4699-accd-a56192819313 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c30163e06ae34eb7b099b1437cda0300'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:02.461948 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-0ef6d66e-eb38-4699-accd-a56192819313 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c30163e06ae34eb7b099b1437cda0300'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:02.473782 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-0ef6d66e-eb38-4699-accd-a56192819313 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c30163e06ae34eb7b099b1437cda0300'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:02.474457 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-0ef6d66e-eb38-4699-accd-a56192819313 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c30163e06ae34eb7b099b1437cda0300'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:02.480377 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1032/2061] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:22:02 2021] DELETE /identity/v3/users/c30163e06ae34eb7b099b1437cda0300 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:22:02.485079 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986275d-2818-4b7e-b07b-7a8fbcc67600 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:02.485571 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986275d-2818-4b7e-b07b-7a8fbcc67600 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:02.485663 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986275d-2818-4b7e-b07b-7a8fbcc67600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:02.503743 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-3986275d-2818-4b7e-b07b-7a8fbcc67600 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:22:02.504885 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-3986275d-2818-4b7e-b07b-7a8fbcc67600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:02.569824 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1030/2062] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:22:02 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:22:02.580636 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef6d66e-eb38-4699-accd-a56192819313 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:02.589273 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-0ef6d66e-eb38-4699-accd-a56192819313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:02.640744 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef6d66e-eb38-4699-accd-a56192819313 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:02.645661 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbea3a5-d9f7-4f05-83e5-6511d0f98a3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:02.646431 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbea3a5-d9f7-4f05-83e5-6511d0f98a3e service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:02.646715 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbea3a5-d9f7-4f05-83e5-6511d0f98a3e service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:02.647018 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbea3a5-d9f7-4f05-83e5-6511d0f98a3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:02.656245 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbea3a5-d9f7-4f05-83e5-6511d0f98a3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:02.657670 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbea3a5-d9f7-4f05-83e5-6511d0f98a3e service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:02.669325 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1033/2063] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:22:02 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:22:02.970090 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986275d-2818-4b7e-b07b-7a8fbcc67600 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:02.971590 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-3986275d-2818-4b7e-b07b-7a8fbcc67600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:02.983434 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986275d-2818-4b7e-b07b-7a8fbcc67600 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:02.990124 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21233dc-fcbe-4fa3-b5a2-caf9c09878fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:02.991242 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21233dc-fcbe-4fa3-b5a2-caf9c09878fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:02.991242 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21233dc-fcbe-4fa3-b5a2-caf9c09878fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:02.991528 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21233dc-fcbe-4fa3-b5a2-caf9c09878fa admin admin] PATH_INFO: `/v3/projects/643f88b7748942d093bdf4af9760721f` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:02.994217 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21233dc-fcbe-4fa3-b5a2-caf9c09878fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=643f88b7748942d093bdf4af9760721f)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:02.996505 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21233dc-fcbe-4fa3-b5a2-caf9c09878fa admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:03.053453 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-c21233dc-fcbe-4fa3-b5a2-caf9c09878fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '643f88b7748942d093bdf4af9760721f', 'request_id': 'req-c21233dc-fcbe-4fa3-b5a2-caf9c09878fa'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:03.059676 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-c21233dc-fcbe-4fa3-b5a2-caf9c09878fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '643f88b7748942d093bdf4af9760721f', 'request_id': 'req-c21233dc-fcbe-4fa3-b5a2-caf9c09878fa'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:03.065297 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-c21233dc-fcbe-4fa3-b5a2-caf9c09878fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '643f88b7748942d093bdf4af9760721f', 'request_id': 'req-c21233dc-fcbe-4fa3-b5a2-caf9c09878fa'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:03.079116 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-c21233dc-fcbe-4fa3-b5a2-caf9c09878fa admin admin] The token cache is being invalidate because project 643f88b7748942d093bdf4af9760721f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:22:03.079398 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-c21233dc-fcbe-4fa3-b5a2-caf9c09878fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:03.079999 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-c21233dc-fcbe-4fa3-b5a2-caf9c09878fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:03.081661 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1031/2064] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:22:02 2021] DELETE /identity/v3/projects/643f88b7748942d093bdf4af9760721f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:22:04.848760 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbea3a5-d9f7-4f05-83e5-6511d0f98a3e service neutron] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:04.850351 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-edbea3a5-d9f7-4f05-83e5-6511d0f98a3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:04.863374 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbea3a5-d9f7-4f05-83e5-6511d0f98a3e service neutron] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:04.917403 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e37b40-7d1a-47bf-87f6-c596113e06b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:04.918169 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e37b40-7d1a-47bf-87f6-c596113e06b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:04.918448 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e37b40-7d1a-47bf-87f6-c596113e06b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:04.918721 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e37b40-7d1a-47bf-87f6-c596113e06b2 admin admin] PATH_INFO: `/v3/users/3bd1071628e54862899f88c0e243a954` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:04.919994 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e37b40-7d1a-47bf-87f6-c596113e06b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bd1071628e54862899f88c0e243a954)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:04.921886 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e37b40-7d1a-47bf-87f6-c596113e06b2 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:04.970243 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-e5e37b40-7d1a-47bf-87f6-c596113e06b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bd1071628e54862899f88c0e243a954'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:04.980030 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-e5e37b40-7d1a-47bf-87f6-c596113e06b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bd1071628e54862899f88c0e243a954'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:04.988859 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-e5e37b40-7d1a-47bf-87f6-c596113e06b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bd1071628e54862899f88c0e243a954'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:05.000536 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-e5e37b40-7d1a-47bf-87f6-c596113e06b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bd1071628e54862899f88c0e243a954'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:05.001200 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-e5e37b40-7d1a-47bf-87f6-c596113e06b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bd1071628e54862899f88c0e243a954'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:05.006999 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1034/2065] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:22:04 2021] DELETE /identity/v3/users/3bd1071628e54862899f88c0e243a954 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:22:05.011517 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdac4dc-5c97-4745-9e85-f0ac7dca56d0 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:05.012010 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdac4dc-5c97-4745-9e85-f0ac7dca56d0 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:05.012108 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdac4dc-5c97-4745-9e85-f0ac7dca56d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:05.031262 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-ffdac4dc-5c97-4745-9e85-f0ac7dca56d0 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:22:05.032460 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-ffdac4dc-5c97-4745-9e85-f0ac7dca56d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:05.091553 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1032/2066] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:22:05 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:22:05.103716 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e37b40-7d1a-47bf-87f6-c596113e06b2 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:05.105869 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-e5e37b40-7d1a-47bf-87f6-c596113e06b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:05.163450 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e37b40-7d1a-47bf-87f6-c596113e06b2 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:05.167863 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b712f48-ddcb-4bef-b968-edd612bd5d53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:05.168455 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b712f48-ddcb-4bef-b968-edd612bd5d53 service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:05.168736 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b712f48-ddcb-4bef-b968-edd612bd5d53 service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:05.169013 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b712f48-ddcb-4bef-b968-edd612bd5d53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:05.179318 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b712f48-ddcb-4bef-b968-edd612bd5d53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:05.180744 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b712f48-ddcb-4bef-b968-edd612bd5d53 service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:05.190560 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1035/2067] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:22:05 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:22:05.473537 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdac4dc-5c97-4745-9e85-f0ac7dca56d0 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:05.475022 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-ffdac4dc-5c97-4745-9e85-f0ac7dca56d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:05.488711 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdac4dc-5c97-4745-9e85-f0ac7dca56d0 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:05.495017 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b080b0-396e-4901-aa64-ead28a5ed740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:05.496245 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b080b0-396e-4901-aa64-ead28a5ed740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:05.496736 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b080b0-396e-4901-aa64-ead28a5ed740 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:05.497189 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b080b0-396e-4901-aa64-ead28a5ed740 admin admin] PATH_INFO: `/v3/projects/de86d54055b14a2f96292fc9ad45d8ba` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:05.498663 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b080b0-396e-4901-aa64-ead28a5ed740 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de86d54055b14a2f96292fc9ad45d8ba)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:05.501535 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b080b0-396e-4901-aa64-ead28a5ed740 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:05.550978 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-d9b080b0-396e-4901-aa64-ead28a5ed740 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de86d54055b14a2f96292fc9ad45d8ba', 'request_id': 'req-d9b080b0-396e-4901-aa64-ead28a5ed740'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:05.557431 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-d9b080b0-396e-4901-aa64-ead28a5ed740 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de86d54055b14a2f96292fc9ad45d8ba', 'request_id': 'req-d9b080b0-396e-4901-aa64-ead28a5ed740'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:05.563423 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-d9b080b0-396e-4901-aa64-ead28a5ed740 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de86d54055b14a2f96292fc9ad45d8ba', 'request_id': 'req-d9b080b0-396e-4901-aa64-ead28a5ed740'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:05.577247 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-d9b080b0-396e-4901-aa64-ead28a5ed740 admin admin] The token cache is being invalidate because project de86d54055b14a2f96292fc9ad45d8ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:22:05.577534 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-d9b080b0-396e-4901-aa64-ead28a5ed740 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:05.578148 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-d9b080b0-396e-4901-aa64-ead28a5ed740 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:05.579744 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1033/2068] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:22:05 2021] DELETE /identity/v3/projects/de86d54055b14a2f96292fc9ad45d8ba => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:22:05.583837 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b712f48-ddcb-4bef-b968-edd612bd5d53 service neutron] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:05.593319 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b712f48-ddcb-4bef-b968-edd612bd5d53 service neutron] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:05.647358 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15b1bb-8877-4042-b531-ec87e2aef728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:05.648219 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15b1bb-8877-4042-b531-ec87e2aef728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:05.648498 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15b1bb-8877-4042-b531-ec87e2aef728 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:05.648775 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15b1bb-8877-4042-b531-ec87e2aef728 admin admin] PATH_INFO: `/v3/users/01f913d3297445d2982a0de3b0afa048` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:05.650006 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e15b1bb-8877-4042-b531-ec87e2aef728 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01f913d3297445d2982a0de3b0afa048)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:05.651959 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e15b1bb-8877-4042-b531-ec87e2aef728 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:05.703240 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-9e15b1bb-8877-4042-b531-ec87e2aef728 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01f913d3297445d2982a0de3b0afa048'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:05.710360 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-9e15b1bb-8877-4042-b531-ec87e2aef728 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01f913d3297445d2982a0de3b0afa048'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:05.719450 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-9e15b1bb-8877-4042-b531-ec87e2aef728 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01f913d3297445d2982a0de3b0afa048'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:05.731638 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-9e15b1bb-8877-4042-b531-ec87e2aef728 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01f913d3297445d2982a0de3b0afa048'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:05.732293 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-9e15b1bb-8877-4042-b531-ec87e2aef728 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01f913d3297445d2982a0de3b0afa048'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:05.737919 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1036/2069] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:22:05 2021] DELETE /identity/v3/users/01f913d3297445d2982a0de3b0afa048 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:22:06.008794 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b080b0-396e-4901-aa64-ead28a5ed740 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:06.010385 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-d9b080b0-396e-4901-aa64-ead28a5ed740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:06.024607 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b080b0-396e-4901-aa64-ead28a5ed740 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:06.081109 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe8387-44e7-45b7-a335-506ff5738ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:06.082017 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe8387-44e7-45b7-a335-506ff5738ae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:06.082305 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe8387-44e7-45b7-a335-506ff5738ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:06.082579 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe8387-44e7-45b7-a335-506ff5738ae4 admin admin] PATH_INFO: `/v3/projects/18815b1bdce444ef9efe7c2bd9ff814b` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:06.083824 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe8387-44e7-45b7-a335-506ff5738ae4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18815b1bdce444ef9efe7c2bd9ff814b)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:06.085732 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe8387-44e7-45b7-a335-506ff5738ae4 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:06.134147 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-f4fe8387-44e7-45b7-a335-506ff5738ae4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18815b1bdce444ef9efe7c2bd9ff814b', 'request_id': 'req-f4fe8387-44e7-45b7-a335-506ff5738ae4'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:06.140296 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-f4fe8387-44e7-45b7-a335-506ff5738ae4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18815b1bdce444ef9efe7c2bd9ff814b', 'request_id': 'req-f4fe8387-44e7-45b7-a335-506ff5738ae4'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:06.146440 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-f4fe8387-44e7-45b7-a335-506ff5738ae4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18815b1bdce444ef9efe7c2bd9ff814b', 'request_id': 'req-f4fe8387-44e7-45b7-a335-506ff5738ae4'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:06.161979 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-f4fe8387-44e7-45b7-a335-506ff5738ae4 admin admin] The token cache is being invalidate because project 18815b1bdce444ef9efe7c2bd9ff814b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:22:06.162266 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-f4fe8387-44e7-45b7-a335-506ff5738ae4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:06.162958 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-f4fe8387-44e7-45b7-a335-506ff5738ae4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:06.164506 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1034/2070] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:22:06 2021] DELETE /identity/v3/projects/18815b1bdce444ef9efe7c2bd9ff814b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:22:06.171073 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad8196-3ca2-4ebc-8435-6eb850d1ed30 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:06.171600 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad8196-3ca2-4ebc-8435-6eb850d1ed30 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:06.171600 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad8196-3ca2-4ebc-8435-6eb850d1ed30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:06.189469 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-b0ad8196-3ca2-4ebc-8435-6eb850d1ed30 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:22:06.190681 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-b0ad8196-3ca2-4ebc-8435-6eb850d1ed30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:06.251244 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1037/2071] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:22:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:22:06.259054 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02944d-ee1d-431a-b493-2f9491d4d08e None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:06.259342 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02944d-ee1d-431a-b493-2f9491d4d08e None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:06.259618 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02944d-ee1d-431a-b493-2f9491d4d08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:06.278069 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-bd02944d-ee1d-431a-b493-2f9491d4d08e None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:22:06.279312 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-bd02944d-ee1d-431a-b493-2f9491d4d08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:06.287374 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1035/2072] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:22:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:22:06.291606 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad8196-3ca2-4ebc-8435-6eb850d1ed30 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:06.302084 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad8196-3ca2-4ebc-8435-6eb850d1ed30 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:06.307676 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5526ff-40bc-4a70-8daf-02f7efa93e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:06.308328 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5526ff-40bc-4a70-8daf-02f7efa93e8d admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:06.308611 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5526ff-40bc-4a70-8daf-02f7efa93e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:06.308889 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5526ff-40bc-4a70-8daf-02f7efa93e8d admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:06.309629 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5526ff-40bc-4a70-8daf-02f7efa93e8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:22:06.309934 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5526ff-40bc-4a70-8daf-02f7efa93e8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:06.311572 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5526ff-40bc-4a70-8daf-02f7efa93e8d admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:06.322807 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1038/2073] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:22:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:22:06.327231 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02944d-ee1d-431a-b493-2f9491d4d08e None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:06.336424 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02944d-ee1d-431a-b493-2f9491d4d08e None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:06.341634 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fbb33b-f77d-49fa-b4ae-a025cab86ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:06.342270 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fbb33b-f77d-49fa-b4ae-a025cab86ba0 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:06.342552 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fbb33b-f77d-49fa-b4ae-a025cab86ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:06.342826 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fbb33b-f77d-49fa-b4ae-a025cab86ba0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:06.343546 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fbb33b-f77d-49fa-b4ae-a025cab86ba0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:06.345431 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fbb33b-f77d-49fa-b4ae-a025cab86ba0 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:06.382502 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1036/2074] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:22:06 2021] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:22:06.387338 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5526ff-40bc-4a70-8daf-02f7efa93e8d admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:06.399692 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5526ff-40bc-4a70-8daf-02f7efa93e8d admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:06.465726 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ee9fe-b9c5-4aea-82d9-71264145b4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:06.466393 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ee9fe-b9c5-4aea-82d9-71264145b4bc admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:06.466677 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ee9fe-b9c5-4aea-82d9-71264145b4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:06.466993 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ee9fe-b9c5-4aea-82d9-71264145b4bc admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:06.467740 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ee9fe-b9c5-4aea-82d9-71264145b4bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:06.469775 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ee9fe-b9c5-4aea-82d9-71264145b4bc admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:06.491287 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1039/2075] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:22:06 2021] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 29 20:22:06.495404 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fbb33b-f77d-49fa-b4ae-a025cab86ba0 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:06.505564 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fbb33b-f77d-49fa-b4ae-a025cab86ba0 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:06.510553 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa31f49-adf8-47f3-b89e-aa85e8811740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:06.511238 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa31f49-adf8-47f3-b89e-aa85e8811740 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:06.511519 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa31f49-adf8-47f3-b89e-aa85e8811740 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:06.511793 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa31f49-adf8-47f3-b89e-aa85e8811740 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:06.512560 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa31f49-adf8-47f3-b89e-aa85e8811740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:06.514154 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa31f49-adf8-47f3-b89e-aa85e8811740 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:06.525046 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1037/2076] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:22:06 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:22:06.529033 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ee9fe-b9c5-4aea-82d9-71264145b4bc admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:06.539654 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ee9fe-b9c5-4aea-82d9-71264145b4bc admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:06.545594 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25908076-3253-4d69-bef2-58286c5a970e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:06.546246 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25908076-3253-4d69-bef2-58286c5a970e admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:06.546522 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25908076-3253-4d69-bef2-58286c5a970e admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:06.546793 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25908076-3253-4d69-bef2-58286c5a970e admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:06.547572 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25908076-3253-4d69-bef2-58286c5a970e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:06.549147 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25908076-3253-4d69-bef2-58286c5a970e admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:06.559730 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1040/2077] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:22:06 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:22:06.563829 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa31f49-adf8-47f3-b89e-aa85e8811740 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:06.573876 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa31f49-adf8-47f3-b89e-aa85e8811740 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:06.578918 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2100f6-094f-4b5a-bf25-a3b3c9193179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:06.579757 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2100f6-094f-4b5a-bf25-a3b3c9193179 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:06.580042 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2100f6-094f-4b5a-bf25-a3b3c9193179 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:06.580297 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2100f6-094f-4b5a-bf25-a3b3c9193179 admin admin] PATH_INFO: `/v3/projects/f9884f9af49e42e38b1d985c43fa9dcc/users/466de8bfa6fe4e4cbf6b360de52c4915/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:06.595415 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2100f6-094f-4b5a-bf25-a3b3c9193179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9884f9af49e42e38b1d985c43fa9dcc, user_id=466de8bfa6fe4e4cbf6b360de52c4915, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:06.598173 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2100f6-094f-4b5a-bf25-a3b3c9193179 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:06.613412 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1038/2078] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:22:06 2021] PUT /identity/v3/projects/f9884f9af49e42e38b1d985c43fa9dcc/users/466de8bfa6fe4e4cbf6b360de52c4915/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:22:06.624582 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72e9f2-f82a-481d-9c4f-1591244e7150 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:06.624852 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72e9f2-f82a-481d-9c4f-1591244e7150 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:06.625133 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72e9f2-f82a-481d-9c4f-1591244e7150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:06.651838 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-ce72e9f2-f82a-481d-9c4f-1591244e7150 None None] MFA Rules not processed for user `466de8bfa6fe4e4cbf6b360de52c4915`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:22:06.653073 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-ce72e9f2-f82a-481d-9c4f-1591244e7150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:06.720076 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1041/2079] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:22:06 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:22:06.724585 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2100f6-094f-4b5a-bf25-a3b3c9193179 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:06.784574 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2100f6-094f-4b5a-bf25-a3b3c9193179 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:06.789966 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c55025-80cc-4e2e-bb4a-eeae71015179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:06.790625 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c55025-80cc-4e2e-bb4a-eeae71015179 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:06.790933 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c55025-80cc-4e2e-bb4a-eeae71015179 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:06.791210 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c55025-80cc-4e2e-bb4a-eeae71015179 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:06.791911 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c55025-80cc-4e2e-bb4a-eeae71015179 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:06.793876 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c55025-80cc-4e2e-bb4a-eeae71015179 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:06.821754 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1039/2080] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:22:06 2021] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:22:06.825974 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72e9f2-f82a-481d-9c4f-1591244e7150 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:06.836881 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72e9f2-f82a-481d-9c4f-1591244e7150 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:06.892062 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe65fc2-4f51-46bd-8189-d58e5bba7378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:06.892822 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe65fc2-4f51-46bd-8189-d58e5bba7378 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:06.893166 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe65fc2-4f51-46bd-8189-d58e5bba7378 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:06.893821 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe65fc2-4f51-46bd-8189-d58e5bba7378 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:06.894603 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe65fc2-4f51-46bd-8189-d58e5bba7378 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:06.896627 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe65fc2-4f51-46bd-8189-d58e5bba7378 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:06.920893 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1042/2081] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:22:06 2021] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:22:06.922540 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c55025-80cc-4e2e-bb4a-eeae71015179 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:06.933873 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c55025-80cc-4e2e-bb4a-eeae71015179 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:06.939764 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33175e-7956-4f7f-ad7a-4c9d4c410089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:06.940513 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33175e-7956-4f7f-ad7a-4c9d4c410089 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:06.940868 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33175e-7956-4f7f-ad7a-4c9d4c410089 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:06.941202 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33175e-7956-4f7f-ad7a-4c9d4c410089 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:06.942094 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c33175e-7956-4f7f-ad7a-4c9d4c410089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:06.943779 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c33175e-7956-4f7f-ad7a-4c9d4c410089 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:06.954736 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1040/2082] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:22:06 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:22:06.959441 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe65fc2-4f51-46bd-8189-d58e5bba7378 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:06.969966 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe65fc2-4f51-46bd-8189-d58e5bba7378 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:06.976111 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f0801-9ce0-4fa4-aa55-ff558a3d07c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:06.976916 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f0801-9ce0-4fa4-aa55-ff558a3d07c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:06.977218 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f0801-9ce0-4fa4-aa55-ff558a3d07c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:06.977514 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f0801-9ce0-4fa4-aa55-ff558a3d07c1 admin admin] PATH_INFO: `/v3/projects/fb88b9e008eb438f918ff84f14756380/users/d4887d07f7774bf89b3b237330fe3c38/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:06.992740 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f0801-9ce0-4fa4-aa55-ff558a3d07c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb88b9e008eb438f918ff84f14756380, user_id=d4887d07f7774bf89b3b237330fe3c38, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:06.995481 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f0801-9ce0-4fa4-aa55-ff558a3d07c1 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:07.009889 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1043/2083] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:22:06 2021] PUT /identity/v3/projects/fb88b9e008eb438f918ff84f14756380/users/d4887d07f7774bf89b3b237330fe3c38/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:22:07.014156 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33175e-7956-4f7f-ad7a-4c9d4c410089 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:07.025511 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33175e-7956-4f7f-ad7a-4c9d4c410089 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:07.096461 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d93d1f-7ea3-4096-add1-77c252199994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:07.097543 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d93d1f-7ea3-4096-add1-77c252199994 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:07.097999 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d93d1f-7ea3-4096-add1-77c252199994 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:07.098268 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d93d1f-7ea3-4096-add1-77c252199994 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:07.099033 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d93d1f-7ea3-4096-add1-77c252199994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:07.100624 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d93d1f-7ea3-4096-add1-77c252199994 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:07.114006 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1041/2084] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:22:07 2021] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:22:07.115228 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f0801-9ce0-4fa4-aa55-ff558a3d07c1 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:07.125446 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f0801-9ce0-4fa4-aa55-ff558a3d07c1 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:07.130221 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed56e258-db20-4713-a24a-bc4c11e5f97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:07.131128 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56e258-db20-4713-a24a-bc4c11e5f97f admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:07.131405 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56e258-db20-4713-a24a-bc4c11e5f97f admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:07.131684 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed56e258-db20-4713-a24a-bc4c11e5f97f admin admin] PATH_INFO: `/v3/projects/fb88b9e008eb438f918ff84f14756380/users/d4887d07f7774bf89b3b237330fe3c38/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:07.133684 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed56e258-db20-4713-a24a-bc4c11e5f97f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb88b9e008eb438f918ff84f14756380, user_id=d4887d07f7774bf89b3b237330fe3c38, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:07.136363 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed56e258-db20-4713-a24a-bc4c11e5f97f admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:07.147332 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1044/2085] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:22:07 2021] PUT /identity/v3/projects/fb88b9e008eb438f918ff84f14756380/users/d4887d07f7774bf89b3b237330fe3c38/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:22:07.157792 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39011961-a8d1-4531-8245-506ff369a3b8 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:07.158094 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39011961-a8d1-4531-8245-506ff369a3b8 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:07.158367 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39011961-a8d1-4531-8245-506ff369a3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:07.185672 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-39011961-a8d1-4531-8245-506ff369a3b8 None None] MFA Rules not processed for user `d4887d07f7774bf89b3b237330fe3c38`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:22:07.186884 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-39011961-a8d1-4531-8245-506ff369a3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:07.260851 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1042/2086] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:22:07 2021] POST /identity/v3/auth/tokens => generated 3309 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:22:07.272274 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed56e258-db20-4713-a24a-bc4c11e5f97f admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:07.274308 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-ed56e258-db20-4713-a24a-bc4c11e5f97f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:07.333914 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed56e258-db20-4713-a24a-bc4c11e5f97f admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:07.338398 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5fcac2-0e45-4851-8afe-e3abdf57c936 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:07.339078 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5fcac2-0e45-4851-8afe-e3abdf57c936 service cinder] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:07.339344 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5fcac2-0e45-4851-8afe-e3abdf57c936 service cinder] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:07.339622 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5fcac2-0e45-4851-8afe-e3abdf57c936 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:07.402675 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5fcac2-0e45-4851-8afe-e3abdf57c936 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:07.404231 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5fcac2-0e45-4851-8afe-e3abdf57c936 service cinder] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:07.413862 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1045/2087] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:22:07 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:22:14.087075 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39011961-a8d1-4531-8245-506ff369a3b8 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:14.098157 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39011961-a8d1-4531-8245-506ff369a3b8 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:14.103344 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e125d-2998-4fc3-80d4-f47eadf3e9f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:14.104118 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e125d-2998-4fc3-80d4-f47eadf3e9f4 service cinder] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:14.104316 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e125d-2998-4fc3-80d4-f47eadf3e9f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:14.104624 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e125d-2998-4fc3-80d4-f47eadf3e9f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:14.115842 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e125d-2998-4fc3-80d4-f47eadf3e9f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:14.117464 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e125d-2998-4fc3-80d4-f47eadf3e9f4 service cinder] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:14.127472 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1043/2088] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:22:14 2021] GET /identity/v3/auth/tokens => generated 3309 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:22:52.347785 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5fcac2-0e45-4851-8afe-e3abdf57c936 service cinder] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:52.349966 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-7f5fcac2-0e45-4851-8afe-e3abdf57c936 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:52.425365 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5fcac2-0e45-4851-8afe-e3abdf57c936 service cinder] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:52.433412 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca97166-0d7c-451a-9833-f621d6368892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:52.434727 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca97166-0d7c-451a-9833-f621d6368892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:52.435213 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca97166-0d7c-451a-9833-f621d6368892 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:52.435557 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca97166-0d7c-451a-9833-f621d6368892 admin admin] PATH_INFO: `/v3/users/36a89f1ee53d40ed953c09d3184f9df9` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:52.437571 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca97166-0d7c-451a-9833-f621d6368892 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36a89f1ee53d40ed953c09d3184f9df9)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:52.440655 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca97166-0d7c-451a-9833-f621d6368892 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:52.490135 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-9ca97166-0d7c-451a-9833-f621d6368892 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36a89f1ee53d40ed953c09d3184f9df9'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:52.497618 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-9ca97166-0d7c-451a-9833-f621d6368892 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36a89f1ee53d40ed953c09d3184f9df9'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:52.507466 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-9ca97166-0d7c-451a-9833-f621d6368892 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36a89f1ee53d40ed953c09d3184f9df9'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:52.521853 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-9ca97166-0d7c-451a-9833-f621d6368892 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36a89f1ee53d40ed953c09d3184f9df9'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:52.522503 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-9ca97166-0d7c-451a-9833-f621d6368892 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36a89f1ee53d40ed953c09d3184f9df9'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:52.528448 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1046/2089] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:22:52 2021] DELETE /identity/v3/users/36a89f1ee53d40ed953c09d3184f9df9 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:22:52.533053 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391851a3-3d7a-44d2-9406-3b6010b740c3 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:52.533594 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391851a3-3d7a-44d2-9406-3b6010b740c3 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:52.533594 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391851a3-3d7a-44d2-9406-3b6010b740c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:52.552133 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-391851a3-3d7a-44d2-9406-3b6010b740c3 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:22:52.553352 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-391851a3-3d7a-44d2-9406-3b6010b740c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:52.614423 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1044/2090] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:22:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:22:52.624986 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca97166-0d7c-451a-9833-f621d6368892 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:52.626516 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-9ca97166-0d7c-451a-9833-f621d6368892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:52.685727 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca97166-0d7c-451a-9833-f621d6368892 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:52.689347 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b0f4c-e013-4f3d-b7aa-83576e019a4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:52.689991 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b0f4c-e013-4f3d-b7aa-83576e019a4f service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:52.690274 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b0f4c-e013-4f3d-b7aa-83576e019a4f service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:52.690513 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b0f4c-e013-4f3d-b7aa-83576e019a4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:52.699602 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b0f4c-e013-4f3d-b7aa-83576e019a4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:52.701062 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901b0f4c-e013-4f3d-b7aa-83576e019a4f service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:52.710490 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1047/2091] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:22:52 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 29 20:22:52.981845 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391851a3-3d7a-44d2-9406-3b6010b740c3 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:52.983492 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-391851a3-3d7a-44d2-9406-3b6010b740c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:52.997270 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391851a3-3d7a-44d2-9406-3b6010b740c3 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:53.003433 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e130d098-85ed-4f36-bef8-6d20139ab70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:53.004404 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130d098-85ed-4f36-bef8-6d20139ab70b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:53.004790 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130d098-85ed-4f36-bef8-6d20139ab70b admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:53.005123 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130d098-85ed-4f36-bef8-6d20139ab70b admin admin] PATH_INFO: `/v3/projects/64a53acf48c84ed582e67115a2f88b68` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:53.006498 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e130d098-85ed-4f36-bef8-6d20139ab70b admin admin] RBAC: Authorizing `identity:delete_project(project_id=64a53acf48c84ed582e67115a2f88b68)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:53.008502 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e130d098-85ed-4f36-bef8-6d20139ab70b admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:53.063109 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-e130d098-85ed-4f36-bef8-6d20139ab70b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64a53acf48c84ed582e67115a2f88b68', 'request_id': 'req-e130d098-85ed-4f36-bef8-6d20139ab70b'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:53.069228 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-e130d098-85ed-4f36-bef8-6d20139ab70b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64a53acf48c84ed582e67115a2f88b68', 'request_id': 'req-e130d098-85ed-4f36-bef8-6d20139ab70b'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:53.074582 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-e130d098-85ed-4f36-bef8-6d20139ab70b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64a53acf48c84ed582e67115a2f88b68', 'request_id': 'req-e130d098-85ed-4f36-bef8-6d20139ab70b'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:53.087015 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-e130d098-85ed-4f36-bef8-6d20139ab70b admin admin] The token cache is being invalidate because project 64a53acf48c84ed582e67115a2f88b68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:22:53.087301 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-e130d098-85ed-4f36-bef8-6d20139ab70b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:53.087925 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-e130d098-85ed-4f36-bef8-6d20139ab70b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:53.089450 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1045/2092] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:22:52 2021] DELETE /identity/v3/projects/64a53acf48c84ed582e67115a2f88b68 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:22:53.095275 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1699a1-c5bd-424d-abb5-b830ebf0973a None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:53.095569 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1699a1-c5bd-424d-abb5-b830ebf0973a None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:53.095850 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1699a1-c5bd-424d-abb5-b830ebf0973a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:53.115177 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-ce1699a1-c5bd-424d-abb5-b830ebf0973a None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:22:53.116402 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-ce1699a1-c5bd-424d-abb5-b830ebf0973a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:53.176895 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1048/2093] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:22:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:22:53.184669 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1014712-fa6d-4b09-a0b0-3cdf95c3c8a4 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:53.185037 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1014712-fa6d-4b09-a0b0-3cdf95c3c8a4 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:53.185409 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1014712-fa6d-4b09-a0b0-3cdf95c3c8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:53.203962 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-f1014712-fa6d-4b09-a0b0-3cdf95c3c8a4 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:22:53.205158 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-f1014712-fa6d-4b09-a0b0-3cdf95c3c8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:53.214012 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1046/2094] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:22:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:22:53.217933 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1699a1-c5bd-424d-abb5-b830ebf0973a None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:53.227558 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1699a1-c5bd-424d-abb5-b830ebf0973a None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:53.232589 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51cf02f-4299-417b-8b22-cc3791a28fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:53.233246 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51cf02f-4299-417b-8b22-cc3791a28fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:53.233528 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51cf02f-4299-417b-8b22-cc3791a28fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:53.233804 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51cf02f-4299-417b-8b22-cc3791a28fe8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:53.234578 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51cf02f-4299-417b-8b22-cc3791a28fe8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:22:53.234905 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51cf02f-4299-417b-8b22-cc3791a28fe8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:53.236534 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51cf02f-4299-417b-8b22-cc3791a28fe8 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:53.247906 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1049/2095] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:22:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:22:53.252188 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1014712-fa6d-4b09-a0b0-3cdf95c3c8a4 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:53.261707 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1014712-fa6d-4b09-a0b0-3cdf95c3c8a4 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:53.267729 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69f64c-ebc5-416f-861f-e91b2f5d8df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:53.268706 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69f64c-ebc5-416f-861f-e91b2f5d8df4 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:53.269046 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69f64c-ebc5-416f-861f-e91b2f5d8df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:53.269322 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69f64c-ebc5-416f-861f-e91b2f5d8df4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:53.270006 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a69f64c-ebc5-416f-861f-e91b2f5d8df4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:53.271995 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a69f64c-ebc5-416f-861f-e91b2f5d8df4 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:53.300857 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1047/2096] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:22:53 2021] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:22:53.304709 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51cf02f-4299-417b-8b22-cc3791a28fe8 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:53.315170 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51cf02f-4299-417b-8b22-cc3791a28fe8 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:53.316338 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69f64c-ebc5-416f-861f-e91b2f5d8df4 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:53.318049 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-8a69f64c-ebc5-416f-861f-e91b2f5d8df4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:53.371688 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a39b8-279c-49d8-9021-25afae39fa48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:53.372356 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a39b8-279c-49d8-9021-25afae39fa48 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:53.372634 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a39b8-279c-49d8-9021-25afae39fa48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:53.372962 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a39b8-279c-49d8-9021-25afae39fa48 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:53.373693 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a39b8-279c-49d8-9021-25afae39fa48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:53.375641 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a39b8-279c-49d8-9021-25afae39fa48 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:53.380460 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69f64c-ebc5-416f-861f-e91b2f5d8df4 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:53.385568 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c4edb-1f57-4aca-8684-cbf9ca4292ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:53.386254 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c4edb-1f57-4aca-8684-cbf9ca4292ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:53.386533 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c4edb-1f57-4aca-8684-cbf9ca4292ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:53.386871 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c4edb-1f57-4aca-8684-cbf9ca4292ac admin admin] PATH_INFO: `/v3/users/466de8bfa6fe4e4cbf6b360de52c4915` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:53.388450 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8c4edb-1f57-4aca-8684-cbf9ca4292ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=466de8bfa6fe4e4cbf6b360de52c4915)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:53.391044 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8c4edb-1f57-4aca-8684-cbf9ca4292ac admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:53.401526 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1050/2097] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:22:53 2021] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:22:53.402550 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a39b8-279c-49d8-9021-25afae39fa48 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:53.411910 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a39b8-279c-49d8-9021-25afae39fa48 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:53.416830 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998fc75-3a68-4517-a3aa-347d9b7252fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:53.417479 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998fc75-3a68-4517-a3aa-347d9b7252fa admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:53.417754 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998fc75-3a68-4517-a3aa-347d9b7252fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:53.418064 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998fc75-3a68-4517-a3aa-347d9b7252fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:53.418763 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5998fc75-3a68-4517-a3aa-347d9b7252fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:53.420390 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5998fc75-3a68-4517-a3aa-347d9b7252fa admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:53.430591 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1051/2098] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:22:53 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:22:53.434529 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998fc75-3a68-4517-a3aa-347d9b7252fa admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:53.438370 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-dc8c4edb-1f57-4aca-8684-cbf9ca4292ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '466de8bfa6fe4e4cbf6b360de52c4915'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:53.444001 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5998fc75-3a68-4517-a3aa-347d9b7252fa admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:53.445186 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-dc8c4edb-1f57-4aca-8684-cbf9ca4292ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '466de8bfa6fe4e4cbf6b360de52c4915'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:53.448564 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efbf783-10c0-4781-ac52-73725b1df45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:53.449196 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efbf783-10c0-4781-ac52-73725b1df45f admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:53.449463 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efbf783-10c0-4781-ac52-73725b1df45f admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:53.449739 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efbf783-10c0-4781-ac52-73725b1df45f admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:53.450468 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efbf783-10c0-4781-ac52-73725b1df45f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:53.452132 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efbf783-10c0-4781-ac52-73725b1df45f admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:53.457035 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-dc8c4edb-1f57-4aca-8684-cbf9ca4292ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '466de8bfa6fe4e4cbf6b360de52c4915'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:53.457742 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-dc8c4edb-1f57-4aca-8684-cbf9ca4292ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '466de8bfa6fe4e4cbf6b360de52c4915'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:53.458350 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-dc8c4edb-1f57-4aca-8684-cbf9ca4292ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '466de8bfa6fe4e4cbf6b360de52c4915'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:53.462661 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1052/2099] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:22:53 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:22:53.467098 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efbf783-10c0-4781-ac52-73725b1df45f admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:53.468723 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-0efbf783-10c0-4781-ac52-73725b1df45f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:53.471273 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1048/2100] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:22:53 2021] DELETE /identity/v3/users/466de8bfa6fe4e4cbf6b360de52c4915 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:22:53.475449 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c4509-9634-4a0d-82fc-e990716aa9a8 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:53.475734 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c4509-9634-4a0d-82fc-e990716aa9a8 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:53.476007 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c4509-9634-4a0d-82fc-e990716aa9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:53.481114 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efbf783-10c0-4781-ac52-73725b1df45f admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:53.492840 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-727c4509-9634-4a0d-82fc-e990716aa9a8 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:22:53.494025 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-727c4509-9634-4a0d-82fc-e990716aa9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:53.536086 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64b570a-d8c7-402d-af2f-032adf4b19c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:53.537158 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b570a-d8c7-402d-af2f-032adf4b19c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:53.537440 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b570a-d8c7-402d-af2f-032adf4b19c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:53.537714 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64b570a-d8c7-402d-af2f-032adf4b19c2 admin admin] PATH_INFO: `/v3/projects/1d43d7d191174cd3889d3766bbdbabb1/users/c4e176d46dbc448b9636c370ca162293/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:53.550310 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1049/2101] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:22:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:22:53.554174 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64b570a-d8c7-402d-af2f-032adf4b19c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d43d7d191174cd3889d3766bbdbabb1, user_id=c4e176d46dbc448b9636c370ca162293, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:53.556842 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64b570a-d8c7-402d-af2f-032adf4b19c2 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:53.561327 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c4509-9634-4a0d-82fc-e990716aa9a8 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:53.562801 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-727c4509-9634-4a0d-82fc-e990716aa9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:53.571260 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1053/2102] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:22:53 2021] PUT /identity/v3/projects/1d43d7d191174cd3889d3766bbdbabb1/users/c4e176d46dbc448b9636c370ca162293/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:22:53.582006 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27c426-9cfe-4daf-b582-84fa6a5ee2bf None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:53.582355 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27c426-9cfe-4daf-b582-84fa6a5ee2bf None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:53.582567 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27c426-9cfe-4daf-b582-84fa6a5ee2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:53.610840 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-ca27c426-9cfe-4daf-b582-84fa6a5ee2bf None None] MFA Rules not processed for user `c4e176d46dbc448b9636c370ca162293`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:22:53.612489 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-ca27c426-9cfe-4daf-b582-84fa6a5ee2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:53.619840 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c4509-9634-4a0d-82fc-e990716aa9a8 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:53.667650 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1704a9e-5656-4edf-a394-f79783d9b474 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:53.668262 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1704a9e-5656-4edf-a394-f79783d9b474 service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:53.668562 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1704a9e-5656-4edf-a394-f79783d9b474 service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:53.668817 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1704a9e-5656-4edf-a394-f79783d9b474 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:53.681826 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1054/2103] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:22:53 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:22:53.693196 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27c426-9cfe-4daf-b582-84fa6a5ee2bf None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:53.694934 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-ca27c426-9cfe-4daf-b582-84fa6a5ee2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:53.729014 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1704a9e-5656-4edf-a394-f79783d9b474 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:53.730702 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1704a9e-5656-4edf-a394-f79783d9b474 service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:53.741357 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1050/2104] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:22:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:22:53.751552 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27c426-9cfe-4daf-b582-84fa6a5ee2bf None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:53.755347 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07931d-9424-424f-b762-b95bd9004446 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:53.756070 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07931d-9424-424f-b762-b95bd9004446 service cinder] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:53.756416 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07931d-9424-424f-b762-b95bd9004446 service cinder] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:53.756757 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07931d-9424-424f-b762-b95bd9004446 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:53.766139 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df07931d-9424-424f-b762-b95bd9004446 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:53.767676 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df07931d-9424-424f-b762-b95bd9004446 service cinder] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:53.779460 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1055/2105] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:22:53 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 29 20:22:53.805264 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1704a9e-5656-4edf-a394-f79783d9b474 service neutron] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:53.818295 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1704a9e-5656-4edf-a394-f79783d9b474 service neutron] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:53.825085 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec555a-a175-4707-a462-cc5e8fa2d15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:53.826125 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec555a-a175-4707-a462-cc5e8fa2d15f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:53.826453 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec555a-a175-4707-a462-cc5e8fa2d15f admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:53.826730 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ec555a-a175-4707-a462-cc5e8fa2d15f admin admin] PATH_INFO: `/v3/users/c4e176d46dbc448b9636c370ca162293` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:53.828709 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec555a-a175-4707-a462-cc5e8fa2d15f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4e176d46dbc448b9636c370ca162293)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:53.830542 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ec555a-a175-4707-a462-cc5e8fa2d15f admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:53.885763 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-c8ec555a-a175-4707-a462-cc5e8fa2d15f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4e176d46dbc448b9636c370ca162293'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:53.889959 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-c8ec555a-a175-4707-a462-cc5e8fa2d15f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4e176d46dbc448b9636c370ca162293'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:53.905105 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-c8ec555a-a175-4707-a462-cc5e8fa2d15f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4e176d46dbc448b9636c370ca162293'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:53.905782 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-c8ec555a-a175-4707-a462-cc5e8fa2d15f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4e176d46dbc448b9636c370ca162293'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:53.906400 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-c8ec555a-a175-4707-a462-cc5e8fa2d15f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4e176d46dbc448b9636c370ca162293'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:53.921748 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1051/2106] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:22:53 2021] DELETE /identity/v3/users/c4e176d46dbc448b9636c370ca162293 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:22:53.926126 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f7083-f5e4-4b12-9c2e-4af3be999712 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:53.926481 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f7083-f5e4-4b12-9c2e-4af3be999712 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:53.926757 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f7083-f5e4-4b12-9c2e-4af3be999712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:53.944018 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-b89f7083-f5e4-4b12-9c2e-4af3be999712 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:22:53.945219 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-b89f7083-f5e4-4b12-9c2e-4af3be999712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:54.001865 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1056/2107] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:22:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:22:54.016214 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec555a-a175-4707-a462-cc5e8fa2d15f admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:54.017742 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-c8ec555a-a175-4707-a462-cc5e8fa2d15f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:54.043910 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f7083-f5e4-4b12-9c2e-4af3be999712 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:54.045442 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-b89f7083-f5e4-4b12-9c2e-4af3be999712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:54.058703 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f7083-f5e4-4b12-9c2e-4af3be999712 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:54.065800 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7fc1d-1b33-45bc-8724-e050ccb1af26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:54.067084 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7fc1d-1b33-45bc-8724-e050ccb1af26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:54.067370 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7fc1d-1b33-45bc-8724-e050ccb1af26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:54.067642 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7fc1d-1b33-45bc-8724-e050ccb1af26 admin admin] PATH_INFO: `/v3/projects/f9884f9af49e42e38b1d985c43fa9dcc` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:54.068930 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7fc1d-1b33-45bc-8724-e050ccb1af26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9884f9af49e42e38b1d985c43fa9dcc)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:54.071256 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac7fc1d-1b33-45bc-8724-e050ccb1af26 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:54.087008 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ec555a-a175-4707-a462-cc5e8fa2d15f admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:54.091626 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15d2c5-3b9b-44f7-8cfc-575676cba2e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:54.092364 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15d2c5-3b9b-44f7-8cfc-575676cba2e4 service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:54.092712 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15d2c5-3b9b-44f7-8cfc-575676cba2e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:54.093054 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15d2c5-3b9b-44f7-8cfc-575676cba2e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:54.103066 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15d2c5-3b9b-44f7-8cfc-575676cba2e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:54.105237 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15d2c5-3b9b-44f7-8cfc-575676cba2e4 service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:54.116492 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1052/2108] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:22:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:22:54.133006 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-bac7fc1d-1b33-45bc-8724-e050ccb1af26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9884f9af49e42e38b1d985c43fa9dcc', 'request_id': 'req-bac7fc1d-1b33-45bc-8724-e050ccb1af26'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:54.140883 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-bac7fc1d-1b33-45bc-8724-e050ccb1af26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9884f9af49e42e38b1d985c43fa9dcc', 'request_id': 'req-bac7fc1d-1b33-45bc-8724-e050ccb1af26'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:54.154985 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-bac7fc1d-1b33-45bc-8724-e050ccb1af26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9884f9af49e42e38b1d985c43fa9dcc', 'request_id': 'req-bac7fc1d-1b33-45bc-8724-e050ccb1af26'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:54.166358 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-bac7fc1d-1b33-45bc-8724-e050ccb1af26 admin admin] The token cache is being invalidate because project f9884f9af49e42e38b1d985c43fa9dcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:22:54.166650 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-bac7fc1d-1b33-45bc-8724-e050ccb1af26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:54.167334 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-bac7fc1d-1b33-45bc-8724-e050ccb1af26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:54.168887 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1057/2109] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:22:54 2021] DELETE /identity/v3/projects/f9884f9af49e42e38b1d985c43fa9dcc => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:22:54.173100 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15d2c5-3b9b-44f7-8cfc-575676cba2e4 service neutron] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:54.184459 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15d2c5-3b9b-44f7-8cfc-575676cba2e4 service neutron] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:54.242185 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e80c96-ad08-4573-88f5-a0d4b7810043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:54.243112 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e80c96-ad08-4573-88f5-a0d4b7810043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:54.243396 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e80c96-ad08-4573-88f5-a0d4b7810043 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:54.243672 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e80c96-ad08-4573-88f5-a0d4b7810043 admin admin] PATH_INFO: `/v3/users/d4887d07f7774bf89b3b237330fe3c38` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:54.245244 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e80c96-ad08-4573-88f5-a0d4b7810043 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4887d07f7774bf89b3b237330fe3c38)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:54.247521 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e80c96-ad08-4573-88f5-a0d4b7810043 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:54.300778 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-e7e80c96-ad08-4573-88f5-a0d4b7810043 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4887d07f7774bf89b3b237330fe3c38'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:54.307891 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-e7e80c96-ad08-4573-88f5-a0d4b7810043 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4887d07f7774bf89b3b237330fe3c38'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:54.320269 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-e7e80c96-ad08-4573-88f5-a0d4b7810043 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4887d07f7774bf89b3b237330fe3c38'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:54.321024 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-e7e80c96-ad08-4573-88f5-a0d4b7810043 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4887d07f7774bf89b3b237330fe3c38'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:54.321628 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-e7e80c96-ad08-4573-88f5-a0d4b7810043 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4887d07f7774bf89b3b237330fe3c38'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:54.344345 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1053/2110] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:22:54 2021] DELETE /identity/v3/users/d4887d07f7774bf89b3b237330fe3c38 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:22:54.585623 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7fc1d-1b33-45bc-8724-e050ccb1af26 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:54.587697 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-bac7fc1d-1b33-45bc-8724-e050ccb1af26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:54.604748 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7fc1d-1b33-45bc-8724-e050ccb1af26 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:54.667473 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014baca1-ac20-427f-8abe-f5fa72a5a008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:54.668342 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014baca1-ac20-427f-8abe-f5fa72a5a008 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:54.668831 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014baca1-ac20-427f-8abe-f5fa72a5a008 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:54.668949 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014baca1-ac20-427f-8abe-f5fa72a5a008 admin admin] PATH_INFO: `/v3/projects/1d43d7d191174cd3889d3766bbdbabb1` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:54.670174 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014baca1-ac20-427f-8abe-f5fa72a5a008 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d43d7d191174cd3889d3766bbdbabb1)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:54.672135 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014baca1-ac20-427f-8abe-f5fa72a5a008 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:54.719774 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-014baca1-ac20-427f-8abe-f5fa72a5a008 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d43d7d191174cd3889d3766bbdbabb1', 'request_id': 'req-014baca1-ac20-427f-8abe-f5fa72a5a008'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:54.726358 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-014baca1-ac20-427f-8abe-f5fa72a5a008 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d43d7d191174cd3889d3766bbdbabb1', 'request_id': 'req-014baca1-ac20-427f-8abe-f5fa72a5a008'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:54.729291 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e80c96-ad08-4573-88f5-a0d4b7810043 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:54.731238 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-e7e80c96-ad08-4573-88f5-a0d4b7810043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:54.739441 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-014baca1-ac20-427f-8abe-f5fa72a5a008 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d43d7d191174cd3889d3766bbdbabb1', 'request_id': 'req-014baca1-ac20-427f-8abe-f5fa72a5a008'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:54.745199 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e80c96-ad08-4573-88f5-a0d4b7810043 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:54.753212 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-014baca1-ac20-427f-8abe-f5fa72a5a008 admin admin] The token cache is being invalidate because project 1d43d7d191174cd3889d3766bbdbabb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:22:54.753596 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-014baca1-ac20-427f-8abe-f5fa72a5a008 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:54.754451 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-014baca1-ac20-427f-8abe-f5fa72a5a008 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:54.756767 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1058/2111] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:22:54 2021] DELETE /identity/v3/projects/1d43d7d191174cd3889d3766bbdbabb1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:22:54.762277 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bfe03-815f-420a-97f6-44774d7ada94 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:54.762941 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bfe03-815f-420a-97f6-44774d7ada94 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:54.763445 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bfe03-815f-420a-97f6-44774d7ada94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:54.783164 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-078bfe03-815f-420a-97f6-44774d7ada94 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:22:54.784380 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-078bfe03-815f-420a-97f6-44774d7ada94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:54.800957 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c8313-9042-4fd7-abd7-7007a217a5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:54.801812 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c8313-9042-4fd7-abd7-7007a217a5a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:54.802092 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c8313-9042-4fd7-abd7-7007a217a5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:54.802359 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c8313-9042-4fd7-abd7-7007a217a5a3 admin admin] PATH_INFO: `/v3/projects/fb88b9e008eb438f918ff84f14756380` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:54.803563 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c8313-9042-4fd7-abd7-7007a217a5a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb88b9e008eb438f918ff84f14756380)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:54.805484 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c8313-9042-4fd7-abd7-7007a217a5a3 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:54.842355 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1059/2112] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:22:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:22:54.850529 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11240f61-2269-4cf9-a973-a5ca94e2c215 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:54.850908 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11240f61-2269-4cf9-a973-a5ca94e2c215 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:54.851148 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11240f61-2269-4cf9-a973-a5ca94e2c215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:54.858192 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-3c7c8313-9042-4fd7-abd7-7007a217a5a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb88b9e008eb438f918ff84f14756380', 'request_id': 'req-3c7c8313-9042-4fd7-abd7-7007a217a5a3'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:54.865000 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-3c7c8313-9042-4fd7-abd7-7007a217a5a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb88b9e008eb438f918ff84f14756380', 'request_id': 'req-3c7c8313-9042-4fd7-abd7-7007a217a5a3'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:54.870168 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-3c7c8313-9042-4fd7-abd7-7007a217a5a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb88b9e008eb438f918ff84f14756380', 'request_id': 'req-3c7c8313-9042-4fd7-abd7-7007a217a5a3'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:54.873330 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-11240f61-2269-4cf9-a973-a5ca94e2c215 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:22:54.874551 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-11240f61-2269-4cf9-a973-a5ca94e2c215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:54.884469 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-3c7c8313-9042-4fd7-abd7-7007a217a5a3 admin admin] The token cache is being invalidate because project fb88b9e008eb438f918ff84f14756380 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:22:54.884754 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-3c7c8313-9042-4fd7-abd7-7007a217a5a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:54.885372 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-3c7c8313-9042-4fd7-abd7-7007a217a5a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:54.887017 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1054/2113] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:22:54 2021] DELETE /identity/v3/projects/fb88b9e008eb438f918ff84f14756380 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:22:54.892495 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220fa5e-5ffd-4dee-8c38-fc4406a32dd0 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:54.892870 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220fa5e-5ffd-4dee-8c38-fc4406a32dd0 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:54.893543 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220fa5e-5ffd-4dee-8c38-fc4406a32dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:54.912092 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-8220fa5e-5ffd-4dee-8c38-fc4406a32dd0 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:22:54.913305 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-8220fa5e-5ffd-4dee-8c38-fc4406a32dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:54.938886 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1060/2114] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:22:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:22:54.943223 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11240f61-2269-4cf9-a973-a5ca94e2c215 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:54.951693 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11240f61-2269-4cf9-a973-a5ca94e2c215 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:54.956557 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda8392-e98d-4d94-a8b6-c5143eace4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:54.957209 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda8392-e98d-4d94-a8b6-c5143eace4ac admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:54.957590 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda8392-e98d-4d94-a8b6-c5143eace4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:54.957712 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda8392-e98d-4d94-a8b6-c5143eace4ac admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:54.958446 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda8392-e98d-4d94-a8b6-c5143eace4ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:22:54.958750 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda8392-e98d-4d94-a8b6-c5143eace4ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:54.960376 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deda8392-e98d-4d94-a8b6-c5143eace4ac admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:54.973437 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1055/2115] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:22:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:22:54.974836 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1061/2116] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:22:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:22:54.979136 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220fa5e-5ffd-4dee-8c38-fc4406a32dd0 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:54.982259 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f506d3-cf9e-4058-bfca-d16a1d5274ba None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:54.982671 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f506d3-cf9e-4058-bfca-d16a1d5274ba None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:54.982976 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f506d3-cf9e-4058-bfca-d16a1d5274ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:54.988711 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220fa5e-5ffd-4dee-8c38-fc4406a32dd0 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:54.993329 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0222bf-5e27-49b5-8152-ba2b41706a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:54.993991 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0222bf-5e27-49b5-8152-ba2b41706a2d admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:54.994269 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0222bf-5e27-49b5-8152-ba2b41706a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:54.994541 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0222bf-5e27-49b5-8152-ba2b41706a2d admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:54.995279 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0222bf-5e27-49b5-8152-ba2b41706a2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:54.997170 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0222bf-5e27-49b5-8152-ba2b41706a2d admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:55.002160 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-33f506d3-cf9e-4058-bfca-d16a1d5274ba None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:22:55.003379 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-33f506d3-cf9e-4058-bfca-d16a1d5274ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:55.011187 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1062/2117] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:22:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:22:55.016033 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f506d3-cf9e-4058-bfca-d16a1d5274ba None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:55.026601 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1056/2118] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:22:54 2021] POST /identity/v3/projects => generated 399 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 29 20:22:55.026758 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f506d3-cf9e-4058-bfca-d16a1d5274ba None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:55.027582 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0222bf-5e27-49b5-8152-ba2b41706a2d admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:55.085615 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1347cd-f0f0-4a82-ac7c-40ea45c83d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:55.086287 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1347cd-f0f0-4a82-ac7c-40ea45c83d1d admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:55.086573 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1347cd-f0f0-4a82-ac7c-40ea45c83d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:55.086777 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0222bf-5e27-49b5-8152-ba2b41706a2d admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:55.086946 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1347cd-f0f0-4a82-ac7c-40ea45c83d1d admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:55.087620 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1347cd-f0f0-4a82-ac7c-40ea45c83d1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:22:55.087929 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1347cd-f0f0-4a82-ac7c-40ea45c83d1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:55.089539 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1347cd-f0f0-4a82-ac7c-40ea45c83d1d admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:55.091653 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72862a-45e4-47ff-b61a-370f40884eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:55.092285 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72862a-45e4-47ff-b61a-370f40884eab admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:55.092520 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72862a-45e4-47ff-b61a-370f40884eab admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:55.092806 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72862a-45e4-47ff-b61a-370f40884eab admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:55.093498 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e72862a-45e4-47ff-b61a-370f40884eab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:55.095426 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e72862a-45e4-47ff-b61a-370f40884eab admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:55.101365 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1063/2119] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:22:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:22:55.105583 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1347cd-f0f0-4a82-ac7c-40ea45c83d1d admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:55.116203 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1347cd-f0f0-4a82-ac7c-40ea45c83d1d admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:55.122374 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1057/2120] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:22:55 2021] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:22:55.122532 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97357389-5dab-4309-b4dd-08302725d52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:55.122532 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97357389-5dab-4309-b4dd-08302725d52d admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:55.122532 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97357389-5dab-4309-b4dd-08302725d52d admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:55.122532 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97357389-5dab-4309-b4dd-08302725d52d admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:55.123028 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97357389-5dab-4309-b4dd-08302725d52d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:55.123503 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72862a-45e4-47ff-b61a-370f40884eab admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:55.124724 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97357389-5dab-4309-b4dd-08302725d52d admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:55.132885 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72862a-45e4-47ff-b61a-370f40884eab admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:55.137862 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ad54c-f275-495a-9d64-93dab6a65790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:55.138592 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ad54c-f275-495a-9d64-93dab6a65790 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:55.138887 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ad54c-f275-495a-9d64-93dab6a65790 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:55.139512 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ad54c-f275-495a-9d64-93dab6a65790 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:55.139959 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ad54c-f275-495a-9d64-93dab6a65790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:55.141510 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ad54c-f275-495a-9d64-93dab6a65790 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:55.155883 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1058/2121] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:22:55 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:22:55.156100 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1064/2122] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:22:55 2021] POST /identity/v3/projects => generated 367 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 29 20:22:55.156202 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ad54c-f275-495a-9d64-93dab6a65790 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:55.156933 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97357389-5dab-4309-b4dd-08302725d52d admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:55.166060 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ad54c-f275-495a-9d64-93dab6a65790 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:55.218419 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97357389-5dab-4309-b4dd-08302725d52d admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:55.222969 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8475a3b-d915-4dcd-af4a-8424fe99f9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:55.223193 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42903eaf-d130-40c5-b24d-3494b6a4557a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:55.223924 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42903eaf-d130-40c5-b24d-3494b6a4557a admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:55.224082 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8475a3b-d915-4dcd-af4a-8424fe99f9a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:55.224208 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42903eaf-d130-40c5-b24d-3494b6a4557a admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:55.224355 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8475a3b-d915-4dcd-af4a-8424fe99f9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:55.224473 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42903eaf-d130-40c5-b24d-3494b6a4557a admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:55.224630 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8475a3b-d915-4dcd-af4a-8424fe99f9a5 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:55.225217 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42903eaf-d130-40c5-b24d-3494b6a4557a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:55.225315 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8475a3b-d915-4dcd-af4a-8424fe99f9a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:55.226809 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42903eaf-d130-40c5-b24d-3494b6a4557a admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:55.227267 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8475a3b-d915-4dcd-af4a-8424fe99f9a5 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:55.236907 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1065/2123] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:22:55 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:22:55.240941 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42903eaf-d130-40c5-b24d-3494b6a4557a admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:55.249650 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1059/2124] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:22:55 2021] POST /identity/v3/users => generated 284 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 29 20:22:55.250644 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8475a3b-d915-4dcd-af4a-8424fe99f9a5 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:55.252851 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42903eaf-d130-40c5-b24d-3494b6a4557a admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:55.257530 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a5882-0eb1-4776-b92e-1626287b4d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:55.258532 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a5882-0eb1-4776-b92e-1626287b4d89 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:55.258906 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a5882-0eb1-4776-b92e-1626287b4d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:55.259256 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a5882-0eb1-4776-b92e-1626287b4d89 admin admin] PATH_INFO: `/v3/projects/c545b6f25d9b47eeb083ca435ae5d316/users/60f099ed17df46fa9920e0489dc7ba38/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:55.260638 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8475a3b-d915-4dcd-af4a-8424fe99f9a5 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:55.265523 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f955fe3-59cc-4284-b197-8d482827d60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:55.266179 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f955fe3-59cc-4284-b197-8d482827d60e admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:55.266453 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f955fe3-59cc-4284-b197-8d482827d60e admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:55.266726 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f955fe3-59cc-4284-b197-8d482827d60e admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:55.267490 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f955fe3-59cc-4284-b197-8d482827d60e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:55.269614 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f955fe3-59cc-4284-b197-8d482827d60e admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:55.275512 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a5882-0eb1-4776-b92e-1626287b4d89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c545b6f25d9b47eeb083ca435ae5d316, user_id=60f099ed17df46fa9920e0489dc7ba38, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:55.278251 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a5882-0eb1-4776-b92e-1626287b4d89 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:55.280317 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1060/2125] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:22:55 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:22:55.284226 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f955fe3-59cc-4284-b197-8d482827d60e admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:55.293551 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f955fe3-59cc-4284-b197-8d482827d60e admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:55.294653 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1066/2126] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:22:55 2021] PUT /identity/v3/projects/c545b6f25d9b47eeb083ca435ae5d316/users/60f099ed17df46fa9920e0489dc7ba38/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:22:55.304416 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6d9c5-c6ee-4fe4-b682-2ea0df58e938 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:55.304707 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6d9c5-c6ee-4fe4-b682-2ea0df58e938 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:55.304985 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6d9c5-c6ee-4fe4-b682-2ea0df58e938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:55.332524 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-45c6d9c5-c6ee-4fe4-b682-2ea0df58e938 None None] MFA Rules not processed for user `60f099ed17df46fa9920e0489dc7ba38`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:22:55.334689 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-45c6d9c5-c6ee-4fe4-b682-2ea0df58e938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:55.355198 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc0ca4-3c33-4127-a654-6182b9d8804f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:55.355785 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc0ca4-3c33-4127-a654-6182b9d8804f admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:55.356134 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc0ca4-3c33-4127-a654-6182b9d8804f admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:55.356437 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc0ca4-3c33-4127-a654-6182b9d8804f admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:55.357384 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc0ca4-3c33-4127-a654-6182b9d8804f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:55.358867 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc0ca4-3c33-4127-a654-6182b9d8804f admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:55.379266 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1061/2127] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:22:55 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 29 20:22:55.381012 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc0ca4-3c33-4127-a654-6182b9d8804f admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:55.391714 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc0ca4-3c33-4127-a654-6182b9d8804f admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:55.396982 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ce4cd-3739-4cbc-bcf5-d0bf05bdd6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:55.397977 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ce4cd-3739-4cbc-bcf5-d0bf05bdd6f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:55.398381 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ce4cd-3739-4cbc-bcf5-d0bf05bdd6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:55.398750 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ce4cd-3739-4cbc-bcf5-d0bf05bdd6f6 admin admin] PATH_INFO: `/v3/projects/b4e21b30ef254f0899c652912ed2b84d/users/edd20694b6a5416f8fd96424141a9c98/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:55.404898 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1067/2128] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:22:55 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:22:55.408009 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6d9c5-c6ee-4fe4-b682-2ea0df58e938 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:55.410422 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-45c6d9c5-c6ee-4fe4-b682-2ea0df58e938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:55.415066 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ce4cd-3739-4cbc-bcf5-d0bf05bdd6f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4e21b30ef254f0899c652912ed2b84d, user_id=edd20694b6a5416f8fd96424141a9c98, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:55.417713 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ce4cd-3739-4cbc-bcf5-d0bf05bdd6f6 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:55.426167 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6d9c5-c6ee-4fe4-b682-2ea0df58e938 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:55.433394 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1062/2129] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:22:55 2021] PUT /identity/v3/projects/b4e21b30ef254f0899c652912ed2b84d/users/edd20694b6a5416f8fd96424141a9c98/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:22:55.434416 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ce4cd-3739-4cbc-bcf5-d0bf05bdd6f6 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:55.449322 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-653ce4cd-3739-4cbc-bcf5-d0bf05bdd6f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:55.486526 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e059425e-48a9-4c88-aa17-b5a2472c50c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:55.488059 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059425e-48a9-4c88-aa17-b5a2472c50c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:55.488334 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059425e-48a9-4c88-aa17-b5a2472c50c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:55.488626 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059425e-48a9-4c88-aa17-b5a2472c50c2 admin admin] PATH_INFO: `/v3/users/16ab49b5fda7473392bbefb4594581be` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:55.489827 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e059425e-48a9-4c88-aa17-b5a2472c50c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16ab49b5fda7473392bbefb4594581be)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:55.491784 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e059425e-48a9-4c88-aa17-b5a2472c50c2 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:55.514698 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ce4cd-3739-4cbc-bcf5-d0bf05bdd6f6 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:55.518721 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0578c-5bfb-4cfe-b349-dda1d46c5546 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:55.519387 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0578c-5bfb-4cfe-b349-dda1d46c5546 service cinder] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:55.519660 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0578c-5bfb-4cfe-b349-dda1d46c5546 service cinder] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:55.519934 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0578c-5bfb-4cfe-b349-dda1d46c5546 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:55.536930 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-e059425e-48a9-4c88-aa17-b5a2472c50c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16ab49b5fda7473392bbefb4594581be'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:55.543531 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-e059425e-48a9-4c88-aa17-b5a2472c50c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16ab49b5fda7473392bbefb4594581be'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:55.551383 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-e059425e-48a9-4c88-aa17-b5a2472c50c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16ab49b5fda7473392bbefb4594581be'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:55.562554 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-e059425e-48a9-4c88-aa17-b5a2472c50c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16ab49b5fda7473392bbefb4594581be'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:55.563276 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-e059425e-48a9-4c88-aa17-b5a2472c50c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16ab49b5fda7473392bbefb4594581be'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:55.569051 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1068/2130] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:22:55 2021] DELETE /identity/v3/users/16ab49b5fda7473392bbefb4594581be => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:22:55.570285 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c8f7e-b002-4c2d-9335-5f7ed09ce8ab None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:55.570568 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c8f7e-b002-4c2d-9335-5f7ed09ce8ab None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:55.570838 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c8f7e-b002-4c2d-9335-5f7ed09ce8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:55.573998 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e0578c-5bfb-4cfe-b349-dda1d46c5546 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:55.575561 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e0578c-5bfb-4cfe-b349-dda1d46c5546 service cinder] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:55.584453 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1063/2131] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:22:55 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:22:55.586018 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db954024-7981-4a83-94a7-516a80a875e1 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:55.586448 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db954024-7981-4a83-94a7-516a80a875e1 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:55.586773 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db954024-7981-4a83-94a7-516a80a875e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:55.596970 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-ec0c8f7e-b002-4c2d-9335-5f7ed09ce8ab None None] MFA Rules not processed for user `edd20694b6a5416f8fd96424141a9c98`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:22:55.598169 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-ec0c8f7e-b002-4c2d-9335-5f7ed09ce8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:55.604214 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-db954024-7981-4a83-94a7-516a80a875e1 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:22:55.605457 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-db954024-7981-4a83-94a7-516a80a875e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:55.666056 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1069/2132] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:22:55 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:22:55.670318 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c8f7e-b002-4c2d-9335-5f7ed09ce8ab None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:55.674691 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1064/2133] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:22:55 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:22:55.675946 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-ec0c8f7e-b002-4c2d-9335-5f7ed09ce8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:55.683638 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db954024-7981-4a83-94a7-516a80a875e1 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:55.685098 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-db954024-7981-4a83-94a7-516a80a875e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:55.690746 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c8f7e-b002-4c2d-9335-5f7ed09ce8ab None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:55.696448 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50614f-0ce9-4a4b-a3f4-2d35ce8c0a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:55.697204 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50614f-0ce9-4a4b-a3f4-2d35ce8c0a69 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:55.697381 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50614f-0ce9-4a4b-a3f4-2d35ce8c0a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:55.697655 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50614f-0ce9-4a4b-a3f4-2d35ce8c0a69 admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:55.698364 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac50614f-0ce9-4a4b-a3f4-2d35ce8c0a69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:55.700449 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac50614f-0ce9-4a4b-a3f4-2d35ce8c0a69 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:55.728915 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1070/2134] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:22:55 2021] POST /identity/v3/projects => generated 369 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 29 20:22:55.732825 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50614f-0ce9-4a4b-a3f4-2d35ce8c0a69 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:55.756747 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db954024-7981-4a83-94a7-516a80a875e1 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:55.805360 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50614f-0ce9-4a4b-a3f4-2d35ce8c0a69 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:55.815147 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee3909-613c-4973-9e31-0296a2389878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:55.815147 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee3909-613c-4973-9e31-0296a2389878 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:55.815147 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee3909-613c-4973-9e31-0296a2389878 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:55.815147 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cee3909-613c-4973-9e31-0296a2389878 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:55.815583 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee3909-613c-4973-9e31-0296a2389878 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:55.815583 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cee3909-613c-4973-9e31-0296a2389878 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:55.819087 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4d0ff-c775-4457-8761-e2acc42bcbd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:55.819751 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4d0ff-c775-4457-8761-e2acc42bcbd5 service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:55.820024 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4d0ff-c775-4457-8761-e2acc42bcbd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:55.820296 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff4d0ff-c775-4457-8761-e2acc42bcbd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:55.831035 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff4d0ff-c775-4457-8761-e2acc42bcbd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:55.833027 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff4d0ff-c775-4457-8761-e2acc42bcbd5 service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:55.841707 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1071/2135] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:22:55 2021] POST /identity/v3/users => generated 291 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:22:55.844774 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1065/2136] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:22:55 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 29 20:22:55.845771 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4d0ff-c775-4457-8761-e2acc42bcbd5 service neutron] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:55.856236 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff4d0ff-c775-4457-8761-e2acc42bcbd5 service neutron] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:55.862029 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac371e9-fa75-41b8-af99-eed1ce8530e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:55.862598 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac371e9-fa75-41b8-af99-eed1ce8530e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:55.863283 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac371e9-fa75-41b8-af99-eed1ce8530e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:55.863583 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac371e9-fa75-41b8-af99-eed1ce8530e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:55.864910 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac371e9-fa75-41b8-af99-eed1ce8530e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:55.866836 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac371e9-fa75-41b8-af99-eed1ce8530e2 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:55.878907 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1066/2137] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:22:55 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:22:55.883662 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee3909-613c-4973-9e31-0296a2389878 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:55.894731 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cee3909-613c-4973-9e31-0296a2389878 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:55.902433 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d2dc7-1f9d-4ffe-a433-0f0b04aa9dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:55.903556 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d2dc7-1f9d-4ffe-a433-0f0b04aa9dc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:55.903841 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d2dc7-1f9d-4ffe-a433-0f0b04aa9dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:55.904277 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d2dc7-1f9d-4ffe-a433-0f0b04aa9dc3 admin admin] PATH_INFO: `/v3/projects/bb13166718ee477fbbb8a0f8169bbb6e/users/51b3314c41e748faa65f64184c5781b8/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:55.924917 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d2dc7-1f9d-4ffe-a433-0f0b04aa9dc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb13166718ee477fbbb8a0f8169bbb6e, user_id=51b3314c41e748faa65f64184c5781b8, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:55.929048 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1d2dc7-1f9d-4ffe-a433-0f0b04aa9dc3 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:55.950802 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1072/2138] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:22:55 2021] PUT /identity/v3/projects/bb13166718ee477fbbb8a0f8169bbb6e/users/51b3314c41e748faa65f64184c5781b8/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:22:55.952133 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac371e9-fa75-41b8-af99-eed1ce8530e2 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:55.980277 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac371e9-fa75-41b8-af99-eed1ce8530e2 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:56.064961 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681b50b-cd94-496b-b460-f9c1aa494b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:56.065850 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681b50b-cd94-496b-b460-f9c1aa494b99 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:56.066276 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681b50b-cd94-496b-b460-f9c1aa494b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:56.066695 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681b50b-cd94-496b-b460-f9c1aa494b99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:56.067657 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681b50b-cd94-496b-b460-f9c1aa494b99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:56.069409 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4681b50b-cd94-496b-b460-f9c1aa494b99 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:56.081285 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1067/2139] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:22:55 2021] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:22:56.087289 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d2dc7-1f9d-4ffe-a433-0f0b04aa9dc3 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:56.097906 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d2dc7-1f9d-4ffe-a433-0f0b04aa9dc3 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:56.103092 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52637f49-b5b3-470d-87d6-e8a89f9b29a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:56.104087 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52637f49-b5b3-470d-87d6-e8a89f9b29a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:56.104606 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52637f49-b5b3-470d-87d6-e8a89f9b29a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:56.104930 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52637f49-b5b3-470d-87d6-e8a89f9b29a8 admin admin] PATH_INFO: `/v3/projects/bb13166718ee477fbbb8a0f8169bbb6e/users/51b3314c41e748faa65f64184c5781b8/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:56.107208 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52637f49-b5b3-470d-87d6-e8a89f9b29a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb13166718ee477fbbb8a0f8169bbb6e, user_id=51b3314c41e748faa65f64184c5781b8, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:56.109888 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52637f49-b5b3-470d-87d6-e8a89f9b29a8 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:56.121602 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1073/2140] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:22:56 2021] PUT /identity/v3/projects/bb13166718ee477fbbb8a0f8169bbb6e/users/51b3314c41e748faa65f64184c5781b8/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:22:56.131992 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02375921-27fb-426f-aa8f-fbc6a9962e6b None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:56.132272 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02375921-27fb-426f-aa8f-fbc6a9962e6b None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:56.132676 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02375921-27fb-426f-aa8f-fbc6a9962e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:56.169109 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-02375921-27fb-426f-aa8f-fbc6a9962e6b None None] MFA Rules not processed for user `51b3314c41e748faa65f64184c5781b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:22:56.170593 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-02375921-27fb-426f-aa8f-fbc6a9962e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:56.180269 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52637f49-b5b3-470d-87d6-e8a89f9b29a8 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:56.182137 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-52637f49-b5b3-470d-87d6-e8a89f9b29a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:56.250008 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1068/2141] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:22:56 2021] POST /identity/v3/auth/tokens => generated 3303 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:22:56.258941 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52637f49-b5b3-470d-87d6-e8a89f9b29a8 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:56.260249 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02375921-27fb-426f-aa8f-fbc6a9962e6b None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:56.261606 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-02375921-27fb-426f-aa8f-fbc6a9962e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:56.264843 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7de3e8-ea3d-4871-a270-f1fdcb17c82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:56.267942 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7de3e8-ea3d-4871-a270-f1fdcb17c82d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:56.267942 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7de3e8-ea3d-4871-a270-f1fdcb17c82d admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:56.268591 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7de3e8-ea3d-4871-a270-f1fdcb17c82d admin admin] PATH_INFO: `/v3/projects/b78af647c6564dba9ca715fa3053763a` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:56.269965 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7de3e8-ea3d-4871-a270-f1fdcb17c82d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b78af647c6564dba9ca715fa3053763a)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:56.272010 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7de3e8-ea3d-4871-a270-f1fdcb17c82d admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:56.319318 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02375921-27fb-426f-aa8f-fbc6a9962e6b None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:56.319884 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ab7de3e8-ea3d-4871-a270-f1fdcb17c82d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b78af647c6564dba9ca715fa3053763a', 'request_id': 'req-ab7de3e8-ea3d-4871-a270-f1fdcb17c82d'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:56.326189 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ab7de3e8-ea3d-4871-a270-f1fdcb17c82d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b78af647c6564dba9ca715fa3053763a', 'request_id': 'req-ab7de3e8-ea3d-4871-a270-f1fdcb17c82d'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:56.335260 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ab7de3e8-ea3d-4871-a270-f1fdcb17c82d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b78af647c6564dba9ca715fa3053763a', 'request_id': 'req-ab7de3e8-ea3d-4871-a270-f1fdcb17c82d'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:56.345660 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ab7de3e8-ea3d-4871-a270-f1fdcb17c82d admin admin] The token cache is being invalidate because project b78af647c6564dba9ca715fa3053763a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:22:56.345950 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ab7de3e8-ea3d-4871-a270-f1fdcb17c82d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:56.346590 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ab7de3e8-ea3d-4871-a270-f1fdcb17c82d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:22:56.348182 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1074/2142] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:22:56 2021] DELETE /identity/v3/projects/b78af647c6564dba9ca715fa3053763a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:22:56.353770 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b63907-fc91-4c45-8050-e3561e549ce8 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:56.354058 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b63907-fc91-4c45-8050-e3561e549ce8 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:56.354337 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b63907-fc91-4c45-8050-e3561e549ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:56.366731 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a155af-d990-4936-8b7d-a404222bc0d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:56.367330 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a155af-d990-4936-8b7d-a404222bc0d1 service cinder] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:56.367608 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a155af-d990-4936-8b7d-a404222bc0d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:56.367879 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a155af-d990-4936-8b7d-a404222bc0d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:56.369649 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-46a155af-d990-4936-8b7d-a404222bc0d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:56.371971 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-26b63907-fc91-4c45-8050-e3561e549ce8 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:22:56.373295 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-26b63907-fc91-4c45-8050-e3561e549ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:56.429708 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1075/2143] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:22:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:22:56.438290 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfd46c-d5e0-4237-830a-8033600e52d0 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:56.438571 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfd46c-d5e0-4237-830a-8033600e52d0 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:56.438862 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfd46c-d5e0-4237-830a-8033600e52d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:56.439160 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a155af-d990-4936-8b7d-a404222bc0d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:56.440781 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a155af-d990-4936-8b7d-a404222bc0d1 service cinder] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:56.451488 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1069/2144] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:22:56 2021] GET /identity/v3/auth/tokens => generated 3303 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 29 20:22:56.457148 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-b5cfd46c-d5e0-4237-830a-8033600e52d0 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:22:56.458403 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-b5cfd46c-d5e0-4237-830a-8033600e52d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:56.467355 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1076/2145] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:22:56 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:22:56.472133 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a155af-d990-4936-8b7d-a404222bc0d1 service cinder] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:56.485239 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a155af-d990-4936-8b7d-a404222bc0d1 service cinder] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:56.495387 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a78b6-65c5-44a2-a882-2a557484f774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:56.496159 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a78b6-65c5-44a2-a882-2a557484f774 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:56.496625 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a78b6-65c5-44a2-a882-2a557484f774 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:56.496858 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a78b6-65c5-44a2-a882-2a557484f774 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:56.497704 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a78b6-65c5-44a2-a882-2a557484f774 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:22:56.498210 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a78b6-65c5-44a2-a882-2a557484f774 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:56.500064 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0a78b6-65c5-44a2-a882-2a557484f774 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:56.501292 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cfd46c-d5e0-4237-830a-8033600e52d0 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:56.502711 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-b5cfd46c-d5e0-4237-830a-8033600e52d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:56.512518 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1070/2146] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:22:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:22:56.515320 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cfd46c-d5e0-4237-830a-8033600e52d0 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:56.517688 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a78b6-65c5-44a2-a882-2a557484f774 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:56.519813 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67422975-4ee4-493d-a27c-43cd944fc3e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:56.520499 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67422975-4ee4-493d-a27c-43cd944fc3e1 service cinder] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:56.520854 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67422975-4ee4-493d-a27c-43cd944fc3e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:56.521199 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67422975-4ee4-493d-a27c-43cd944fc3e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:56.523119 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-67422975-4ee4-493d-a27c-43cd944fc3e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:56.527623 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0a78b6-65c5-44a2-a882-2a557484f774 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:56.532443 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a6582-3211-44a3-a2a2-37f286e0b696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:56.533089 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a6582-3211-44a3-a2a2-37f286e0b696 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:56.533361 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a6582-3211-44a3-a2a2-37f286e0b696 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:56.533628 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a6582-3211-44a3-a2a2-37f286e0b696 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:56.534352 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a6582-3211-44a3-a2a2-37f286e0b696 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:56.536497 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a6582-3211-44a3-a2a2-37f286e0b696 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:56.567484 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1071/2147] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:22:56 2021] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:22:56.571320 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a6582-3211-44a3-a2a2-37f286e0b696 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:56.593199 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67422975-4ee4-493d-a27c-43cd944fc3e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:56.594716 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67422975-4ee4-493d-a27c-43cd944fc3e1 service cinder] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:56.605661 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1077/2148] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:22:56 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 29 20:22:56.637848 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a6582-3211-44a3-a2a2-37f286e0b696 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:56.642951 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a77d92-831d-4a12-93f6-731e72d0e511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:56.643969 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a77d92-831d-4a12-93f6-731e72d0e511 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:56.644244 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a77d92-831d-4a12-93f6-731e72d0e511 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:56.644511 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a77d92-831d-4a12-93f6-731e72d0e511 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:56.645215 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a77d92-831d-4a12-93f6-731e72d0e511 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:56.647177 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a77d92-831d-4a12-93f6-731e72d0e511 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:56.671112 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1072/2149] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:22:56 2021] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 29 20:22:56.672268 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67422975-4ee4-493d-a27c-43cd944fc3e1 service cinder] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:56.682796 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67422975-4ee4-493d-a27c-43cd944fc3e1 service cinder] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:56.687501 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9e65c-651d-4fb4-9045-2afc95a359c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:56.688162 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9e65c-651d-4fb4-9045-2afc95a359c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:56.688436 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9e65c-651d-4fb4-9045-2afc95a359c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:56.688736 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9e65c-651d-4fb4-9045-2afc95a359c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:56.689456 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d9e65c-651d-4fb4-9045-2afc95a359c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:56.691528 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d9e65c-651d-4fb4-9045-2afc95a359c1 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:56.703621 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1078/2150] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:22:56 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:22:56.704953 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a77d92-831d-4a12-93f6-731e72d0e511 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:56.714487 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a77d92-831d-4a12-93f6-731e72d0e511 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:56.719163 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdfbcd-3c91-475b-9395-a9cf485a816e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:56.719821 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdfbcd-3c91-475b-9395-a9cf485a816e admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:56.720094 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdfbcd-3c91-475b-9395-a9cf485a816e admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:56.720359 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdfbcd-3c91-475b-9395-a9cf485a816e admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:56.721083 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fdfbcd-3c91-475b-9395-a9cf485a816e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:56.722675 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fdfbcd-3c91-475b-9395-a9cf485a816e admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:56.732923 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1073/2151] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:22:56 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:22:56.737078 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9e65c-651d-4fb4-9045-2afc95a359c1 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:56.748744 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9e65c-651d-4fb4-9045-2afc95a359c1 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:56.754286 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ee0ad-23a1-4609-b24e-4021f16edc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:56.755299 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ee0ad-23a1-4609-b24e-4021f16edc7e admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:56.755584 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ee0ad-23a1-4609-b24e-4021f16edc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:56.755861 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ee0ad-23a1-4609-b24e-4021f16edc7e admin admin] PATH_INFO: `/v3/projects/d0593cc3827f49c692cfaf5e31e792eb/users/218c58c38edd49d98aa798975c0a7a43/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:56.772995 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ee0ad-23a1-4609-b24e-4021f16edc7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0593cc3827f49c692cfaf5e31e792eb, user_id=218c58c38edd49d98aa798975c0a7a43, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:56.775724 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ee0ad-23a1-4609-b24e-4021f16edc7e admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:56.788993 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1079/2152] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:22:56 2021] PUT /identity/v3/projects/d0593cc3827f49c692cfaf5e31e792eb/users/218c58c38edd49d98aa798975c0a7a43/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:22:56.800060 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70d7c0-6dbc-4aba-a890-1c7bcde54f6b None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:56.800523 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70d7c0-6dbc-4aba-a890-1c7bcde54f6b None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:56.800790 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70d7c0-6dbc-4aba-a890-1c7bcde54f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:56.830310 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-6a70d7c0-6dbc-4aba-a890-1c7bcde54f6b None None] MFA Rules not processed for user `218c58c38edd49d98aa798975c0a7a43`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:22:56.831602 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-6a70d7c0-6dbc-4aba-a890-1c7bcde54f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:56.906324 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1074/2153] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:22:56 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:22:56.916980 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ee0ad-23a1-4609-b24e-4021f16edc7e admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:56.969573 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ee0ad-23a1-4609-b24e-4021f16edc7e admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:56.973147 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95329ea7-2aa8-4c9e-9ba6-b21265dc1a80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:56.973791 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95329ea7-2aa8-4c9e-9ba6-b21265dc1a80 service cinder] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:56.974071 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95329ea7-2aa8-4c9e-9ba6-b21265dc1a80 service cinder] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:56.974343 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95329ea7-2aa8-4c9e-9ba6-b21265dc1a80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:56.982386 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95329ea7-2aa8-4c9e-9ba6-b21265dc1a80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:56.983853 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95329ea7-2aa8-4c9e-9ba6-b21265dc1a80 service cinder] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:22:56.992433 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1080/2154] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:22:56 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:22:59.876551 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70d7c0-6dbc-4aba-a890-1c7bcde54f6b None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:22:59.878015 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-6a70d7c0-6dbc-4aba-a890-1c7bcde54f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:22:59.944681 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70d7c0-6dbc-4aba-a890-1c7bcde54f6b None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:22:59.950143 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5747cd-a63b-44fb-8ccc-b26fdd59d810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:22:59.951174 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5747cd-a63b-44fb-8ccc-b26fdd59d810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:22:59.951488 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5747cd-a63b-44fb-8ccc-b26fdd59d810 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:22:59.951851 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5747cd-a63b-44fb-8ccc-b26fdd59d810 admin admin] PATH_INFO: `/v3/users/edd20694b6a5416f8fd96424141a9c98` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:22:59.953338 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5747cd-a63b-44fb-8ccc-b26fdd59d810 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edd20694b6a5416f8fd96424141a9c98)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:22:59.955305 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5747cd-a63b-44fb-8ccc-b26fdd59d810 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:00.015500 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-0c5747cd-a63b-44fb-8ccc-b26fdd59d810 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edd20694b6a5416f8fd96424141a9c98'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:00.022691 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-0c5747cd-a63b-44fb-8ccc-b26fdd59d810 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edd20694b6a5416f8fd96424141a9c98'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:00.034320 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-0c5747cd-a63b-44fb-8ccc-b26fdd59d810 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edd20694b6a5416f8fd96424141a9c98'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:00.035411 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-0c5747cd-a63b-44fb-8ccc-b26fdd59d810 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edd20694b6a5416f8fd96424141a9c98'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:00.036021 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-0c5747cd-a63b-44fb-8ccc-b26fdd59d810 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edd20694b6a5416f8fd96424141a9c98'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:00.050381 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1075/2155] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:22:59 2021] DELETE /identity/v3/users/edd20694b6a5416f8fd96424141a9c98 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:23:00.055041 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4f391-a7c7-4513-8623-10e019802a98 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:00.055557 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4f391-a7c7-4513-8623-10e019802a98 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:00.055735 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f4f391-a7c7-4513-8623-10e019802a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:00.073520 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-68f4f391-a7c7-4513-8623-10e019802a98 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:23:00.074823 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-68f4f391-a7c7-4513-8623-10e019802a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:00.134086 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1081/2156] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:23:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:23:00.144748 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5747cd-a63b-44fb-8ccc-b26fdd59d810 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:00.146893 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-0c5747cd-a63b-44fb-8ccc-b26fdd59d810 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:00.204968 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5747cd-a63b-44fb-8ccc-b26fdd59d810 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:00.209110 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ed9ca-e008-4170-85ce-2a9ef225362e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:00.209745 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ed9ca-e008-4170-85ce-2a9ef225362e service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:00.210020 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ed9ca-e008-4170-85ce-2a9ef225362e service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:00.210257 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ed9ca-e008-4170-85ce-2a9ef225362e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:00.219566 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9ed9ca-e008-4170-85ce-2a9ef225362e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:00.220986 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9ed9ca-e008-4170-85ce-2a9ef225362e service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:00.230363 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1076/2157] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:23:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:23:00.495232 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4f391-a7c7-4513-8623-10e019802a98 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:00.505209 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-68f4f391-a7c7-4513-8623-10e019802a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:00.514925 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f4f391-a7c7-4513-8623-10e019802a98 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:00.520133 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d4636-a68a-471d-b83f-1a9ff1982d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:00.521220 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d4636-a68a-471d-b83f-1a9ff1982d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:00.521322 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d4636-a68a-471d-b83f-1a9ff1982d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:00.521569 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d4636-a68a-471d-b83f-1a9ff1982d99 admin admin] PATH_INFO: `/v3/projects/b4e21b30ef254f0899c652912ed2b84d` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:00.522752 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d4636-a68a-471d-b83f-1a9ff1982d99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4e21b30ef254f0899c652912ed2b84d)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:00.524699 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d4636-a68a-471d-b83f-1a9ff1982d99 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:00.570161 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-d75d4636-a68a-471d-b83f-1a9ff1982d99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4e21b30ef254f0899c652912ed2b84d', 'request_id': 'req-d75d4636-a68a-471d-b83f-1a9ff1982d99'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:00.576598 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-d75d4636-a68a-471d-b83f-1a9ff1982d99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4e21b30ef254f0899c652912ed2b84d', 'request_id': 'req-d75d4636-a68a-471d-b83f-1a9ff1982d99'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:00.587055 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-d75d4636-a68a-471d-b83f-1a9ff1982d99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4e21b30ef254f0899c652912ed2b84d', 'request_id': 'req-d75d4636-a68a-471d-b83f-1a9ff1982d99'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:00.604226 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-d75d4636-a68a-471d-b83f-1a9ff1982d99 admin admin] The token cache is being invalidate because project b4e21b30ef254f0899c652912ed2b84d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:23:00.604667 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-d75d4636-a68a-471d-b83f-1a9ff1982d99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:00.605835 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-d75d4636-a68a-471d-b83f-1a9ff1982d99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:00.608075 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1082/2158] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:23:00 2021] DELETE /identity/v3/projects/b4e21b30ef254f0899c652912ed2b84d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:23:00.612238 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ed9ca-e008-4170-85ce-2a9ef225362e service neutron] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:00.622600 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ed9ca-e008-4170-85ce-2a9ef225362e service neutron] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:00.685787 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3814c-3410-4a9b-93c7-5e01967680e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:00.686628 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3814c-3410-4a9b-93c7-5e01967680e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:00.686959 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3814c-3410-4a9b-93c7-5e01967680e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:00.687249 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3814c-3410-4a9b-93c7-5e01967680e3 admin admin] PATH_INFO: `/v3/users/51b3314c41e748faa65f64184c5781b8` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:00.688492 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc3814c-3410-4a9b-93c7-5e01967680e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51b3314c41e748faa65f64184c5781b8)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:00.690529 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc3814c-3410-4a9b-93c7-5e01967680e3 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:00.742886 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-ccc3814c-3410-4a9b-93c7-5e01967680e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51b3314c41e748faa65f64184c5781b8'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:00.749744 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-ccc3814c-3410-4a9b-93c7-5e01967680e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51b3314c41e748faa65f64184c5781b8'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:00.761123 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-ccc3814c-3410-4a9b-93c7-5e01967680e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51b3314c41e748faa65f64184c5781b8'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:00.761849 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-ccc3814c-3410-4a9b-93c7-5e01967680e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51b3314c41e748faa65f64184c5781b8'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:00.762507 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-ccc3814c-3410-4a9b-93c7-5e01967680e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51b3314c41e748faa65f64184c5781b8'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:00.777882 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1077/2159] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:23:00 2021] DELETE /identity/v3/users/51b3314c41e748faa65f64184c5781b8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:23:01.052074 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d4636-a68a-471d-b83f-1a9ff1982d99 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:01.054078 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-d75d4636-a68a-471d-b83f-1a9ff1982d99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:01.072478 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d4636-a68a-471d-b83f-1a9ff1982d99 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:01.132717 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e84566-8d25-4015-a402-6ece576a978a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:01.133577 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e84566-8d25-4015-a402-6ece576a978a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:01.133854 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e84566-8d25-4015-a402-6ece576a978a admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:01.134152 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e84566-8d25-4015-a402-6ece576a978a admin admin] PATH_INFO: `/v3/projects/bb13166718ee477fbbb8a0f8169bbb6e` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:01.135357 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e84566-8d25-4015-a402-6ece576a978a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb13166718ee477fbbb8a0f8169bbb6e)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:01.137248 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e84566-8d25-4015-a402-6ece576a978a admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:01.185971 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-a7e84566-8d25-4015-a402-6ece576a978a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb13166718ee477fbbb8a0f8169bbb6e', 'request_id': 'req-a7e84566-8d25-4015-a402-6ece576a978a'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:01.192079 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-a7e84566-8d25-4015-a402-6ece576a978a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb13166718ee477fbbb8a0f8169bbb6e', 'request_id': 'req-a7e84566-8d25-4015-a402-6ece576a978a'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:01.201750 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-a7e84566-8d25-4015-a402-6ece576a978a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb13166718ee477fbbb8a0f8169bbb6e', 'request_id': 'req-a7e84566-8d25-4015-a402-6ece576a978a'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:01.212869 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-a7e84566-8d25-4015-a402-6ece576a978a admin admin] The token cache is being invalidate because project bb13166718ee477fbbb8a0f8169bbb6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:23:01.213169 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-a7e84566-8d25-4015-a402-6ece576a978a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:01.213868 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-a7e84566-8d25-4015-a402-6ece576a978a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:01.215507 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1083/2160] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:23:01 2021] DELETE /identity/v3/projects/bb13166718ee477fbbb8a0f8169bbb6e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:23:01.221293 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05a99c-7745-4b85-ae71-9c04ec674bed None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:01.221785 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05a99c-7745-4b85-ae71-9c04ec674bed None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:01.221892 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05a99c-7745-4b85-ae71-9c04ec674bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:01.239550 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-ee05a99c-7745-4b85-ae71-9c04ec674bed None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:23:01.240731 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-ee05a99c-7745-4b85-ae71-9c04ec674bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:01.296892 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1078/2161] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:23:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:23:01.305782 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a022d78-7350-4bda-ad28-c559c53c3e79 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:01.306068 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a022d78-7350-4bda-ad28-c559c53c3e79 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:01.306324 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a022d78-7350-4bda-ad28-c559c53c3e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:01.326233 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-6a022d78-7350-4bda-ad28-c559c53c3e79 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:23:01.327529 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-6a022d78-7350-4bda-ad28-c559c53c3e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:01.337351 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1084/2162] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:23:01 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:23:01.341548 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05a99c-7745-4b85-ae71-9c04ec674bed None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:01.352876 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05a99c-7745-4b85-ae71-9c04ec674bed None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:01.359217 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ebad8-9f8e-4441-8ae9-ae4a056198d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:01.359885 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ebad8-9f8e-4441-8ae9-ae4a056198d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:01.360169 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ebad8-9f8e-4441-8ae9-ae4a056198d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:01.360445 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29ebad8-9f8e-4441-8ae9-ae4a056198d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:01.361185 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ebad8-9f8e-4441-8ae9-ae4a056198d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:23:01.361493 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ebad8-9f8e-4441-8ae9-ae4a056198d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:01.363129 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29ebad8-9f8e-4441-8ae9-ae4a056198d7 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:01.374897 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1079/2163] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:23:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:23:01.379208 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a022d78-7350-4bda-ad28-c559c53c3e79 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:01.388300 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a022d78-7350-4bda-ad28-c559c53c3e79 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:01.393657 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9a033-aeaa-4337-99e3-45aff8efaf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:01.394298 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9a033-aeaa-4337-99e3-45aff8efaf02 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:01.394573 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9a033-aeaa-4337-99e3-45aff8efaf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:01.394840 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9a033-aeaa-4337-99e3-45aff8efaf02 admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:01.395577 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be9a033-aeaa-4337-99e3-45aff8efaf02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:01.397454 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be9a033-aeaa-4337-99e3-45aff8efaf02 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:01.423007 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1085/2164] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:23:01 2021] POST /identity/v3/projects => generated 379 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 29 20:23:01.427216 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ebad8-9f8e-4441-8ae9-ae4a056198d7 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:01.437555 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29ebad8-9f8e-4441-8ae9-ae4a056198d7 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:01.500531 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c0c0f-982b-4163-9768-92dfc9c1f190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:01.501205 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c0c0f-982b-4163-9768-92dfc9c1f190 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:01.501485 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c0c0f-982b-4163-9768-92dfc9c1f190 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:01.501761 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c0c0f-982b-4163-9768-92dfc9c1f190 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:01.502461 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c0c0f-982b-4163-9768-92dfc9c1f190 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:01.504441 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c0c0f-982b-4163-9768-92dfc9c1f190 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:01.529248 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1080/2165] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:23:01 2021] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:23:01.534207 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9a033-aeaa-4337-99e3-45aff8efaf02 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:01.545405 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be9a033-aeaa-4337-99e3-45aff8efaf02 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:01.560254 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3faf2a8-cbc3-4f86-bf98-c36faf40133a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:01.561077 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3faf2a8-cbc3-4f86-bf98-c36faf40133a admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:01.561362 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3faf2a8-cbc3-4f86-bf98-c36faf40133a admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:01.561848 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3faf2a8-cbc3-4f86-bf98-c36faf40133a admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:01.562435 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3faf2a8-cbc3-4f86-bf98-c36faf40133a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:01.564162 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3faf2a8-cbc3-4f86-bf98-c36faf40133a admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:01.576013 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1086/2166] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:23:01 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:23:01.580155 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c0c0f-982b-4163-9768-92dfc9c1f190 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:01.594143 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c0c0f-982b-4163-9768-92dfc9c1f190 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:01.601006 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5e6b7-ff4a-4971-8ef8-062244edc21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:01.601938 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5e6b7-ff4a-4971-8ef8-062244edc21c admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:01.602299 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5e6b7-ff4a-4971-8ef8-062244edc21c admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:01.602746 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5e6b7-ff4a-4971-8ef8-062244edc21c admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:01.603602 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5e6b7-ff4a-4971-8ef8-062244edc21c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:01.605822 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5e6b7-ff4a-4971-8ef8-062244edc21c admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:01.622190 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1081/2167] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:23:01 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:23:01.626480 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3faf2a8-cbc3-4f86-bf98-c36faf40133a admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:01.637743 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3faf2a8-cbc3-4f86-bf98-c36faf40133a admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:01.643096 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e13a1-5d06-4dfd-8888-bf6b80179ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:01.644364 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e13a1-5d06-4dfd-8888-bf6b80179ad5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:01.644708 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e13a1-5d06-4dfd-8888-bf6b80179ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:01.644983 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e13a1-5d06-4dfd-8888-bf6b80179ad5 admin admin] PATH_INFO: `/v3/projects/2048b0ae820b417aa94d3ef1c98c8c9b/users/63046d419fbf4114a70c1377754198db/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:01.660246 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e13a1-5d06-4dfd-8888-bf6b80179ad5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2048b0ae820b417aa94d3ef1c98c8c9b, user_id=63046d419fbf4114a70c1377754198db, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:01.663016 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e13a1-5d06-4dfd-8888-bf6b80179ad5 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:01.681091 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1087/2168] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:23:01 2021] PUT /identity/v3/projects/2048b0ae820b417aa94d3ef1c98c8c9b/users/63046d419fbf4114a70c1377754198db/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:23:01.691249 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921a76c-ab0b-48ce-8baf-bf9625e6b292 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:01.691748 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921a76c-ab0b-48ce-8baf-bf9625e6b292 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:01.692095 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921a76c-ab0b-48ce-8baf-bf9625e6b292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:01.721704 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-b921a76c-ab0b-48ce-8baf-bf9625e6b292 None None] MFA Rules not processed for user `63046d419fbf4114a70c1377754198db`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:23:01.723222 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-b921a76c-ab0b-48ce-8baf-bf9625e6b292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:01.788616 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1082/2169] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:23:01 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:23:01.793541 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e13a1-5d06-4dfd-8888-bf6b80179ad5 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:01.862448 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e13a1-5d06-4dfd-8888-bf6b80179ad5 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:01.867328 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bab9ce-6bc2-41c8-8631-54a9a4940838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:01.868101 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bab9ce-6bc2-41c8-8631-54a9a4940838 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:01.868409 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bab9ce-6bc2-41c8-8631-54a9a4940838 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:01.868680 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bab9ce-6bc2-41c8-8631-54a9a4940838 admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:01.869392 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bab9ce-6bc2-41c8-8631-54a9a4940838 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:01.871344 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bab9ce-6bc2-41c8-8631-54a9a4940838 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:01.901145 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1088/2170] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:23:01 2021] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:23:01.902455 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921a76c-ab0b-48ce-8baf-bf9625e6b292 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:01.913771 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921a76c-ab0b-48ce-8baf-bf9625e6b292 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:01.979158 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66641cd6-d573-4fa9-a224-bd37bf6f9e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:01.980146 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66641cd6-d573-4fa9-a224-bd37bf6f9e46 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:01.980550 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66641cd6-d573-4fa9-a224-bd37bf6f9e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:01.980957 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66641cd6-d573-4fa9-a224-bd37bf6f9e46 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:01.982243 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66641cd6-d573-4fa9-a224-bd37bf6f9e46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:01.984803 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66641cd6-d573-4fa9-a224-bd37bf6f9e46 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:02.005993 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1083/2171] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:23:01 2021] POST /identity/v3/users => generated 290 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:23:02.010160 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bab9ce-6bc2-41c8-8631-54a9a4940838 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:02.021000 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bab9ce-6bc2-41c8-8631-54a9a4940838 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:02.026568 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b9e40-1f15-450a-bc3b-cbdad0bb9771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:02.027249 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b9e40-1f15-450a-bc3b-cbdad0bb9771 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:02.027525 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b9e40-1f15-450a-bc3b-cbdad0bb9771 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:02.027798 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b9e40-1f15-450a-bc3b-cbdad0bb9771 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:02.028526 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b9e40-1f15-450a-bc3b-cbdad0bb9771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:02.030099 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b9e40-1f15-450a-bc3b-cbdad0bb9771 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:02.041173 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1089/2172] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:23:02 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:23:02.044891 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66641cd6-d573-4fa9-a224-bd37bf6f9e46 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:02.055212 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66641cd6-d573-4fa9-a224-bd37bf6f9e46 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:02.060182 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b45677-2d87-4bde-a2b4-961a122cc884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:02.060836 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b45677-2d87-4bde-a2b4-961a122cc884 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:02.061116 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b45677-2d87-4bde-a2b4-961a122cc884 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:02.061404 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b45677-2d87-4bde-a2b4-961a122cc884 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:02.062362 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b45677-2d87-4bde-a2b4-961a122cc884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:02.063964 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b45677-2d87-4bde-a2b4-961a122cc884 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:02.077317 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1084/2173] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:23:02 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:23:02.078461 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b9e40-1f15-450a-bc3b-cbdad0bb9771 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:02.088541 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b9e40-1f15-450a-bc3b-cbdad0bb9771 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:02.093585 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6700006-3c84-4ee1-8b05-5a93c81cfb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:02.094468 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6700006-3c84-4ee1-8b05-5a93c81cfb6b admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:02.094746 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6700006-3c84-4ee1-8b05-5a93c81cfb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:02.095054 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6700006-3c84-4ee1-8b05-5a93c81cfb6b admin admin] PATH_INFO: `/v3/projects/eb8eac6a89f140cdb35e225d696b6ba2/users/b8ed46cc4db34c12ba343b7d52227ba4/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:02.112481 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6700006-3c84-4ee1-8b05-5a93c81cfb6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb8eac6a89f140cdb35e225d696b6ba2, user_id=b8ed46cc4db34c12ba343b7d52227ba4, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:02.114629 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6700006-3c84-4ee1-8b05-5a93c81cfb6b admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:02.129150 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1090/2174] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:23:02 2021] PUT /identity/v3/projects/eb8eac6a89f140cdb35e225d696b6ba2/users/b8ed46cc4db34c12ba343b7d52227ba4/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:23:02.140493 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa8646-2f80-4345-8f97-a6b4e985900e None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:02.140783 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa8646-2f80-4345-8f97-a6b4e985900e None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:02.141058 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa8646-2f80-4345-8f97-a6b4e985900e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:02.167665 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-b1aa8646-2f80-4345-8f97-a6b4e985900e None None] MFA Rules not processed for user `b8ed46cc4db34c12ba343b7d52227ba4`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:23:02.168873 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-b1aa8646-2f80-4345-8f97-a6b4e985900e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:02.231837 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1085/2175] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:23:02 2021] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:23:02.236643 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6700006-3c84-4ee1-8b05-5a93c81cfb6b admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:02.302154 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6700006-3c84-4ee1-8b05-5a93c81cfb6b admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:02.307586 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad0df5-300d-4895-908e-9a0c7d823b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:02.308336 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad0df5-300d-4895-908e-9a0c7d823b40 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:02.308625 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad0df5-300d-4895-908e-9a0c7d823b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:02.308893 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad0df5-300d-4895-908e-9a0c7d823b40 admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:02.309662 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ad0df5-300d-4895-908e-9a0c7d823b40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:02.311650 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ad0df5-300d-4895-908e-9a0c7d823b40 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:02.343354 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1091/2176] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:23:02 2021] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:23:02.344684 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa8646-2f80-4345-8f97-a6b4e985900e None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:02.359371 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa8646-2f80-4345-8f97-a6b4e985900e None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:02.421938 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c8316a-39a5-47cd-b3f8-2de7210cc039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:02.422612 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8316a-39a5-47cd-b3f8-2de7210cc039 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:02.422951 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8316a-39a5-47cd-b3f8-2de7210cc039 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:02.423243 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8316a-39a5-47cd-b3f8-2de7210cc039 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:02.423956 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c8316a-39a5-47cd-b3f8-2de7210cc039 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:02.425852 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c8316a-39a5-47cd-b3f8-2de7210cc039 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:02.448314 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1086/2177] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:23:02 2021] POST /identity/v3/users => generated 295 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:23:02.450686 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad0df5-300d-4895-908e-9a0c7d823b40 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:02.463676 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad0df5-300d-4895-908e-9a0c7d823b40 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:02.471299 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145cc817-8517-4968-aa37-54f5859bd83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:02.471985 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145cc817-8517-4968-aa37-54f5859bd83b admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:02.472263 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145cc817-8517-4968-aa37-54f5859bd83b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:02.472786 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145cc817-8517-4968-aa37-54f5859bd83b admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:02.473918 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145cc817-8517-4968-aa37-54f5859bd83b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:02.476265 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145cc817-8517-4968-aa37-54f5859bd83b admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:02.487728 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1092/2178] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:23:02 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:23:02.494985 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c8316a-39a5-47cd-b3f8-2de7210cc039 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:02.505046 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c8316a-39a5-47cd-b3f8-2de7210cc039 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:02.509639 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c8f92-8a32-43cb-b89e-df25b69062b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:02.510524 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c8f92-8a32-43cb-b89e-df25b69062b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:02.510808 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c8f92-8a32-43cb-b89e-df25b69062b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:02.511116 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3c8f92-8a32-43cb-b89e-df25b69062b5 admin admin] PATH_INFO: `/v3/projects/d5af878379a84b8ebfc114cc94de4ca1/users/69530fb86317477c9871d998f4864cf5/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:02.525481 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3c8f92-8a32-43cb-b89e-df25b69062b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5af878379a84b8ebfc114cc94de4ca1, user_id=69530fb86317477c9871d998f4864cf5, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:02.528178 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3c8f92-8a32-43cb-b89e-df25b69062b5 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:02.543224 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1087/2179] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:23:02 2021] PUT /identity/v3/projects/d5af878379a84b8ebfc114cc94de4ca1/users/69530fb86317477c9871d998f4864cf5/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:23:02.547207 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145cc817-8517-4968-aa37-54f5859bd83b admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:02.558635 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145cc817-8517-4968-aa37-54f5859bd83b admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:02.620367 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68285be8-4537-485b-9b46-664449ba4832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:02.620962 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68285be8-4537-485b-9b46-664449ba4832 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:02.621236 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68285be8-4537-485b-9b46-664449ba4832 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:02.621528 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68285be8-4537-485b-9b46-664449ba4832 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:02.622290 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68285be8-4537-485b-9b46-664449ba4832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:02.623943 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68285be8-4537-485b-9b46-664449ba4832 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:02.634193 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1093/2180] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:23:02 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:23:02.638708 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c8f92-8a32-43cb-b89e-df25b69062b5 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:02.650144 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3c8f92-8a32-43cb-b89e-df25b69062b5 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:02.654990 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b0468-b3d2-4a5d-a0fe-a3cba61cd5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:02.655918 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b0468-b3d2-4a5d-a0fe-a3cba61cd5b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:02.656197 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b0468-b3d2-4a5d-a0fe-a3cba61cd5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:02.656493 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b0468-b3d2-4a5d-a0fe-a3cba61cd5b3 admin admin] PATH_INFO: `/v3/projects/d5af878379a84b8ebfc114cc94de4ca1/users/69530fb86317477c9871d998f4864cf5/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:02.658483 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b0468-b3d2-4a5d-a0fe-a3cba61cd5b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5af878379a84b8ebfc114cc94de4ca1, user_id=69530fb86317477c9871d998f4864cf5, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:02.661171 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b0468-b3d2-4a5d-a0fe-a3cba61cd5b3 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:02.671802 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1088/2181] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:23:02 2021] PUT /identity/v3/projects/d5af878379a84b8ebfc114cc94de4ca1/users/69530fb86317477c9871d998f4864cf5/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:23:02.682103 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb357f2-8d9e-4c5e-a7d5-d9049270b51e None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:02.682383 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb357f2-8d9e-4c5e-a7d5-d9049270b51e None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:02.682658 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb357f2-8d9e-4c5e-a7d5-d9049270b51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:02.710156 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-1eb357f2-8d9e-4c5e-a7d5-d9049270b51e None None] MFA Rules not processed for user `69530fb86317477c9871d998f4864cf5`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:23:02.711407 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-1eb357f2-8d9e-4c5e-a7d5-d9049270b51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:02.787443 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1094/2182] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:23:02 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:23:02.800099 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b0468-b3d2-4a5d-a0fe-a3cba61cd5b3 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:02.802244 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-6f2b0468-b3d2-4a5d-a0fe-a3cba61cd5b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:02.861828 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b0468-b3d2-4a5d-a0fe-a3cba61cd5b3 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:02.866573 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a46414-6b90-4efb-8a71-8ad358385f30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:02.867256 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a46414-6b90-4efb-8a71-8ad358385f30 service cinder] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:02.867546 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a46414-6b90-4efb-8a71-8ad358385f30 service cinder] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:02.867815 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a46414-6b90-4efb-8a71-8ad358385f30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:02.877661 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a46414-6b90-4efb-8a71-8ad358385f30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:02.879123 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a46414-6b90-4efb-8a71-8ad358385f30 service cinder] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:02.888604 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1089/2183] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:23:02 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:23:02.928721 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb357f2-8d9e-4c5e-a7d5-d9049270b51e None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:02.938695 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb357f2-8d9e-4c5e-a7d5-d9049270b51e None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:02.942699 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028af9be-3a7f-4ac9-a9f5-2d67090e253a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:02.943348 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028af9be-3a7f-4ac9-a9f5-2d67090e253a service cinder] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:02.943661 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028af9be-3a7f-4ac9-a9f5-2d67090e253a service cinder] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:02.943959 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028af9be-3a7f-4ac9-a9f5-2d67090e253a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:03.004450 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028af9be-3a7f-4ac9-a9f5-2d67090e253a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:03.005876 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028af9be-3a7f-4ac9-a9f5-2d67090e253a service cinder] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:03.015094 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1095/2184] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:23:02 2021] GET /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:23:04.677649 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a46414-6b90-4efb-8a71-8ad358385f30 service cinder] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:04.679215 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-f6a46414-6b90-4efb-8a71-8ad358385f30 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:04.769187 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a46414-6b90-4efb-8a71-8ad358385f30 service cinder] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:04.775063 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19057f66-f4ea-43dd-8cdc-30443f8d98e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:04.776049 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19057f66-f4ea-43dd-8cdc-30443f8d98e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:04.776448 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19057f66-f4ea-43dd-8cdc-30443f8d98e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:04.776650 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19057f66-f4ea-43dd-8cdc-30443f8d98e4 admin admin] PATH_INFO: `/v3/users/60f099ed17df46fa9920e0489dc7ba38` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:04.778166 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19057f66-f4ea-43dd-8cdc-30443f8d98e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60f099ed17df46fa9920e0489dc7ba38)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:04.781144 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19057f66-f4ea-43dd-8cdc-30443f8d98e4 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:04.848244 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-19057f66-f4ea-43dd-8cdc-30443f8d98e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60f099ed17df46fa9920e0489dc7ba38'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:04.856671 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-19057f66-f4ea-43dd-8cdc-30443f8d98e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60f099ed17df46fa9920e0489dc7ba38'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:04.871701 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-19057f66-f4ea-43dd-8cdc-30443f8d98e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60f099ed17df46fa9920e0489dc7ba38'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:04.872437 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-19057f66-f4ea-43dd-8cdc-30443f8d98e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60f099ed17df46fa9920e0489dc7ba38'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:04.873310 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-19057f66-f4ea-43dd-8cdc-30443f8d98e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60f099ed17df46fa9920e0489dc7ba38'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:04.892253 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1090/2185] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:23:04 2021] DELETE /identity/v3/users/60f099ed17df46fa9920e0489dc7ba38 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:23:04.894971 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e491d-a53a-4ac3-98a9-b4d331fa21d7 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:04.895478 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e491d-a53a-4ac3-98a9-b4d331fa21d7 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:04.895993 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e491d-a53a-4ac3-98a9-b4d331fa21d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:04.916048 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-223e491d-a53a-4ac3-98a9-b4d331fa21d7 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:23:04.917441 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-223e491d-a53a-4ac3-98a9-b4d331fa21d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:04.983171 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1096/2186] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:23:04 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:23:04.993523 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19057f66-f4ea-43dd-8cdc-30443f8d98e4 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:04.995214 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-19057f66-f4ea-43dd-8cdc-30443f8d98e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:05.066834 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19057f66-f4ea-43dd-8cdc-30443f8d98e4 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:05.077363 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7d111-1c53-408f-bddb-b4f1f2473225 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:05.078051 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7d111-1c53-408f-bddb-b4f1f2473225 service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:05.078390 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7d111-1c53-408f-bddb-b4f1f2473225 service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:05.080237 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7d111-1c53-408f-bddb-b4f1f2473225 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:05.091147 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee7d111-1c53-408f-bddb-b4f1f2473225 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:05.092966 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee7d111-1c53-408f-bddb-b4f1f2473225 service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:05.103281 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1091/2187] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:23:04 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:23:05.432889 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e491d-a53a-4ac3-98a9-b4d331fa21d7 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:05.434520 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-223e491d-a53a-4ac3-98a9-b4d331fa21d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:05.453466 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e491d-a53a-4ac3-98a9-b4d331fa21d7 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:05.465579 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26340f18-fd66-47e3-8e50-a6aaec6d3329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:05.466105 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26340f18-fd66-47e3-8e50-a6aaec6d3329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:05.466450 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26340f18-fd66-47e3-8e50-a6aaec6d3329 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:05.466793 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26340f18-fd66-47e3-8e50-a6aaec6d3329 admin admin] PATH_INFO: `/v3/projects/c545b6f25d9b47eeb083ca435ae5d316` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:05.468235 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26340f18-fd66-47e3-8e50-a6aaec6d3329 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c545b6f25d9b47eeb083ca435ae5d316)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:05.470369 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26340f18-fd66-47e3-8e50-a6aaec6d3329 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:05.524015 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-26340f18-fd66-47e3-8e50-a6aaec6d3329 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c545b6f25d9b47eeb083ca435ae5d316', 'request_id': 'req-26340f18-fd66-47e3-8e50-a6aaec6d3329'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:05.532534 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-26340f18-fd66-47e3-8e50-a6aaec6d3329 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c545b6f25d9b47eeb083ca435ae5d316', 'request_id': 'req-26340f18-fd66-47e3-8e50-a6aaec6d3329'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:05.541045 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-26340f18-fd66-47e3-8e50-a6aaec6d3329 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c545b6f25d9b47eeb083ca435ae5d316', 'request_id': 'req-26340f18-fd66-47e3-8e50-a6aaec6d3329'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:05.552585 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-26340f18-fd66-47e3-8e50-a6aaec6d3329 admin admin] The token cache is being invalidate because project c545b6f25d9b47eeb083ca435ae5d316 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:23:05.552987 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-26340f18-fd66-47e3-8e50-a6aaec6d3329 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:05.553877 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-26340f18-fd66-47e3-8e50-a6aaec6d3329 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:05.566358 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1097/2188] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:23:05 2021] DELETE /identity/v3/projects/c545b6f25d9b47eeb083ca435ae5d316 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:23:05.951089 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7d111-1c53-408f-bddb-b4f1f2473225 service neutron] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:05.952597 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-fee7d111-1c53-408f-bddb-b4f1f2473225 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:05.965803 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7d111-1c53-408f-bddb-b4f1f2473225 service neutron] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:06.025148 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb51dcf-4c64-4432-bbe7-c922f04864f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:06.026028 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb51dcf-4c64-4432-bbe7-c922f04864f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:06.026306 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb51dcf-4c64-4432-bbe7-c922f04864f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:06.026578 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb51dcf-4c64-4432-bbe7-c922f04864f7 admin admin] PATH_INFO: `/v3/users/63046d419fbf4114a70c1377754198db` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:06.027944 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb51dcf-4c64-4432-bbe7-c922f04864f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63046d419fbf4114a70c1377754198db)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:06.030033 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb51dcf-4c64-4432-bbe7-c922f04864f7 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:06.083177 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-3fb51dcf-4c64-4432-bbe7-c922f04864f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63046d419fbf4114a70c1377754198db'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:06.089847 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-3fb51dcf-4c64-4432-bbe7-c922f04864f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63046d419fbf4114a70c1377754198db'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:06.102719 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-3fb51dcf-4c64-4432-bbe7-c922f04864f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63046d419fbf4114a70c1377754198db'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:06.103567 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-3fb51dcf-4c64-4432-bbe7-c922f04864f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63046d419fbf4114a70c1377754198db'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:06.104425 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-3fb51dcf-4c64-4432-bbe7-c922f04864f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63046d419fbf4114a70c1377754198db'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:06.118671 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1092/2189] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:23:05 2021] DELETE /identity/v3/users/63046d419fbf4114a70c1377754198db => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:23:06.123238 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15266405-d839-4862-9762-ffd3ce4aed74 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:06.123718 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15266405-d839-4862-9762-ffd3ce4aed74 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:06.123808 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15266405-d839-4862-9762-ffd3ce4aed74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:06.141763 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-15266405-d839-4862-9762-ffd3ce4aed74 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:23:06.143005 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-15266405-d839-4862-9762-ffd3ce4aed74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:06.204551 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1098/2190] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:23:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:23:06.214570 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb51dcf-4c64-4432-bbe7-c922f04864f7 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:06.216119 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-3fb51dcf-4c64-4432-bbe7-c922f04864f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:06.286587 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb51dcf-4c64-4432-bbe7-c922f04864f7 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:06.290513 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f68239-cb7a-49d6-b8e9-fdffc8224264 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:06.291264 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f68239-cb7a-49d6-b8e9-fdffc8224264 service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:06.291617 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f68239-cb7a-49d6-b8e9-fdffc8224264 service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:06.291952 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f68239-cb7a-49d6-b8e9-fdffc8224264 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:06.302277 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f68239-cb7a-49d6-b8e9-fdffc8224264 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:06.303855 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f68239-cb7a-49d6-b8e9-fdffc8224264 service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:06.313927 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1093/2191] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:23:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 29 20:23:06.583020 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15266405-d839-4862-9762-ffd3ce4aed74 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:06.584928 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-15266405-d839-4862-9762-ffd3ce4aed74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:06.597755 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15266405-d839-4862-9762-ffd3ce4aed74 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:06.603481 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a305a86-5e07-4a9c-b2d5-fbb7fd7de05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:06.604087 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a305a86-5e07-4a9c-b2d5-fbb7fd7de05e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:06.604414 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a305a86-5e07-4a9c-b2d5-fbb7fd7de05e admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:06.604689 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a305a86-5e07-4a9c-b2d5-fbb7fd7de05e admin admin] PATH_INFO: `/v3/projects/2048b0ae820b417aa94d3ef1c98c8c9b` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:06.606027 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a305a86-5e07-4a9c-b2d5-fbb7fd7de05e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2048b0ae820b417aa94d3ef1c98c8c9b)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:06.608009 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a305a86-5e07-4a9c-b2d5-fbb7fd7de05e admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:06.657702 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-4a305a86-5e07-4a9c-b2d5-fbb7fd7de05e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2048b0ae820b417aa94d3ef1c98c8c9b', 'request_id': 'req-4a305a86-5e07-4a9c-b2d5-fbb7fd7de05e'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:06.664018 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-4a305a86-5e07-4a9c-b2d5-fbb7fd7de05e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2048b0ae820b417aa94d3ef1c98c8c9b', 'request_id': 'req-4a305a86-5e07-4a9c-b2d5-fbb7fd7de05e'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:06.671960 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-4a305a86-5e07-4a9c-b2d5-fbb7fd7de05e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2048b0ae820b417aa94d3ef1c98c8c9b', 'request_id': 'req-4a305a86-5e07-4a9c-b2d5-fbb7fd7de05e'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:06.682285 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-4a305a86-5e07-4a9c-b2d5-fbb7fd7de05e admin admin] The token cache is being invalidate because project 2048b0ae820b417aa94d3ef1c98c8c9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:23:06.682571 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-4a305a86-5e07-4a9c-b2d5-fbb7fd7de05e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:06.683211 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-4a305a86-5e07-4a9c-b2d5-fbb7fd7de05e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:06.684771 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1099/2192] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:23:06 2021] DELETE /identity/v3/projects/2048b0ae820b417aa94d3ef1c98c8c9b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:23:06.688789 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f68239-cb7a-49d6-b8e9-fdffc8224264 service neutron] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:06.698065 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f68239-cb7a-49d6-b8e9-fdffc8224264 service neutron] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:06.752572 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f7292-958f-449c-8a17-fe485f850bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:06.753444 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f7292-958f-449c-8a17-fe485f850bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:06.753719 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f7292-958f-449c-8a17-fe485f850bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:06.753989 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f7292-958f-449c-8a17-fe485f850bf8 admin admin] PATH_INFO: `/v3/users/b8ed46cc4db34c12ba343b7d52227ba4` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:06.755291 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f7292-958f-449c-8a17-fe485f850bf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8ed46cc4db34c12ba343b7d52227ba4)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:06.757231 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f7292-958f-449c-8a17-fe485f850bf8 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:06.831317 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-aa0f7292-958f-449c-8a17-fe485f850bf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8ed46cc4db34c12ba343b7d52227ba4'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:06.839583 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-aa0f7292-958f-449c-8a17-fe485f850bf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8ed46cc4db34c12ba343b7d52227ba4'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:06.850738 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-aa0f7292-958f-449c-8a17-fe485f850bf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8ed46cc4db34c12ba343b7d52227ba4'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:06.851529 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-aa0f7292-958f-449c-8a17-fe485f850bf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8ed46cc4db34c12ba343b7d52227ba4'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:06.852085 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-aa0f7292-958f-449c-8a17-fe485f850bf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8ed46cc4db34c12ba343b7d52227ba4'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:06.867228 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1094/2193] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:23:06 2021] DELETE /identity/v3/users/b8ed46cc4db34c12ba343b7d52227ba4 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:23:07.139396 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a305a86-5e07-4a9c-b2d5-fbb7fd7de05e admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:07.140993 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-4a305a86-5e07-4a9c-b2d5-fbb7fd7de05e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:07.154781 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a305a86-5e07-4a9c-b2d5-fbb7fd7de05e admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:07.215308 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fecc327-c286-40cc-9e59-7ebc871dad8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:07.216166 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecc327-c286-40cc-9e59-7ebc871dad8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:07.216445 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecc327-c286-40cc-9e59-7ebc871dad8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:07.216719 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecc327-c286-40cc-9e59-7ebc871dad8b admin admin] PATH_INFO: `/v3/projects/eb8eac6a89f140cdb35e225d696b6ba2` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:07.217966 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fecc327-c286-40cc-9e59-7ebc871dad8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb8eac6a89f140cdb35e225d696b6ba2)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:07.219937 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fecc327-c286-40cc-9e59-7ebc871dad8b admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:07.269126 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-3fecc327-c286-40cc-9e59-7ebc871dad8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb8eac6a89f140cdb35e225d696b6ba2', 'request_id': 'req-3fecc327-c286-40cc-9e59-7ebc871dad8b'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:07.275241 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-3fecc327-c286-40cc-9e59-7ebc871dad8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb8eac6a89f140cdb35e225d696b6ba2', 'request_id': 'req-3fecc327-c286-40cc-9e59-7ebc871dad8b'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:07.283436 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-3fecc327-c286-40cc-9e59-7ebc871dad8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb8eac6a89f140cdb35e225d696b6ba2', 'request_id': 'req-3fecc327-c286-40cc-9e59-7ebc871dad8b'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:07.293458 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-3fecc327-c286-40cc-9e59-7ebc871dad8b admin admin] The token cache is being invalidate because project eb8eac6a89f140cdb35e225d696b6ba2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:23:07.293736 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-3fecc327-c286-40cc-9e59-7ebc871dad8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:07.294384 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-3fecc327-c286-40cc-9e59-7ebc871dad8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:07.296008 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1100/2194] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:23:07 2021] DELETE /identity/v3/projects/eb8eac6a89f140cdb35e225d696b6ba2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:23:07.300219 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f7292-958f-449c-8a17-fe485f850bf8 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:07.301704 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-aa0f7292-958f-449c-8a17-fe485f850bf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:07.314630 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f7292-958f-449c-8a17-fe485f850bf8 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:07.373833 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b4822-85d3-4549-ae15-a8beb3b91b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:07.374715 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b4822-85d3-4549-ae15-a8beb3b91b9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:07.375023 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b4822-85d3-4549-ae15-a8beb3b91b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:07.375296 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b4822-85d3-4549-ae15-a8beb3b91b9d admin admin] PATH_INFO: `/v3/users/69530fb86317477c9871d998f4864cf5` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:07.376588 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b4822-85d3-4549-ae15-a8beb3b91b9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=69530fb86317477c9871d998f4864cf5)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:07.378510 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b4822-85d3-4549-ae15-a8beb3b91b9d admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:07.425230 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-f50b4822-85d3-4549-ae15-a8beb3b91b9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69530fb86317477c9871d998f4864cf5'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:07.432488 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-f50b4822-85d3-4549-ae15-a8beb3b91b9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69530fb86317477c9871d998f4864cf5'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:07.444888 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-f50b4822-85d3-4549-ae15-a8beb3b91b9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69530fb86317477c9871d998f4864cf5'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:07.445636 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-f50b4822-85d3-4549-ae15-a8beb3b91b9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69530fb86317477c9871d998f4864cf5'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:07.446268 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-f50b4822-85d3-4549-ae15-a8beb3b91b9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69530fb86317477c9871d998f4864cf5'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:07.460458 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1095/2195] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:23:07 2021] DELETE /identity/v3/users/69530fb86317477c9871d998f4864cf5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:23:07.729285 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fecc327-c286-40cc-9e59-7ebc871dad8b admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:07.730772 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-3fecc327-c286-40cc-9e59-7ebc871dad8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:07.744103 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fecc327-c286-40cc-9e59-7ebc871dad8b admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:07.804948 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92602d3e-5259-4fbd-8647-3f2c2ae4ecc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:07.805836 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92602d3e-5259-4fbd-8647-3f2c2ae4ecc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:07.806113 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92602d3e-5259-4fbd-8647-3f2c2ae4ecc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:07.806383 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92602d3e-5259-4fbd-8647-3f2c2ae4ecc4 admin admin] PATH_INFO: `/v3/projects/d5af878379a84b8ebfc114cc94de4ca1` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:07.807614 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92602d3e-5259-4fbd-8647-3f2c2ae4ecc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5af878379a84b8ebfc114cc94de4ca1)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:07.809573 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92602d3e-5259-4fbd-8647-3f2c2ae4ecc4 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:07.854833 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-92602d3e-5259-4fbd-8647-3f2c2ae4ecc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5af878379a84b8ebfc114cc94de4ca1', 'request_id': 'req-92602d3e-5259-4fbd-8647-3f2c2ae4ecc4'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:07.861125 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-92602d3e-5259-4fbd-8647-3f2c2ae4ecc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5af878379a84b8ebfc114cc94de4ca1', 'request_id': 'req-92602d3e-5259-4fbd-8647-3f2c2ae4ecc4'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:07.868450 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-92602d3e-5259-4fbd-8647-3f2c2ae4ecc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5af878379a84b8ebfc114cc94de4ca1', 'request_id': 'req-92602d3e-5259-4fbd-8647-3f2c2ae4ecc4'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:07.879681 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-92602d3e-5259-4fbd-8647-3f2c2ae4ecc4 admin admin] The token cache is being invalidate because project d5af878379a84b8ebfc114cc94de4ca1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:23:07.880412 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-92602d3e-5259-4fbd-8647-3f2c2ae4ecc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:07.880608 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-92602d3e-5259-4fbd-8647-3f2c2ae4ecc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:07.882178 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1101/2196] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:23:07 2021] DELETE /identity/v3/projects/d5af878379a84b8ebfc114cc94de4ca1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:23:07.888861 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b21c4-5674-4758-9b04-d73d3cb32d6f None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:07.889137 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b21c4-5674-4758-9b04-d73d3cb32d6f None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:07.889422 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b21c4-5674-4758-9b04-d73d3cb32d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:07.909341 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-c73b21c4-5674-4758-9b04-d73d3cb32d6f None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:23:07.910530 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-c73b21c4-5674-4758-9b04-d73d3cb32d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:07.970053 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1096/2197] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:23:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:23:07.978882 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71da5ff-600b-42c1-99e0-a87b341b70db None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:07.979169 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71da5ff-600b-42c1-99e0-a87b341b70db None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:07.979444 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71da5ff-600b-42c1-99e0-a87b341b70db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:07.999392 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-f71da5ff-600b-42c1-99e0-a87b341b70db None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:23:08.000711 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-f71da5ff-600b-42c1-99e0-a87b341b70db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:08.010273 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1102/2198] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:23:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:23:08.015454 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b21c4-5674-4758-9b04-d73d3cb32d6f None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:08.026821 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b21c4-5674-4758-9b04-d73d3cb32d6f None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:08.031799 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2d970-42b1-414d-b598-50060b97131f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:08.032573 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2d970-42b1-414d-b598-50060b97131f admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:08.032788 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2d970-42b1-414d-b598-50060b97131f admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:08.033078 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2d970-42b1-414d-b598-50060b97131f admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:08.033844 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2d970-42b1-414d-b598-50060b97131f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:23:08.034141 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2d970-42b1-414d-b598-50060b97131f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:08.035820 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2d970-42b1-414d-b598-50060b97131f admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:08.048610 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1097/2199] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:23:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:23:08.053552 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71da5ff-600b-42c1-99e0-a87b341b70db None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:08.063265 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71da5ff-600b-42c1-99e0-a87b341b70db None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:08.068184 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbdf820-35fa-4200-8daf-6d0ed11acf68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:08.068835 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdf820-35fa-4200-8daf-6d0ed11acf68 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:08.069115 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdf820-35fa-4200-8daf-6d0ed11acf68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:08.069384 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdf820-35fa-4200-8daf-6d0ed11acf68 admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:08.070098 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbdf820-35fa-4200-8daf-6d0ed11acf68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:08.072036 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbdf820-35fa-4200-8daf-6d0ed11acf68 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:08.101175 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1103/2200] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:23:08 2021] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 29 20:23:08.105409 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2d970-42b1-414d-b598-50060b97131f admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:08.116158 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2d970-42b1-414d-b598-50060b97131f admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:08.175080 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dcd0df-de96-4c22-b2e2-809d5a2a7d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:08.175743 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcd0df-de96-4c22-b2e2-809d5a2a7d5c admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:08.176020 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcd0df-de96-4c22-b2e2-809d5a2a7d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:08.176314 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcd0df-de96-4c22-b2e2-809d5a2a7d5c admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:08.177012 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dcd0df-de96-4c22-b2e2-809d5a2a7d5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:08.178937 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dcd0df-de96-4c22-b2e2-809d5a2a7d5c admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:08.199153 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1098/2201] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:23:08 2021] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 29 20:23:08.203438 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbdf820-35fa-4200-8daf-6d0ed11acf68 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:08.214174 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbdf820-35fa-4200-8daf-6d0ed11acf68 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:08.220082 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e53f4-25c8-40d0-820d-16bbd31b1b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:08.220745 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e53f4-25c8-40d0-820d-16bbd31b1b1b admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:08.221025 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e53f4-25c8-40d0-820d-16bbd31b1b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:08.221300 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e53f4-25c8-40d0-820d-16bbd31b1b1b admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:08.222023 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e53f4-25c8-40d0-820d-16bbd31b1b1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:08.223653 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363e53f4-25c8-40d0-820d-16bbd31b1b1b admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:08.234657 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1104/2202] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:23:08 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:23:08.238778 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dcd0df-de96-4c22-b2e2-809d5a2a7d5c admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:08.250518 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dcd0df-de96-4c22-b2e2-809d5a2a7d5c admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:08.256616 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a4b629-418f-4e78-b080-7778aa8f1d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:08.257291 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4b629-418f-4e78-b080-7778aa8f1d77 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:08.257580 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4b629-418f-4e78-b080-7778aa8f1d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:08.257838 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4b629-418f-4e78-b080-7778aa8f1d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:08.258573 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a4b629-418f-4e78-b080-7778aa8f1d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:08.260286 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a4b629-418f-4e78-b080-7778aa8f1d77 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:08.271600 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1099/2203] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:23:08 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:23:08.275601 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e53f4-25c8-40d0-820d-16bbd31b1b1b admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:08.285841 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e53f4-25c8-40d0-820d-16bbd31b1b1b admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:08.291963 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d42141-8ec2-450b-a7e3-634574d94d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:08.292955 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d42141-8ec2-450b-a7e3-634574d94d16 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:08.293237 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d42141-8ec2-450b-a7e3-634574d94d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:08.293507 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d42141-8ec2-450b-a7e3-634574d94d16 admin admin] PATH_INFO: `/v3/projects/b5735dc6d08e4cddad8d76bbb3e7308f/users/800d1ece5af64fb2b270b6631c978b6d/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:08.309542 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d42141-8ec2-450b-a7e3-634574d94d16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5735dc6d08e4cddad8d76bbb3e7308f, user_id=800d1ece5af64fb2b270b6631c978b6d, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:08.312236 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d42141-8ec2-450b-a7e3-634574d94d16 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:08.330262 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1105/2204] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:23:08 2021] PUT /identity/v3/projects/b5735dc6d08e4cddad8d76bbb3e7308f/users/800d1ece5af64fb2b270b6631c978b6d/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:23:08.343705 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f1bd2-d76a-4e53-90a3-f72faed48f0d None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:08.344480 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f1bd2-d76a-4e53-90a3-f72faed48f0d None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:08.344600 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f1bd2-d76a-4e53-90a3-f72faed48f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:08.375247 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-fb0f1bd2-d76a-4e53-90a3-f72faed48f0d None None] MFA Rules not processed for user `800d1ece5af64fb2b270b6631c978b6d`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:23:08.377003 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-fb0f1bd2-d76a-4e53-90a3-f72faed48f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:08.455647 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1100/2205] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:23:08 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:23:08.460391 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d42141-8ec2-450b-a7e3-634574d94d16 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:08.531960 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d42141-8ec2-450b-a7e3-634574d94d16 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:08.536776 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f2ab74-b5de-442e-aa31-58f6bfd6c440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:08.537453 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2ab74-b5de-442e-aa31-58f6bfd6c440 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:08.537736 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2ab74-b5de-442e-aa31-58f6bfd6c440 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:08.538016 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2ab74-b5de-442e-aa31-58f6bfd6c440 admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:08.538749 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f2ab74-b5de-442e-aa31-58f6bfd6c440 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:08.540718 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f2ab74-b5de-442e-aa31-58f6bfd6c440 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:08.572521 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1106/2206] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:23:08 2021] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:23:08.574022 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f1bd2-d76a-4e53-90a3-f72faed48f0d None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:08.585380 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f1bd2-d76a-4e53-90a3-f72faed48f0d None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:08.642020 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcda462-bb53-4c82-9ee2-2dbe8744a4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:08.642636 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcda462-bb53-4c82-9ee2-2dbe8744a4c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:08.642952 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcda462-bb53-4c82-9ee2-2dbe8744a4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:08.643549 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcda462-bb53-4c82-9ee2-2dbe8744a4c7 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:08.644264 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcda462-bb53-4c82-9ee2-2dbe8744a4c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:08.646257 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcda462-bb53-4c82-9ee2-2dbe8744a4c7 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:08.670455 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1101/2207] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:23:08 2021] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:23:08.675926 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f2ab74-b5de-442e-aa31-58f6bfd6c440 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:08.686726 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f2ab74-b5de-442e-aa31-58f6bfd6c440 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:08.692038 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f97a75-90fd-4fc8-addd-5b154a2436a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:08.692878 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f97a75-90fd-4fc8-addd-5b154a2436a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:08.693142 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f97a75-90fd-4fc8-addd-5b154a2436a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:08.693434 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f97a75-90fd-4fc8-addd-5b154a2436a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:08.694165 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f97a75-90fd-4fc8-addd-5b154a2436a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:08.695789 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f97a75-90fd-4fc8-addd-5b154a2436a1 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:08.709717 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1107/2208] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:23:08 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:23:08.711140 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcda462-bb53-4c82-9ee2-2dbe8744a4c7 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:08.721244 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcda462-bb53-4c82-9ee2-2dbe8744a4c7 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:08.726637 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5291156b-4252-460c-9f74-c32679e65847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:08.727566 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291156b-4252-460c-9f74-c32679e65847 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:08.727842 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291156b-4252-460c-9f74-c32679e65847 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:08.728108 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5291156b-4252-460c-9f74-c32679e65847 admin admin] PATH_INFO: `/v3/projects/4432a9ea653b41b98171638fdf57ef37/users/c0acdf259eca400bb04543c3a7bafd42/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:08.745702 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5291156b-4252-460c-9f74-c32679e65847 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4432a9ea653b41b98171638fdf57ef37, user_id=c0acdf259eca400bb04543c3a7bafd42, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:08.748332 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5291156b-4252-460c-9f74-c32679e65847 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:08.762621 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1102/2209] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:23:08 2021] PUT /identity/v3/projects/4432a9ea653b41b98171638fdf57ef37/users/c0acdf259eca400bb04543c3a7bafd42/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:23:08.766553 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f97a75-90fd-4fc8-addd-5b154a2436a1 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:08.776680 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f97a75-90fd-4fc8-addd-5b154a2436a1 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:08.835866 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692641d6-a698-4bfc-9fba-7b569920c06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:08.836679 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692641d6-a698-4bfc-9fba-7b569920c06b admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:08.836967 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692641d6-a698-4bfc-9fba-7b569920c06b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:08.837229 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692641d6-a698-4bfc-9fba-7b569920c06b admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:08.837994 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692641d6-a698-4bfc-9fba-7b569920c06b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:08.839838 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692641d6-a698-4bfc-9fba-7b569920c06b admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:08.850428 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1108/2210] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:23:08 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:23:08.855365 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5291156b-4252-460c-9f74-c32679e65847 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:08.868515 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5291156b-4252-460c-9f74-c32679e65847 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:08.877029 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20343456-44ea-4dbf-b137-398f6b9bb615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:08.877951 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20343456-44ea-4dbf-b137-398f6b9bb615 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:08.878195 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20343456-44ea-4dbf-b137-398f6b9bb615 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:08.884842 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20343456-44ea-4dbf-b137-398f6b9bb615 admin admin] PATH_INFO: `/v3/projects/4432a9ea653b41b98171638fdf57ef37/users/c0acdf259eca400bb04543c3a7bafd42/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:08.884842 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20343456-44ea-4dbf-b137-398f6b9bb615 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4432a9ea653b41b98171638fdf57ef37, user_id=c0acdf259eca400bb04543c3a7bafd42, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:08.884842 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20343456-44ea-4dbf-b137-398f6b9bb615 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:08.896146 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1103/2211] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:23:08 2021] PUT /identity/v3/projects/4432a9ea653b41b98171638fdf57ef37/users/c0acdf259eca400bb04543c3a7bafd42/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:23:08.907791 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4e010-d06a-4021-8a02-7214ce91676d None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:08.908076 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4e010-d06a-4021-8a02-7214ce91676d None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:08.908357 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4e010-d06a-4021-8a02-7214ce91676d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:08.944697 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-b4f4e010-d06a-4021-8a02-7214ce91676d None None] MFA Rules not processed for user `c0acdf259eca400bb04543c3a7bafd42`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:23:08.945954 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-b4f4e010-d06a-4021-8a02-7214ce91676d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:09.026459 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1109/2212] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:23:08 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:23:09.036355 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20343456-44ea-4dbf-b137-398f6b9bb615 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:09.038119 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-20343456-44ea-4dbf-b137-398f6b9bb615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:09.097817 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20343456-44ea-4dbf-b137-398f6b9bb615 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:09.101404 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281903e3-5e89-4133-beeb-17ffecfcce69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:09.102042 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281903e3-5e89-4133-beeb-17ffecfcce69 service cinder] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:09.102318 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281903e3-5e89-4133-beeb-17ffecfcce69 service cinder] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:09.102587 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281903e3-5e89-4133-beeb-17ffecfcce69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:09.111189 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281903e3-5e89-4133-beeb-17ffecfcce69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:09.112600 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281903e3-5e89-4133-beeb-17ffecfcce69 service cinder] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:09.121709 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1104/2213] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:23:09 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:23:09.651743 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4e010-d06a-4021-8a02-7214ce91676d None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:09.717292 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4e010-d06a-4021-8a02-7214ce91676d None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:09.723066 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06d41b-3379-4296-ad08-4026b909f1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:09.723948 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06d41b-3379-4296-ad08-4026b909f1f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:09.724235 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06d41b-3379-4296-ad08-4026b909f1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:09.724509 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06d41b-3379-4296-ad08-4026b909f1f7 admin admin] PATH_INFO: `/v3/users/800d1ece5af64fb2b270b6631c978b6d` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:09.725749 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06d41b-3379-4296-ad08-4026b909f1f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=800d1ece5af64fb2b270b6631c978b6d)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:09.727709 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06d41b-3379-4296-ad08-4026b909f1f7 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:09.776911 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ff06d41b-3379-4296-ad08-4026b909f1f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '800d1ece5af64fb2b270b6631c978b6d'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:09.784546 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ff06d41b-3379-4296-ad08-4026b909f1f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '800d1ece5af64fb2b270b6631c978b6d'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:09.794317 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ff06d41b-3379-4296-ad08-4026b909f1f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '800d1ece5af64fb2b270b6631c978b6d'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:09.805736 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ff06d41b-3379-4296-ad08-4026b909f1f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '800d1ece5af64fb2b270b6631c978b6d'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:09.806504 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ff06d41b-3379-4296-ad08-4026b909f1f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '800d1ece5af64fb2b270b6631c978b6d'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:09.815025 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1110/2214] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:23:09 2021] DELETE /identity/v3/users/800d1ece5af64fb2b270b6631c978b6d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:23:09.819637 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b7a2c-8e4f-4f79-84d7-9e3fa283aac8 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:09.820171 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b7a2c-8e4f-4f79-84d7-9e3fa283aac8 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:09.820171 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b7a2c-8e4f-4f79-84d7-9e3fa283aac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:09.838136 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-549b7a2c-8e4f-4f79-84d7-9e3fa283aac8 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:23:09.839370 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-549b7a2c-8e4f-4f79-84d7-9e3fa283aac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:09.913373 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1105/2215] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:23:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:23:09.928372 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06d41b-3379-4296-ad08-4026b909f1f7 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:09.930739 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-ff06d41b-3379-4296-ad08-4026b909f1f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:09.992614 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06d41b-3379-4296-ad08-4026b909f1f7 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:09.996501 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db7cdcb-899c-4972-9f82-35e65776acd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:09.997634 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7cdcb-899c-4972-9f82-35e65776acd0 service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:09.997981 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7cdcb-899c-4972-9f82-35e65776acd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:09.998321 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7cdcb-899c-4972-9f82-35e65776acd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:10.008525 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b7a2c-8e4f-4f79-84d7-9e3fa283aac8 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:10.010078 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-549b7a2c-8e4f-4f79-84d7-9e3fa283aac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:10.014387 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db7cdcb-899c-4972-9f82-35e65776acd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:10.015845 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db7cdcb-899c-4972-9f82-35e65776acd0 service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:10.022357 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b7a2c-8e4f-4f79-84d7-9e3fa283aac8 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:10.026112 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1111/2216] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:23:09 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:23:10.028347 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726093c8-aa9c-49aa-9ca0-81b016437d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:10.029221 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726093c8-aa9c-49aa-9ca0-81b016437d63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:10.029480 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726093c8-aa9c-49aa-9ca0-81b016437d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:10.029749 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726093c8-aa9c-49aa-9ca0-81b016437d63 admin admin] PATH_INFO: `/v3/users/218c58c38edd49d98aa798975c0a7a43` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:10.030988 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726093c8-aa9c-49aa-9ca0-81b016437d63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=218c58c38edd49d98aa798975c0a7a43)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:10.033224 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726093c8-aa9c-49aa-9ca0-81b016437d63 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:10.083963 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-726093c8-aa9c-49aa-9ca0-81b016437d63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '218c58c38edd49d98aa798975c0a7a43'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:10.091990 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-726093c8-aa9c-49aa-9ca0-81b016437d63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '218c58c38edd49d98aa798975c0a7a43'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:10.105711 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-726093c8-aa9c-49aa-9ca0-81b016437d63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '218c58c38edd49d98aa798975c0a7a43'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:10.106515 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-726093c8-aa9c-49aa-9ca0-81b016437d63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '218c58c38edd49d98aa798975c0a7a43'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:10.107171 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-726093c8-aa9c-49aa-9ca0-81b016437d63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '218c58c38edd49d98aa798975c0a7a43'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:10.126896 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1106/2217] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:23:10 2021] DELETE /identity/v3/users/218c58c38edd49d98aa798975c0a7a43 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:23:10.129170 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6abce0-0b51-4df3-bec2-3d9a75ae05a5 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:10.129479 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6abce0-0b51-4df3-bec2-3d9a75ae05a5 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:10.129762 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6abce0-0b51-4df3-bec2-3d9a75ae05a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:10.147404 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-7d6abce0-0b51-4df3-bec2-3d9a75ae05a5 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:23:10.148605 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-7d6abce0-0b51-4df3-bec2-3d9a75ae05a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:10.218755 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1112/2218] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:23:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:23:10.232371 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726093c8-aa9c-49aa-9ca0-81b016437d63 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:10.233915 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-726093c8-aa9c-49aa-9ca0-81b016437d63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:10.298219 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726093c8-aa9c-49aa-9ca0-81b016437d63 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:10.302318 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155137fe-bf3b-4071-bb0f-02bddfe0130a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:10.303010 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155137fe-bf3b-4071-bb0f-02bddfe0130a service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:10.303293 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155137fe-bf3b-4071-bb0f-02bddfe0130a service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:10.303687 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155137fe-bf3b-4071-bb0f-02bddfe0130a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:10.324962 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155137fe-bf3b-4071-bb0f-02bddfe0130a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:10.326562 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155137fe-bf3b-4071-bb0f-02bddfe0130a service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:10.338557 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1107/2219] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:23:10 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 29 20:23:10.340161 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6abce0-0b51-4df3-bec2-3d9a75ae05a5 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:10.341692 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-7d6abce0-0b51-4df3-bec2-3d9a75ae05a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:10.357929 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6abce0-0b51-4df3-bec2-3d9a75ae05a5 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:10.374621 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52765ffb-e962-4007-aee9-637640a3dc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:10.380466 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52765ffb-e962-4007-aee9-637640a3dc33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:10.380771 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52765ffb-e962-4007-aee9-637640a3dc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:10.381077 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52765ffb-e962-4007-aee9-637640a3dc33 admin admin] PATH_INFO: `/v3/projects/b5735dc6d08e4cddad8d76bbb3e7308f` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:10.383319 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52765ffb-e962-4007-aee9-637640a3dc33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5735dc6d08e4cddad8d76bbb3e7308f)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:10.385418 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52765ffb-e962-4007-aee9-637640a3dc33 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:10.445020 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-52765ffb-e962-4007-aee9-637640a3dc33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5735dc6d08e4cddad8d76bbb3e7308f', 'request_id': 'req-52765ffb-e962-4007-aee9-637640a3dc33'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:10.452031 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-52765ffb-e962-4007-aee9-637640a3dc33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5735dc6d08e4cddad8d76bbb3e7308f', 'request_id': 'req-52765ffb-e962-4007-aee9-637640a3dc33'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:10.461072 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-52765ffb-e962-4007-aee9-637640a3dc33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5735dc6d08e4cddad8d76bbb3e7308f', 'request_id': 'req-52765ffb-e962-4007-aee9-637640a3dc33'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:10.474321 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-52765ffb-e962-4007-aee9-637640a3dc33 admin admin] The token cache is being invalidate because project b5735dc6d08e4cddad8d76bbb3e7308f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:23:10.474795 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-52765ffb-e962-4007-aee9-637640a3dc33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:10.476303 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-52765ffb-e962-4007-aee9-637640a3dc33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:10.478227 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1113/2220] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:23:10 2021] DELETE /identity/v3/projects/b5735dc6d08e4cddad8d76bbb3e7308f => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:23:10.483345 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155137fe-bf3b-4071-bb0f-02bddfe0130a service neutron] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:10.493066 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155137fe-bf3b-4071-bb0f-02bddfe0130a service neutron] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:10.558006 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9bff6-c46a-4a25-b066-35abe4865b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:10.559304 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9bff6-c46a-4a25-b066-35abe4865b5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:10.559817 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9bff6-c46a-4a25-b066-35abe4865b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:10.560198 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9bff6-c46a-4a25-b066-35abe4865b5d admin admin] PATH_INFO: `/v3/users/c0acdf259eca400bb04543c3a7bafd42` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:10.562965 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9bff6-c46a-4a25-b066-35abe4865b5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0acdf259eca400bb04543c3a7bafd42)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:10.566044 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9bff6-c46a-4a25-b066-35abe4865b5d admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:10.615516 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-11b9bff6-c46a-4a25-b066-35abe4865b5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0acdf259eca400bb04543c3a7bafd42'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:10.622639 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-11b9bff6-c46a-4a25-b066-35abe4865b5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0acdf259eca400bb04543c3a7bafd42'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:10.635487 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-11b9bff6-c46a-4a25-b066-35abe4865b5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0acdf259eca400bb04543c3a7bafd42'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:10.636277 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-11b9bff6-c46a-4a25-b066-35abe4865b5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0acdf259eca400bb04543c3a7bafd42'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:10.636902 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-11b9bff6-c46a-4a25-b066-35abe4865b5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0acdf259eca400bb04543c3a7bafd42'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:10.649567 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52765ffb-e962-4007-aee9-637640a3dc33 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:10.651174 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-52765ffb-e962-4007-aee9-637640a3dc33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:10.655601 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1108/2221] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:23:10 2021] DELETE /identity/v3/users/c0acdf259eca400bb04543c3a7bafd42 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:23:10.669293 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52765ffb-e962-4007-aee9-637640a3dc33 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:10.735076 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3128b3-d4fc-46e7-bfa1-98ea905d0963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:10.736137 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3128b3-d4fc-46e7-bfa1-98ea905d0963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:10.736489 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3128b3-d4fc-46e7-bfa1-98ea905d0963 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:10.736830 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3128b3-d4fc-46e7-bfa1-98ea905d0963 admin admin] PATH_INFO: `/v3/projects/d0593cc3827f49c692cfaf5e31e792eb` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:10.738156 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3128b3-d4fc-46e7-bfa1-98ea905d0963 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0593cc3827f49c692cfaf5e31e792eb)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:10.740098 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3128b3-d4fc-46e7-bfa1-98ea905d0963 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:10.795735 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-6d3128b3-d4fc-46e7-bfa1-98ea905d0963 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0593cc3827f49c692cfaf5e31e792eb', 'request_id': 'req-6d3128b3-d4fc-46e7-bfa1-98ea905d0963'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:10.802067 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-6d3128b3-d4fc-46e7-bfa1-98ea905d0963 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0593cc3827f49c692cfaf5e31e792eb', 'request_id': 'req-6d3128b3-d4fc-46e7-bfa1-98ea905d0963'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:10.817097 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-6d3128b3-d4fc-46e7-bfa1-98ea905d0963 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0593cc3827f49c692cfaf5e31e792eb', 'request_id': 'req-6d3128b3-d4fc-46e7-bfa1-98ea905d0963'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:10.829631 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-6d3128b3-d4fc-46e7-bfa1-98ea905d0963 admin admin] The token cache is being invalidate because project d0593cc3827f49c692cfaf5e31e792eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:23:10.830036 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-6d3128b3-d4fc-46e7-bfa1-98ea905d0963 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:10.830890 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-6d3128b3-d4fc-46e7-bfa1-98ea905d0963 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:10.837059 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1114/2222] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:23:10 2021] DELETE /identity/v3/projects/d0593cc3827f49c692cfaf5e31e792eb => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:23:10.838995 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25967d5-cbde-472d-b6d0-4b54750004d7 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:10.839478 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25967d5-cbde-472d-b6d0-4b54750004d7 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:10.839562 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25967d5-cbde-472d-b6d0-4b54750004d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:10.863082 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-e25967d5-cbde-472d-b6d0-4b54750004d7 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:23:10.864287 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-e25967d5-cbde-472d-b6d0-4b54750004d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:10.921090 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1109/2223] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:23:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:23:10.928922 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbf128-cf95-4149-be3c-9cfca9013af0 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:10.929275 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbf128-cf95-4149-be3c-9cfca9013af0 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:10.929546 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fbf128-cf95-4149-be3c-9cfca9013af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:10.948359 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25967d5-cbde-472d-b6d0-4b54750004d7 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:10.948561 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-c0fbf128-cf95-4149-be3c-9cfca9013af0 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:23:10.949766 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-c0fbf128-cf95-4149-be3c-9cfca9013af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:10.950327 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-e25967d5-cbde-472d-b6d0-4b54750004d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:10.958598 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1115/2224] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:23:10 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:23:10.963227 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fbf128-cf95-4149-be3c-9cfca9013af0 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:10.969963 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25967d5-cbde-472d-b6d0-4b54750004d7 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:10.973945 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fbf128-cf95-4149-be3c-9cfca9013af0 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:10.978639 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21803056-483b-401f-8052-487d61afb978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:10.979534 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21803056-483b-401f-8052-487d61afb978 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:10.979760 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21803056-483b-401f-8052-487d61afb978 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:10.980033 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21803056-483b-401f-8052-487d61afb978 admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:10.980771 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21803056-483b-401f-8052-487d61afb978 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:23:10.981073 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21803056-483b-401f-8052-487d61afb978 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:10.981268 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27754dab-b501-4759-b875-8a779c0e88df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:10.982133 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27754dab-b501-4759-b875-8a779c0e88df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:10.982530 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27754dab-b501-4759-b875-8a779c0e88df admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:10.982637 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21803056-483b-401f-8052-487d61afb978 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:10.982810 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27754dab-b501-4759-b875-8a779c0e88df admin admin] PATH_INFO: `/v3/projects/4432a9ea653b41b98171638fdf57ef37` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:10.985270 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27754dab-b501-4759-b875-8a779c0e88df admin admin] RBAC: Authorizing `identity:delete_project(project_id=4432a9ea653b41b98171638fdf57ef37)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:10.986601 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27754dab-b501-4759-b875-8a779c0e88df admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:10.995355 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1116/2225] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:23:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:23:10.999445 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21803056-483b-401f-8052-487d61afb978 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:11.009408 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21803056-483b-401f-8052-487d61afb978 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:11.014672 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6207b-c04e-4ba5-9234-74be45e3b04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:11.015489 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6207b-c04e-4ba5-9234-74be45e3b04c admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:11.015769 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6207b-c04e-4ba5-9234-74be45e3b04c admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:11.016226 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d6207b-c04e-4ba5-9234-74be45e3b04c admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:11.017063 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6207b-c04e-4ba5-9234-74be45e3b04c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:11.019457 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d6207b-c04e-4ba5-9234-74be45e3b04c admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:11.037246 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-27754dab-b501-4759-b875-8a779c0e88df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4432a9ea653b41b98171638fdf57ef37', 'request_id': 'req-27754dab-b501-4759-b875-8a779c0e88df'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:11.043643 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-27754dab-b501-4759-b875-8a779c0e88df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4432a9ea653b41b98171638fdf57ef37', 'request_id': 'req-27754dab-b501-4759-b875-8a779c0e88df'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:11.045281 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1117/2226] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:23:10 2021] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 29 20:23:11.049386 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6207b-c04e-4ba5-9234-74be45e3b04c admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:11.049552 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-27754dab-b501-4759-b875-8a779c0e88df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4432a9ea653b41b98171638fdf57ef37', 'request_id': 'req-27754dab-b501-4759-b875-8a779c0e88df'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:11.062996 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-27754dab-b501-4759-b875-8a779c0e88df admin admin] The token cache is being invalidate because project 4432a9ea653b41b98171638fdf57ef37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:23:11.063279 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-27754dab-b501-4759-b875-8a779c0e88df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:11.063896 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-27754dab-b501-4759-b875-8a779c0e88df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:11.065733 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1110/2227] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:23:10 2021] DELETE /identity/v3/projects/4432a9ea653b41b98171638fdf57ef37 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:23:11.071706 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7d9da-77e1-4db6-8820-a1663b5dced0 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:11.071989 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7d9da-77e1-4db6-8820-a1663b5dced0 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:11.072262 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7d9da-77e1-4db6-8820-a1663b5dced0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:11.090148 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-cdc7d9da-77e1-4db6-8820-a1663b5dced0 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:23:11.091373 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-cdc7d9da-77e1-4db6-8820-a1663b5dced0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:11.108407 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d6207b-c04e-4ba5-9234-74be45e3b04c admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:11.113485 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db40bb9-7dba-4ee8-8783-a25c3a85f245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:11.114151 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db40bb9-7dba-4ee8-8783-a25c3a85f245 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:11.114428 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db40bb9-7dba-4ee8-8783-a25c3a85f245 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:11.114703 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db40bb9-7dba-4ee8-8783-a25c3a85f245 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:11.115704 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db40bb9-7dba-4ee8-8783-a25c3a85f245 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:11.117658 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db40bb9-7dba-4ee8-8783-a25c3a85f245 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:11.137659 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1118/2228] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:23:11 2021] POST /identity/v3/users => generated 288 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 29 20:23:11.141512 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db40bb9-7dba-4ee8-8783-a25c3a85f245 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:11.143447 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-5db40bb9-7dba-4ee8-8783-a25c3a85f245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:11.150946 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1111/2229] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:23:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:23:11.154892 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db40bb9-7dba-4ee8-8783-a25c3a85f245 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:11.158629 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b736bf-edb8-4adb-9bcd-c09a9e799cec None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:11.159002 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b736bf-edb8-4adb-9bcd-c09a9e799cec None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:11.159276 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b736bf-edb8-4adb-9bcd-c09a9e799cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:11.159538 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611563b-8873-453a-9dc9-d797dc7bd60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:11.160185 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611563b-8873-453a-9dc9-d797dc7bd60d admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:11.160465 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611563b-8873-453a-9dc9-d797dc7bd60d admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:11.160740 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611563b-8873-453a-9dc9-d797dc7bd60d admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:11.161475 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611563b-8873-453a-9dc9-d797dc7bd60d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:11.163159 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611563b-8873-453a-9dc9-d797dc7bd60d admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:11.176044 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1119/2230] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:23:11 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 29 20:23:11.176819 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-d3b736bf-edb8-4adb-9bcd-c09a9e799cec None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:23:11.177061 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611563b-8873-453a-9dc9-d797dc7bd60d admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:11.178091 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-d3b736bf-edb8-4adb-9bcd-c09a9e799cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:11.186022 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1112/2231] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:23:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:23:11.186380 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611563b-8873-453a-9dc9-d797dc7bd60d admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:11.190212 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b736bf-edb8-4adb-9bcd-c09a9e799cec None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:11.191327 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc9a08-b4df-4c1d-acbc-0e641b867cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:11.191987 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc9a08-b4df-4c1d-acbc-0e641b867cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:11.192270 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc9a08-b4df-4c1d-acbc-0e641b867cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:11.192542 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc9a08-b4df-4c1d-acbc-0e641b867cb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:11.193269 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc9a08-b4df-4c1d-acbc-0e641b867cb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:11.194911 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc9a08-b4df-4c1d-acbc-0e641b867cb2 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:11.199233 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b736bf-edb8-4adb-9bcd-c09a9e799cec None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:11.203777 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba85446-a664-413c-b82c-d4bc308db511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:11.204402 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba85446-a664-413c-b82c-d4bc308db511 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:11.204679 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba85446-a664-413c-b82c-d4bc308db511 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:11.204800 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1120/2232] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:23:11 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:23:11.207187 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba85446-a664-413c-b82c-d4bc308db511 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:11.208030 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba85446-a664-413c-b82c-d4bc308db511 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:23:11.208344 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba85446-a664-413c-b82c-d4bc308db511 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:11.208581 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc9a08-b4df-4c1d-acbc-0e641b867cb2 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:11.209924 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba85446-a664-413c-b82c-d4bc308db511 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:11.217566 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc9a08-b4df-4c1d-acbc-0e641b867cb2 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:11.224815 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1113/2233] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:23:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:23:11.224974 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ffbce-f5e9-4d34-a650-fe2986ca08f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:11.224974 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ffbce-f5e9-4d34-a650-fe2986ca08f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:11.224974 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ffbce-f5e9-4d34-a650-fe2986ca08f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:11.224974 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ffbce-f5e9-4d34-a650-fe2986ca08f3 admin admin] PATH_INFO: `/v3/projects/69576e1384e64446b439c0cbe2c501eb/users/cde4a6e93b75434fa4b403b8b30fffd6/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:11.226468 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba85446-a664-413c-b82c-d4bc308db511 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:11.239554 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ffbce-f5e9-4d34-a650-fe2986ca08f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69576e1384e64446b439c0cbe2c501eb, user_id=cde4a6e93b75434fa4b403b8b30fffd6, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:11.241005 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba85446-a664-413c-b82c-d4bc308db511 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:11.242102 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ffbce-f5e9-4d34-a650-fe2986ca08f3 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:11.246119 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97bcfa9-aa2f-44e2-a193-bf7fb44a7c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:11.246781 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bcfa9-aa2f-44e2-a193-bf7fb44a7c65 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:11.247142 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bcfa9-aa2f-44e2-a193-bf7fb44a7c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:11.247364 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bcfa9-aa2f-44e2-a193-bf7fb44a7c65 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:11.248072 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97bcfa9-aa2f-44e2-a193-bf7fb44a7c65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:11.249971 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97bcfa9-aa2f-44e2-a193-bf7fb44a7c65 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:11.255782 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1121/2234] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:23:11 2021] PUT /identity/v3/projects/69576e1384e64446b439c0cbe2c501eb/users/cde4a6e93b75434fa4b403b8b30fffd6/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:23:11.266198 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b3d77-73d8-4f11-8452-b5ec3e9a53ef None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:11.266198 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b3d77-73d8-4f11-8452-b5ec3e9a53ef None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:11.266497 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b3d77-73d8-4f11-8452-b5ec3e9a53ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:11.276778 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1114/2235] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:23:11 2021] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 29 20:23:11.280903 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97bcfa9-aa2f-44e2-a193-bf7fb44a7c65 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:11.294434 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-5e9b3d77-73d8-4f11-8452-b5ec3e9a53ef None None] MFA Rules not processed for user `cde4a6e93b75434fa4b403b8b30fffd6`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:23:11.295654 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-5e9b3d77-73d8-4f11-8452-b5ec3e9a53ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:11.340978 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97bcfa9-aa2f-44e2-a193-bf7fb44a7c65 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:11.346048 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c878395e-e4b7-4ec7-9d19-910025cd46ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:11.346827 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878395e-e4b7-4ec7-9d19-910025cd46ac admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:11.347213 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878395e-e4b7-4ec7-9d19-910025cd46ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:11.347489 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878395e-e4b7-4ec7-9d19-910025cd46ac admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:11.348269 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c878395e-e4b7-4ec7-9d19-910025cd46ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:11.350264 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c878395e-e4b7-4ec7-9d19-910025cd46ac admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:11.363463 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1122/2236] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:23:11 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:23:11.370564 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1115/2237] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:23:11 2021] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 29 20:23:11.374098 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b3d77-73d8-4f11-8452-b5ec3e9a53ef None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:11.374414 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c878395e-e4b7-4ec7-9d19-910025cd46ac admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:11.375686 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-5e9b3d77-73d8-4f11-8452-b5ec3e9a53ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:11.383956 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c878395e-e4b7-4ec7-9d19-910025cd46ac admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:11.388823 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0441a-9ad4-4dbf-8a54-2d87e7742b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:11.389486 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0441a-9ad4-4dbf-8a54-2d87e7742b4a admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:11.389743 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0441a-9ad4-4dbf-8a54-2d87e7742b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:11.390039 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0441a-9ad4-4dbf-8a54-2d87e7742b4a admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:11.390776 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0441a-9ad4-4dbf-8a54-2d87e7742b4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:11.392501 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0441a-9ad4-4dbf-8a54-2d87e7742b4a admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:11.402606 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1116/2238] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:23:11 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 29 20:23:11.406549 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0441a-9ad4-4dbf-8a54-2d87e7742b4a admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:11.416035 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0441a-9ad4-4dbf-8a54-2d87e7742b4a admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:11.420769 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd60ddb-df0f-4b15-acba-a57a57a2cf45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:11.421397 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd60ddb-df0f-4b15-acba-a57a57a2cf45 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:11.421680 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd60ddb-df0f-4b15-acba-a57a57a2cf45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:11.421958 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd60ddb-df0f-4b15-acba-a57a57a2cf45 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:11.422704 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd60ddb-df0f-4b15-acba-a57a57a2cf45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:11.424494 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd60ddb-df0f-4b15-acba-a57a57a2cf45 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:11.431872 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b3d77-73d8-4f11-8452-b5ec3e9a53ef None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:11.434877 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feb5352-d86d-48fa-af6b-d06c35f592d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:11.435541 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb5352-d86d-48fa-af6b-d06c35f592d7 service cinder] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:11.435818 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb5352-d86d-48fa-af6b-d06c35f592d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:11.436093 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feb5352-d86d-48fa-af6b-d06c35f592d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:11.437690 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1117/2239] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:23:11 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 29 20:23:11.438600 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd60ddb-df0f-4b15-acba-a57a57a2cf45 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:11.446137 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb5352-d86d-48fa-af6b-d06c35f592d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:11.447727 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feb5352-d86d-48fa-af6b-d06c35f592d7 service cinder] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:11.448417 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd60ddb-df0f-4b15-acba-a57a57a2cf45 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:11.453452 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df7147d-3b85-4577-9782-9c2836302ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:11.455460 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7147d-3b85-4577-9782-9c2836302ec9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:11.455460 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7147d-3b85-4577-9782-9c2836302ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:11.455460 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7147d-3b85-4577-9782-9c2836302ec9 admin admin] PATH_INFO: `/v3/projects/4e32390102a14c368c919e4b5eb1b559/users/0f38d07e06654204a3353e4af1a64b8a/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:11.457191 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1123/2240] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:23:11 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:23:11.470321 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df7147d-3b85-4577-9782-9c2836302ec9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e32390102a14c368c919e4b5eb1b559, user_id=0f38d07e06654204a3353e4af1a64b8a, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:11.472987 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df7147d-3b85-4577-9782-9c2836302ec9 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:11.487895 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1118/2241] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:23:11 2021] PUT /identity/v3/projects/4e32390102a14c368c919e4b5eb1b559/users/0f38d07e06654204a3353e4af1a64b8a/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:23:11.492821 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e573ed5-c52a-47b5-8855-6997cc72f5cc None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:11.493102 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e573ed5-c52a-47b5-8855-6997cc72f5cc None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:11.493370 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e573ed5-c52a-47b5-8855-6997cc72f5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:11.511171 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-2e573ed5-c52a-47b5-8855-6997cc72f5cc None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:23:11.512395 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-2e573ed5-c52a-47b5-8855-6997cc72f5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:11.578572 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1124/2242] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:23:11 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:23:11.588743 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df7147d-3b85-4577-9782-9c2836302ec9 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:11.590819 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-1df7147d-3b85-4577-9782-9c2836302ec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:11.651065 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df7147d-3b85-4577-9782-9c2836302ec9 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:11.654816 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612e858-1720-400b-b7c2-7ac59bb083e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:11.655506 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612e858-1720-400b-b7c2-7ac59bb083e7 service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:11.655786 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612e858-1720-400b-b7c2-7ac59bb083e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:11.656059 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612e858-1720-400b-b7c2-7ac59bb083e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:11.665316 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4612e858-1720-400b-b7c2-7ac59bb083e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:11.667012 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4612e858-1720-400b-b7c2-7ac59bb083e7 service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:11.677218 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1119/2243] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:23:11 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:23:12.836555 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c6c56-ad1a-4fd8-9aac-a0afa6233623 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:12.837016 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c6c56-ad1a-4fd8-9aac-a0afa6233623 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:12.837162 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c6c56-ad1a-4fd8-9aac-a0afa6233623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:12.855406 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-277c6c56-ad1a-4fd8-9aac-a0afa6233623 None None] MFA Rules not processed for user `cde4a6e93b75434fa4b403b8b30fffd6`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:23:12.856825 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-277c6c56-ad1a-4fd8-9aac-a0afa6233623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:12.917040 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1125/2244] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:23:12 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:23:16.375792 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7a642-b7db-4abd-80d5-bcc9681b4b74 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:16.377140 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7a642-b7db-4abd-80d5-bcc9681b4b74 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:16.378019 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d7a642-b7db-4abd-80d5-bcc9681b4b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:16.423833 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-b8d7a642-b7db-4abd-80d5-bcc9681b4b74 None None] MFA Rules not processed for user `0f38d07e06654204a3353e4af1a64b8a`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:23:16.426086 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-b8d7a642-b7db-4abd-80d5-bcc9681b4b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:16.525683 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1120/2245] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:23:16 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:23:16.533758 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c6c56-ad1a-4fd8-9aac-a0afa6233623 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:16.546178 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c6c56-ad1a-4fd8-9aac-a0afa6233623 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:16.551516 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310ebaf-fe92-4df4-bd5b-f9c7823158a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:16.552455 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310ebaf-fe92-4df4-bd5b-f9c7823158a3 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:16.552888 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310ebaf-fe92-4df4-bd5b-f9c7823158a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:16.553449 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310ebaf-fe92-4df4-bd5b-f9c7823158a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:16.554688 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310ebaf-fe92-4df4-bd5b-f9c7823158a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:16.556945 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310ebaf-fe92-4df4-bd5b-f9c7823158a3 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:16.597489 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7a642-b7db-4abd-80d5-bcc9681b4b74 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:16.600738 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1126/2246] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:23:16 2021] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:23:16.611773 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d7a642-b7db-4abd-80d5-bcc9681b4b74 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:16.702281 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5f0a4-ecee-40d0-8e28-ea4389817ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:16.703697 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5f0a4-ecee-40d0-8e28-ea4389817ae1 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:16.703984 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5f0a4-ecee-40d0-8e28-ea4389817ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:16.704254 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb5f0a4-ecee-40d0-8e28-ea4389817ae1 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:16.705510 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb5f0a4-ecee-40d0-8e28-ea4389817ae1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:16.708287 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb5f0a4-ecee-40d0-8e28-ea4389817ae1 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:16.733619 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1121/2247] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:23:16 2021] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 29 20:23:16.737632 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310ebaf-fe92-4df4-bd5b-f9c7823158a3 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:16.749884 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310ebaf-fe92-4df4-bd5b-f9c7823158a3 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:16.755106 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29266185-6a80-4271-a1d3-1ad7e0ede8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:16.755929 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29266185-6a80-4271-a1d3-1ad7e0ede8c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:16.756336 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29266185-6a80-4271-a1d3-1ad7e0ede8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:16.756722 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29266185-6a80-4271-a1d3-1ad7e0ede8c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:16.757553 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29266185-6a80-4271-a1d3-1ad7e0ede8c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:16.759377 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29266185-6a80-4271-a1d3-1ad7e0ede8c9 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:16.773990 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1127/2248] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:23:16 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:23:16.775251 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5f0a4-ecee-40d0-8e28-ea4389817ae1 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:16.786244 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb5f0a4-ecee-40d0-8e28-ea4389817ae1 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:16.791179 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ba5d2-5642-4dd7-8d2e-89bd7f906d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:16.792229 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ba5d2-5642-4dd7-8d2e-89bd7f906d31 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:16.792599 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ba5d2-5642-4dd7-8d2e-89bd7f906d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:16.792945 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ba5d2-5642-4dd7-8d2e-89bd7f906d31 admin admin] PATH_INFO: `/v3/projects/d1cb90edfc164901be51862ee6c9759b/users/287dff1403884c059e491eecba659da0/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:16.809932 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ba5d2-5642-4dd7-8d2e-89bd7f906d31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1cb90edfc164901be51862ee6c9759b, user_id=287dff1403884c059e491eecba659da0, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:16.813910 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ba5d2-5642-4dd7-8d2e-89bd7f906d31 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:16.839732 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1122/2249] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:23:16 2021] PUT /identity/v3/projects/d1cb90edfc164901be51862ee6c9759b/users/287dff1403884c059e491eecba659da0/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:23:16.843560 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29266185-6a80-4271-a1d3-1ad7e0ede8c9 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:16.855330 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29266185-6a80-4271-a1d3-1ad7e0ede8c9 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:16.923197 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107a30e-9cb5-4421-a2a9-c236f2bd6fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:16.923872 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107a30e-9cb5-4421-a2a9-c236f2bd6fcd admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:16.924152 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107a30e-9cb5-4421-a2a9-c236f2bd6fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:16.924425 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107a30e-9cb5-4421-a2a9-c236f2bd6fcd admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:16.925928 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c107a30e-9cb5-4421-a2a9-c236f2bd6fcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:16.927983 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c107a30e-9cb5-4421-a2a9-c236f2bd6fcd admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:16.942902 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1128/2250] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:23:16 2021] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:23:16.944395 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ba5d2-5642-4dd7-8d2e-89bd7f906d31 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:16.959093 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ba5d2-5642-4dd7-8d2e-89bd7f906d31 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:16.966341 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b45781-1973-4e5b-9303-4a7eb795f8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:16.967296 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b45781-1973-4e5b-9303-4a7eb795f8bf admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:16.967577 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b45781-1973-4e5b-9303-4a7eb795f8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:16.968239 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b45781-1973-4e5b-9303-4a7eb795f8bf admin admin] PATH_INFO: `/v3/projects/d1cb90edfc164901be51862ee6c9759b/users/287dff1403884c059e491eecba659da0/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:16.970265 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b45781-1973-4e5b-9303-4a7eb795f8bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1cb90edfc164901be51862ee6c9759b, user_id=287dff1403884c059e491eecba659da0, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:16.974046 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b45781-1973-4e5b-9303-4a7eb795f8bf admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:16.994418 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1123/2251] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:23:16 2021] PUT /identity/v3/projects/d1cb90edfc164901be51862ee6c9759b/users/287dff1403884c059e491eecba659da0/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:23:22.261704 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c7f4a-be27-493f-8b63-9665b23141a3 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:22.262552 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c7f4a-be27-493f-8b63-9665b23141a3 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:22.263042 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c7f4a-be27-493f-8b63-9665b23141a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:22.361264 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-490c7f4a-be27-493f-8b63-9665b23141a3 None None] MFA Rules not processed for user `287dff1403884c059e491eecba659da0`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:23:22.364493 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-490c7f4a-be27-493f-8b63-9665b23141a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:22.563076 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1129/2252] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:23:22 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:23:22.574626 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b45781-1973-4e5b-9303-4a7eb795f8bf admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:22.576961 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-26b45781-1973-4e5b-9303-4a7eb795f8bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:22.716676 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b45781-1973-4e5b-9303-4a7eb795f8bf admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:22.723486 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf324c6-7137-4b69-b459-7609517c0fef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:22.724366 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf324c6-7137-4b69-b459-7609517c0fef service nova] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:22.724716 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf324c6-7137-4b69-b459-7609517c0fef service nova] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:22.725062 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf324c6-7137-4b69-b459-7609517c0fef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:22.801465 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf324c6-7137-4b69-b459-7609517c0fef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:22.803101 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf324c6-7137-4b69-b459-7609517c0fef service nova] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:22.813836 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1124/2253] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:23:22 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:23:24.147457 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9c639-5602-427f-96c2-fc6175aaae28 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:24.148314 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9c639-5602-427f-96c2-fc6175aaae28 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:24.148768 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9c639-5602-427f-96c2-fc6175aaae28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:24.170602 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-76f9c639-5602-427f-96c2-fc6175aaae28 None None] MFA Rules not processed for user `0f38d07e06654204a3353e4af1a64b8a`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:23:24.172113 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-76f9c639-5602-427f-96c2-fc6175aaae28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:24.182467 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1130/2254] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:23:24 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:23:32.247635 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34930ecf-4fc6-4c4c-82f1-b3efa00b8119 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:32.248173 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34930ecf-4fc6-4c4c-82f1-b3efa00b8119 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:32.248173 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34930ecf-4fc6-4c4c-82f1-b3efa00b8119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:32.267311 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-34930ecf-4fc6-4c4c-82f1-b3efa00b8119 None None] MFA Rules not processed for user `19d72c913c2b4442836a991120eec243`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:23:32.268855 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-34930ecf-4fc6-4c4c-82f1-b3efa00b8119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:32.324354 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1125/2255] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Nov 29 20:23:32 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:23:32.366499 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9c639-5602-427f-96c2-fc6175aaae28 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:32.367998 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-76f9c639-5602-427f-96c2-fc6175aaae28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:32.437937 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9c639-5602-427f-96c2-fc6175aaae28 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:32.444155 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8791d9-7756-45b9-96b4-12e4a09469a4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51fc6fd9b37447bba1759a702b86ce6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:32.444810 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8791d9-7756-45b9-96b4-12e4a09469a4 service swift] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:32.445088 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8791d9-7756-45b9-96b4-12e4a09469a4 service swift] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:32.445382 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8791d9-7756-45b9-96b4-12e4a09469a4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:32.454265 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8791d9-7756-45b9-96b4-12e4a09469a4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:32.455873 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8791d9-7756-45b9-96b4-12e4a09469a4 service swift] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:32.465562 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1131/2256] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Nov 29 20:23:32 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:23:33.003063 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8ca67-2f08-4fb4-b436-d80dac3fb49b None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:33.003356 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8ca67-2f08-4fb4-b436-d80dac3fb49b None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:33.003639 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8ca67-2f08-4fb4-b436-d80dac3fb49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:33.023054 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-f4f8ca67-2f08-4fb4-b436-d80dac3fb49b None None] MFA Rules not processed for user `19d72c913c2b4442836a991120eec243`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:23:33.024256 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-f4f8ca67-2f08-4fb4-b436-d80dac3fb49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:33.032345 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1126/2257] 10.222.0.15 () {58 vars in 967 bytes} [Mon Nov 29 20:23:33 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:23:33.046935 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8791d9-7756-45b9-96b4-12e4a09469a4 service swift] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:33.057587 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8791d9-7756-45b9-96b4-12e4a09469a4 service swift] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:33.063779 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f6e0b-4fee-4915-adf5-76c5c7fa4005 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51fc6fd9b37447bba1759a702b86ce6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:33.064414 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f6e0b-4fee-4915-adf5-76c5c7fa4005 service swift] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:33.064691 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f6e0b-4fee-4915-adf5-76c5c7fa4005 service swift] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:33.064960 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f6e0b-4fee-4915-adf5-76c5c7fa4005 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:33.073494 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f6e0b-4fee-4915-adf5-76c5c7fa4005 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:33.075039 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f6e0b-4fee-4915-adf5-76c5c7fa4005 service swift] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:33.083479 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1132/2258] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Nov 29 20:23:33 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:23:33.294391 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50dcb38-4922-4068-a758-b531074ce7a2 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:33.295017 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50dcb38-4922-4068-a758-b531074ce7a2 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:33.295017 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50dcb38-4922-4068-a758-b531074ce7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:33.313304 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-a50dcb38-4922-4068-a758-b531074ce7a2 None None] MFA Rules not processed for user `19d72c913c2b4442836a991120eec243`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:23:33.314511 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-a50dcb38-4922-4068-a758-b531074ce7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:33.323961 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1127/2259] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Nov 29 20:23:33 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:23:33.337098 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f6e0b-4fee-4915-adf5-76c5c7fa4005 service swift] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:33.347639 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f6e0b-4fee-4915-adf5-76c5c7fa4005 service swift] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:33.352848 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6663d4b-83c1-4861-9a3e-b62de0dfa786 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51fc6fd9b37447bba1759a702b86ce6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:33.353482 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6663d4b-83c1-4861-9a3e-b62de0dfa786 service swift] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:33.353759 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6663d4b-83c1-4861-9a3e-b62de0dfa786 service swift] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:33.354030 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6663d4b-83c1-4861-9a3e-b62de0dfa786 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:33.362105 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6663d4b-83c1-4861-9a3e-b62de0dfa786 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:33.363720 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6663d4b-83c1-4861-9a3e-b62de0dfa786 service swift] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:33.371470 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1133/2260] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Nov 29 20:23:33 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:23:33.718754 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7dff9-dd49-46e7-8da1-7e6e7b84b312 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:33.719216 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7dff9-dd49-46e7-8da1-7e6e7b84b312 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:33.719572 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7dff9-dd49-46e7-8da1-7e6e7b84b312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:33.738322 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-6dc7dff9-dd49-46e7-8da1-7e6e7b84b312 None None] MFA Rules not processed for user `19d72c913c2b4442836a991120eec243`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:23:33.739749 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-6dc7dff9-dd49-46e7-8da1-7e6e7b84b312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:33.748123 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1128/2261] 10.222.0.15 () {58 vars in 967 bytes} [Mon Nov 29 20:23:33 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:23:33.761650 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6663d4b-83c1-4861-9a3e-b62de0dfa786 service swift] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:33.772808 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6663d4b-83c1-4861-9a3e-b62de0dfa786 service swift] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:33.778563 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48c0f1-3812-42e6-a8c2-32ab424f6641 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51fc6fd9b37447bba1759a702b86ce6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:33.779304 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48c0f1-3812-42e6-a8c2-32ab424f6641 service swift] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:33.779645 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48c0f1-3812-42e6-a8c2-32ab424f6641 service swift] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:33.780003 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48c0f1-3812-42e6-a8c2-32ab424f6641 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:33.795616 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e48c0f1-3812-42e6-a8c2-32ab424f6641 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:33.797412 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e48c0f1-3812-42e6-a8c2-32ab424f6641 service swift] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:33.806910 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1134/2262] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Nov 29 20:23:33 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:23:35.841428 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc7dff9-dd49-46e7-8da1-7e6e7b84b312 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:35.932571 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc7dff9-dd49-46e7-8da1-7e6e7b84b312 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:35.937421 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e537917-3c9c-49f4-ab75-ba56df6420c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:35.938328 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e537917-3c9c-49f4-ab75-ba56df6420c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:35.938624 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e537917-3c9c-49f4-ab75-ba56df6420c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:35.938936 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e537917-3c9c-49f4-ab75-ba56df6420c6 admin admin] PATH_INFO: `/v3/users/cde4a6e93b75434fa4b403b8b30fffd6` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:35.940308 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e537917-3c9c-49f4-ab75-ba56df6420c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cde4a6e93b75434fa4b403b8b30fffd6)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:35.942214 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e537917-3c9c-49f4-ab75-ba56df6420c6 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:35.990622 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-6e537917-3c9c-49f4-ab75-ba56df6420c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cde4a6e93b75434fa4b403b8b30fffd6'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:35.997526 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-6e537917-3c9c-49f4-ab75-ba56df6420c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cde4a6e93b75434fa4b403b8b30fffd6'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:36.010499 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-6e537917-3c9c-49f4-ab75-ba56df6420c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cde4a6e93b75434fa4b403b8b30fffd6'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:36.011808 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-6e537917-3c9c-49f4-ab75-ba56df6420c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cde4a6e93b75434fa4b403b8b30fffd6'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:36.012730 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-6e537917-3c9c-49f4-ab75-ba56df6420c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cde4a6e93b75434fa4b403b8b30fffd6'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:36.040718 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1129/2263] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:23:35 2021] DELETE /identity/v3/users/cde4a6e93b75434fa4b403b8b30fffd6 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:23:36.042943 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c8dd0-b499-48f6-8213-223727b05a91 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:36.043465 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c8dd0-b499-48f6-8213-223727b05a91 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:36.043465 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c8dd0-b499-48f6-8213-223727b05a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:36.080513 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-232c8dd0-b499-48f6-8213-223727b05a91 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:23:36.081725 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-232c8dd0-b499-48f6-8213-223727b05a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:36.164619 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1135/2264] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:23:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:23:36.181769 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e537917-3c9c-49f4-ab75-ba56df6420c6 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:36.183483 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-6e537917-3c9c-49f4-ab75-ba56df6420c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:36.289218 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e537917-3c9c-49f4-ab75-ba56df6420c6 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:36.293085 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9815d22-e8d5-43f4-bd49-411c285dd03d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:36.293728 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9815d22-e8d5-43f4-bd49-411c285dd03d service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:36.294011 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9815d22-e8d5-43f4-bd49-411c285dd03d service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:36.294287 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9815d22-e8d5-43f4-bd49-411c285dd03d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:36.303516 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9815d22-e8d5-43f4-bd49-411c285dd03d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:36.304948 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9815d22-e8d5-43f4-bd49-411c285dd03d service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:36.315241 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1130/2265] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:23:36 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 29 20:23:36.536561 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c8dd0-b499-48f6-8213-223727b05a91 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:36.539484 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-232c8dd0-b499-48f6-8213-223727b05a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:36.555370 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c8dd0-b499-48f6-8213-223727b05a91 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:36.561378 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb48ba0-e86d-4929-90cd-72b86e889587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:36.562468 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb48ba0-e86d-4929-90cd-72b86e889587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:36.562918 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb48ba0-e86d-4929-90cd-72b86e889587 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:36.563314 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb48ba0-e86d-4929-90cd-72b86e889587 admin admin] PATH_INFO: `/v3/projects/69576e1384e64446b439c0cbe2c501eb` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:36.564694 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb48ba0-e86d-4929-90cd-72b86e889587 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69576e1384e64446b439c0cbe2c501eb)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:36.566595 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb48ba0-e86d-4929-90cd-72b86e889587 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:36.613533 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-0bb48ba0-e86d-4929-90cd-72b86e889587 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69576e1384e64446b439c0cbe2c501eb', 'request_id': 'req-0bb48ba0-e86d-4929-90cd-72b86e889587'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:36.619817 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-0bb48ba0-e86d-4929-90cd-72b86e889587 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69576e1384e64446b439c0cbe2c501eb', 'request_id': 'req-0bb48ba0-e86d-4929-90cd-72b86e889587'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:36.628988 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-0bb48ba0-e86d-4929-90cd-72b86e889587 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69576e1384e64446b439c0cbe2c501eb', 'request_id': 'req-0bb48ba0-e86d-4929-90cd-72b86e889587'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:36.641586 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-0bb48ba0-e86d-4929-90cd-72b86e889587 admin admin] The token cache is being invalidate because project 69576e1384e64446b439c0cbe2c501eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:23:36.641878 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-0bb48ba0-e86d-4929-90cd-72b86e889587 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:36.642615 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-0bb48ba0-e86d-4929-90cd-72b86e889587 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:23:36.644857 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1136/2266] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:23:36 2021] DELETE /identity/v3/projects/69576e1384e64446b439c0cbe2c501eb => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:23:36.652233 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676b92b-aae1-44c6-bd06-9dece78a8ea0 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:36.652597 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676b92b-aae1-44c6-bd06-9dece78a8ea0 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:36.652945 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676b92b-aae1-44c6-bd06-9dece78a8ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:36.700632 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-0676b92b-aae1-44c6-bd06-9dece78a8ea0 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:23:36.701861 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-0676b92b-aae1-44c6-bd06-9dece78a8ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:36.766337 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1131/2267] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:23:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:23:36.775202 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e4260-60fc-40c1-846a-3ff9677cd093 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:36.775466 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e4260-60fc-40c1-846a-3ff9677cd093 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:36.775767 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e4260-60fc-40c1-846a-3ff9677cd093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:36.794552 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-780e4260-60fc-40c1-846a-3ff9677cd093 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:23:36.795796 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-780e4260-60fc-40c1-846a-3ff9677cd093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:36.804610 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1137/2268] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:23:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:23:36.809401 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676b92b-aae1-44c6-bd06-9dece78a8ea0 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:36.819911 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676b92b-aae1-44c6-bd06-9dece78a8ea0 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:36.825181 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e510d-fadc-4de1-87d1-e4ade13b43a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:36.825871 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e510d-fadc-4de1-87d1-e4ade13b43a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:36.826149 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e510d-fadc-4de1-87d1-e4ade13b43a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:36.826432 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e510d-fadc-4de1-87d1-e4ade13b43a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:36.827340 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e510d-fadc-4de1-87d1-e4ade13b43a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:23:36.827647 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e510d-fadc-4de1-87d1-e4ade13b43a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:36.829411 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e510d-fadc-4de1-87d1-e4ade13b43a9 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:36.841715 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1132/2269] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:23:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:23:36.846417 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e4260-60fc-40c1-846a-3ff9677cd093 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:36.855475 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e4260-60fc-40c1-846a-3ff9677cd093 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:36.860211 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312424b-0eb7-496e-a27b-0ab8207f6981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:36.860876 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312424b-0eb7-496e-a27b-0ab8207f6981 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:36.861158 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312424b-0eb7-496e-a27b-0ab8207f6981 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:36.861440 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312424b-0eb7-496e-a27b-0ab8207f6981 admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:36.862166 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3312424b-0eb7-496e-a27b-0ab8207f6981 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:36.864180 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3312424b-0eb7-496e-a27b-0ab8207f6981 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:36.890537 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1138/2270] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:23:36 2021] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:23:36.895147 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e510d-fadc-4de1-87d1-e4ade13b43a9 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:36.905333 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e510d-fadc-4de1-87d1-e4ade13b43a9 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:36.959694 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea630a-9857-475c-82ec-611f7f2c29b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:36.960338 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea630a-9857-475c-82ec-611f7f2c29b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:36.960616 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea630a-9857-475c-82ec-611f7f2c29b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:36.960894 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea630a-9857-475c-82ec-611f7f2c29b1 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:36.961591 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea630a-9857-475c-82ec-611f7f2c29b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:36.963567 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea630a-9857-475c-82ec-611f7f2c29b1 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:36.988250 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1133/2271] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:23:36 2021] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:23:36.992503 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312424b-0eb7-496e-a27b-0ab8207f6981 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:37.004227 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3312424b-0eb7-496e-a27b-0ab8207f6981 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:37.009130 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48998e-07f3-4304-8b5e-86e0a114bf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:37.009791 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48998e-07f3-4304-8b5e-86e0a114bf23 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:37.010091 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48998e-07f3-4304-8b5e-86e0a114bf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:37.010361 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48998e-07f3-4304-8b5e-86e0a114bf23 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:37.011122 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f48998e-07f3-4304-8b5e-86e0a114bf23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:37.012713 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f48998e-07f3-4304-8b5e-86e0a114bf23 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:37.023401 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1139/2272] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:23:36 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:23:37.027797 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea630a-9857-475c-82ec-611f7f2c29b1 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:37.038560 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea630a-9857-475c-82ec-611f7f2c29b1 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:37.044588 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d61a529-3bd8-4087-8bca-328f7dcc7354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:37.045242 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61a529-3bd8-4087-8bca-328f7dcc7354 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:37.045520 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61a529-3bd8-4087-8bca-328f7dcc7354 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:37.045821 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61a529-3bd8-4087-8bca-328f7dcc7354 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:37.046542 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d61a529-3bd8-4087-8bca-328f7dcc7354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:37.048374 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d61a529-3bd8-4087-8bca-328f7dcc7354 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:37.059201 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1134/2273] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:23:37 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:23:37.062991 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48998e-07f3-4304-8b5e-86e0a114bf23 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:37.073550 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48998e-07f3-4304-8b5e-86e0a114bf23 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:37.078564 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b196a48-3dbc-4770-9ffa-f8686e95f7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:37.079521 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b196a48-3dbc-4770-9ffa-f8686e95f7c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:37.079801 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b196a48-3dbc-4770-9ffa-f8686e95f7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:37.080059 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b196a48-3dbc-4770-9ffa-f8686e95f7c0 admin admin] PATH_INFO: `/v3/projects/0c9b2b4aee1a4bacaec32bafef2e9965/users/82869068bf684f1d8e6248fca88a49bb/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:37.095073 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b196a48-3dbc-4770-9ffa-f8686e95f7c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c9b2b4aee1a4bacaec32bafef2e9965, user_id=82869068bf684f1d8e6248fca88a49bb, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:37.098274 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b196a48-3dbc-4770-9ffa-f8686e95f7c0 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:37.114264 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1140/2274] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:23:37 2021] PUT /identity/v3/projects/0c9b2b4aee1a4bacaec32bafef2e9965/users/82869068bf684f1d8e6248fca88a49bb/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:23:37.119213 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64108026-213a-4ea2-a48c-d6e5eac4e2a0 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:37.119496 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64108026-213a-4ea2-a48c-d6e5eac4e2a0 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:37.119772 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64108026-213a-4ea2-a48c-d6e5eac4e2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:37.138163 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-64108026-213a-4ea2-a48c-d6e5eac4e2a0 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:23:37.139394 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-64108026-213a-4ea2-a48c-d6e5eac4e2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:37.208168 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1135/2275] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:23:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:23:37.218922 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b196a48-3dbc-4770-9ffa-f8686e95f7c0 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:37.220865 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-2b196a48-3dbc-4770-9ffa-f8686e95f7c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:37.279806 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b196a48-3dbc-4770-9ffa-f8686e95f7c0 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:37.285306 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df7798-3af2-45b6-9163-97d48d578701 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:37.285999 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df7798-3af2-45b6-9163-97d48d578701 service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:37.286267 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df7798-3af2-45b6-9163-97d48d578701 service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:37.286532 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7df7798-3af2-45b6-9163-97d48d578701 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:37.296341 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7df7798-3af2-45b6-9163-97d48d578701 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:37.297969 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7df7798-3af2-45b6-9163-97d48d578701 service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:37.304108 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b3df5-9819-4c08-a1da-c64a74359fc0 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:37.304400 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b3df5-9819-4c08-a1da-c64a74359fc0 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:37.304823 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b3df5-9819-4c08-a1da-c64a74359fc0 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:37.306657 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1136/2276] 10.222.0.15 () {54 vars in 960 bytes} [Mon Nov 29 20:23:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 29 20:23:37.308296 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1141/2277] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:23:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:23:37.313710 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d66f21-865c-41ec-9505-7372a0af2a4c None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:37.314000 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d66f21-865c-41ec-9505-7372a0af2a4c None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:37.314410 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d66f21-865c-41ec-9505-7372a0af2a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:37.384571 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-54d66f21-865c-41ec-9505-7372a0af2a4c None None] MFA Rules not processed for user `b954c18d7e9349e899f4c1cd42b89166`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:23:37.385803 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-54d66f21-865c-41ec-9505-7372a0af2a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:37.479477 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1137/2278] 10.222.0.15 () {58 vars in 1057 bytes} [Mon Nov 29 20:23:37 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:23:37.487939 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df7798-3af2-45b6-9163-97d48d578701 service neutron] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:37.499897 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7df7798-3af2-45b6-9163-97d48d578701 service neutron] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:37.505153 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab72b9-fc31-48a0-bdcd-77c352a69fa9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b954c18d7e9349e899f4c1cd42b89166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:37.505814 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab72b9-fc31-48a0-bdcd-77c352a69fa9 service placement] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:37.506113 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab72b9-fc31-48a0-bdcd-77c352a69fa9 service placement] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:37.506366 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab72b9-fc31-48a0-bdcd-77c352a69fa9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:37.508201 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-d8ab72b9-fc31-48a0-bdcd-77c352a69fa9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:37.520261 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab72b9-fc31-48a0-bdcd-77c352a69fa9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:37.522096 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab72b9-fc31-48a0-bdcd-77c352a69fa9 service placement] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:37.532418 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1142/2279] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:23:37 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:23:41.733306 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700fd47-309f-4422-92e4-b58930568e81 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:41.733834 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700fd47-309f-4422-92e4-b58930568e81 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:41.734237 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700fd47-309f-4422-92e4-b58930568e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:41.763297 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-3700fd47-309f-4422-92e4-b58930568e81 None None] MFA Rules not processed for user `82869068bf684f1d8e6248fca88a49bb`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:23:41.764631 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-3700fd47-309f-4422-92e4-b58930568e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:41.829355 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1138/2280] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:23:41 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:23:41.833642 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab72b9-fc31-48a0-bdcd-77c352a69fa9 service placement] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:41.844159 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab72b9-fc31-48a0-bdcd-77c352a69fa9 service placement] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:41.848705 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f19831-1f2f-4eda-8006-3d212c67d97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:41.849352 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f19831-1f2f-4eda-8006-3d212c67d97b admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:41.849637 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f19831-1f2f-4eda-8006-3d212c67d97b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:41.849907 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f19831-1f2f-4eda-8006-3d212c67d97b admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:41.850633 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f19831-1f2f-4eda-8006-3d212c67d97b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:41.852583 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f19831-1f2f-4eda-8006-3d212c67d97b admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:41.879809 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1143/2281] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:23:41 2021] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:23:41.884057 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700fd47-309f-4422-92e4-b58930568e81 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:41.898554 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700fd47-309f-4422-92e4-b58930568e81 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:41.965525 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf68ce-82d0-41f1-8395-e7b5a0cefc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:41.966206 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf68ce-82d0-41f1-8395-e7b5a0cefc5c admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:41.966489 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf68ce-82d0-41f1-8395-e7b5a0cefc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:41.966766 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf68ce-82d0-41f1-8395-e7b5a0cefc5c admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:41.967513 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf68ce-82d0-41f1-8395-e7b5a0cefc5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:41.969432 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf68ce-82d0-41f1-8395-e7b5a0cefc5c admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:41.994243 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1139/2282] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:23:41 2021] POST /identity/v3/users => generated 299 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:23:41.995499 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f19831-1f2f-4eda-8006-3d212c67d97b admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:42.005670 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f19831-1f2f-4eda-8006-3d212c67d97b admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:42.010323 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9dec3-7041-4ed1-8ffc-19dc4f61f249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:42.011010 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9dec3-7041-4ed1-8ffc-19dc4f61f249 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:42.011297 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9dec3-7041-4ed1-8ffc-19dc4f61f249 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:42.011546 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9dec3-7041-4ed1-8ffc-19dc4f61f249 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:42.012322 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e9dec3-7041-4ed1-8ffc-19dc4f61f249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:42.013911 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e9dec3-7041-4ed1-8ffc-19dc4f61f249 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:42.025111 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1144/2283] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:23:41 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:23:42.029310 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf68ce-82d0-41f1-8395-e7b5a0cefc5c admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:42.039521 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf68ce-82d0-41f1-8395-e7b5a0cefc5c admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:42.044872 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a659d-f529-4319-b1cb-1fad50a3dbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:42.045683 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a659d-f529-4319-b1cb-1fad50a3dbcb admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:42.045959 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a659d-f529-4319-b1cb-1fad50a3dbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:42.046224 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a659d-f529-4319-b1cb-1fad50a3dbcb admin admin] PATH_INFO: `/v3/projects/b3b11af4073e4f1e94b980b887df8717/users/beccca8676944bc4b3e6c9828998da55/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:42.062038 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a659d-f529-4319-b1cb-1fad50a3dbcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3b11af4073e4f1e94b980b887df8717, user_id=beccca8676944bc4b3e6c9828998da55, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:42.064705 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a659d-f529-4319-b1cb-1fad50a3dbcb admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:42.080657 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1140/2284] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:23:42 2021] PUT /identity/v3/projects/b3b11af4073e4f1e94b980b887df8717/users/beccca8676944bc4b3e6c9828998da55/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:23:42.084653 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9dec3-7041-4ed1-8ffc-19dc4f61f249 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:42.096220 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9dec3-7041-4ed1-8ffc-19dc4f61f249 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:42.154882 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6570bcc1-4cb4-435c-a365-220db7af2aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:42.155609 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570bcc1-4cb4-435c-a365-220db7af2aae admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:42.155872 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570bcc1-4cb4-435c-a365-220db7af2aae admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:42.156144 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6570bcc1-4cb4-435c-a365-220db7af2aae admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:42.157011 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6570bcc1-4cb4-435c-a365-220db7af2aae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:42.159138 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6570bcc1-4cb4-435c-a365-220db7af2aae admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:42.171214 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1145/2285] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:23:42 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 29 20:23:42.175412 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a659d-f529-4319-b1cb-1fad50a3dbcb admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:42.186152 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a659d-f529-4319-b1cb-1fad50a3dbcb admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:42.191271 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9c3f5-c399-4c17-8d96-5f9a30497307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:42.192406 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9c3f5-c399-4c17-8d96-5f9a30497307 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:42.192746 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9c3f5-c399-4c17-8d96-5f9a30497307 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:42.193025 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9c3f5-c399-4c17-8d96-5f9a30497307 admin admin] PATH_INFO: `/v3/projects/b3b11af4073e4f1e94b980b887df8717/users/beccca8676944bc4b3e6c9828998da55/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:42.195857 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f9c3f5-c399-4c17-8d96-5f9a30497307 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3b11af4073e4f1e94b980b887df8717, user_id=beccca8676944bc4b3e6c9828998da55, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:42.200420 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f9c3f5-c399-4c17-8d96-5f9a30497307 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:42.215857 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1141/2286] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:23:42 2021] PUT /identity/v3/projects/b3b11af4073e4f1e94b980b887df8717/users/beccca8676944bc4b3e6c9828998da55/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:23:45.763142 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c6047-0be4-4ed8-adae-e16102e6deb1 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:45.763728 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c6047-0be4-4ed8-adae-e16102e6deb1 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:45.763947 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194c6047-0be4-4ed8-adae-e16102e6deb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:45.795925 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-194c6047-0be4-4ed8-adae-e16102e6deb1 None None] MFA Rules not processed for user `19d72c913c2b4442836a991120eec243`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:23:45.797766 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-194c6047-0be4-4ed8-adae-e16102e6deb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:45.917757 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1146/2287] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Nov 29 20:23:45 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:23:45.941533 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9c3f5-c399-4c17-8d96-5f9a30497307 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:45.943566 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-01f9c3f5-c399-4c17-8d96-5f9a30497307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:46.126632 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9c3f5-c399-4c17-8d96-5f9a30497307 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:46.137808 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb5031-9d9d-47c0-8a13-40c55edc726c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51fc6fd9b37447bba1759a702b86ce6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:46.139404 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb5031-9d9d-47c0-8a13-40c55edc726c service swift] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:46.139702 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb5031-9d9d-47c0-8a13-40c55edc726c service swift] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:46.140021 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb5031-9d9d-47c0-8a13-40c55edc726c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:46.160433 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb5031-9d9d-47c0-8a13-40c55edc726c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:46.169738 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb5031-9d9d-47c0-8a13-40c55edc726c service swift] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:46.224234 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1142/2288] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Nov 29 20:23:45 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:23:48.429684 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caccc25-1eb7-4da3-b65b-b3b2318639d0 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:48.430354 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caccc25-1eb7-4da3-b65b-b3b2318639d0 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:48.430354 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caccc25-1eb7-4da3-b65b-b3b2318639d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:48.488259 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-0caccc25-1eb7-4da3-b65b-b3b2318639d0 None None] MFA Rules not processed for user `beccca8676944bc4b3e6c9828998da55`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:23:48.489719 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-0caccc25-1eb7-4da3-b65b-b3b2318639d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:48.612050 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1147/2289] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:23:48 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:23:48.624841 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb5031-9d9d-47c0-8a13-40c55edc726c service swift] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:48.629582 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-dbcb5031-9d9d-47c0-8a13-40c55edc726c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:48.756345 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb5031-9d9d-47c0-8a13-40c55edc726c service swift] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:48.768082 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d7017-056a-4e8c-9850-ce231076d6d6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcc415af1f5a42febbdbd187e066cf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:48.770134 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d7017-056a-4e8c-9850-ce231076d6d6 service glance] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:48.771703 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d7017-056a-4e8c-9850-ce231076d6d6 service glance] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:48.773371 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d7017-056a-4e8c-9850-ce231076d6d6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:48.862049 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d7017-056a-4e8c-9850-ce231076d6d6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:48.863697 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d7017-056a-4e8c-9850-ce231076d6d6 service glance] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:48.891019 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1143/2290] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:23:48 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:23:49.131867 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b5a8a-cfa1-4453-a15c-09756c775ab5 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:49.132148 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b5a8a-cfa1-4453-a15c-09756c775ab5 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:49.132416 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b5a8a-cfa1-4453-a15c-09756c775ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:49.160195 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-761b5a8a-cfa1-4453-a15c-09756c775ab5 None None] MFA Rules not processed for user `19d72c913c2b4442836a991120eec243`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:23:49.161637 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-761b5a8a-cfa1-4453-a15c-09756c775ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:23:49.178744 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1148/2291] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Nov 29 20:23:49 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:23:49.194769 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d7017-056a-4e8c-9850-ce231076d6d6 service glance] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:23:49.209891 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d7017-056a-4e8c-9850-ce231076d6d6 service glance] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:23:49.215726 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a25913-c719-4766-adf4-a05a3d72ef17 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51fc6fd9b37447bba1759a702b86ce6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:23:49.218736 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a25913-c719-4766-adf4-a05a3d72ef17 service swift] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:23:49.219211 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a25913-c719-4766-adf4-a05a3d72ef17 service swift] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:23:49.219582 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a25913-c719-4766-adf4-a05a3d72ef17 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:23:49.247635 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a25913-c719-4766-adf4-a05a3d72ef17 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:23:49.249345 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a25913-c719-4766-adf4-a05a3d72ef17 service swift] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:23:49.273860 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1144/2292] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Nov 29 20:23:49 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:24:00.639569 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac44b3-e368-49a9-9edc-e757ae1a43bc None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:24:00.640772 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac44b3-e368-49a9-9edc-e757ae1a43bc None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:24:00.641328 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac44b3-e368-49a9-9edc-e757ae1a43bc None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:24:00.644843 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1149/2293] 10.222.0.15 () {54 vars in 912 bytes} [Mon Nov 29 20:24:00 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:24:00.659389 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705f9ac-9995-4691-ae73-bc73eb74a0e8 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:24:00.660457 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705f9ac-9995-4691-ae73-bc73eb74a0e8 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:24:00.660913 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705f9ac-9995-4691-ae73-bc73eb74a0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:24:00.680953 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-2705f9ac-9995-4691-ae73-bc73eb74a0e8 None None] MFA Rules not processed for user `b954c18d7e9349e899f4c1cd42b89166`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:24:00.682236 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-2705f9ac-9995-4691-ae73-bc73eb74a0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:24:00.767026 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1145/2294] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Nov 29 20:24:00 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:24:00.788926 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac44b3-e368-49a9-9edc-e757ae1a43bc None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:24:00.792881 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-17ac44b3-e368-49a9-9edc-e757ae1a43bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:24:00.817004 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac44b3-e368-49a9-9edc-e757ae1a43bc None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:24:00.823553 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d77a634-057f-489b-b43c-8ec4348856a3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b954c18d7e9349e899f4c1cd42b89166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:24:00.824199 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77a634-057f-489b-b43c-8ec4348856a3 service placement] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:24:00.837295 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77a634-057f-489b-b43c-8ec4348856a3 service placement] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:24:00.837739 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77a634-057f-489b-b43c-8ec4348856a3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:24:00.848354 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d77a634-057f-489b-b43c-8ec4348856a3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:24:00.851056 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d77a634-057f-489b-b43c-8ec4348856a3 service placement] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:24:00.862340 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1150/2295] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:24:00 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:24:02.654328 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3ba3f-4eac-43c6-88ce-9ad9f3be7aec None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:24:02.655493 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3ba3f-4eac-43c6-88ce-9ad9f3be7aec None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:24:02.656958 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3ba3f-4eac-43c6-88ce-9ad9f3be7aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:24:02.681163 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-d8e3ba3f-4eac-43c6-88ce-9ad9f3be7aec None None] MFA Rules not processed for user `82869068bf684f1d8e6248fca88a49bb`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:24:02.682358 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-d8e3ba3f-4eac-43c6-88ce-9ad9f3be7aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:24:02.689484 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1146/2296] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:24:02 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:24:05.926885 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47353507-2e64-4ee0-9e58-3aa387f7bf2c None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:24:05.928095 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47353507-2e64-4ee0-9e58-3aa387f7bf2c None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:24:05.928613 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47353507-2e64-4ee0-9e58-3aa387f7bf2c None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:24:05.930808 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1151/2297] 10.222.0.15 () {54 vars in 921 bytes} [Mon Nov 29 20:24:05 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Nov 29 20:24:05.937447 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5543d-4aa6-4c39-9f9c-221bcd474d71 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:24:05.937942 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5543d-4aa6-4c39-9f9c-221bcd474d71 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:24:05.938124 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5543d-4aa6-4c39-9f9c-221bcd474d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:24:06.002437 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-8dc5543d-4aa6-4c39-9f9c-221bcd474d71 None None] MFA Rules not processed for user `5f76a8c3d04e440b92d12ced18d97941`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:24:06.003985 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-8dc5543d-4aa6-4c39-9f9c-221bcd474d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:24:06.097297 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1147/2298] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Nov 29 20:24:05 2021] POST /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:24:06.111942 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47353507-2e64-4ee0-9e58-3aa387f7bf2c None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:24:06.114986 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-47353507-2e64-4ee0-9e58-3aa387f7bf2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:24:06.139709 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47353507-2e64-4ee0-9e58-3aa387f7bf2c None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:24:06.159694 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af41e9d-a533-4776-9310-fe6b78b36515 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcc415af1f5a42febbdbd187e066cf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:24:06.160538 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af41e9d-a533-4776-9310-fe6b78b36515 service glance] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:24:06.160944 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af41e9d-a533-4776-9310-fe6b78b36515 service glance] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:24:06.161322 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af41e9d-a533-4776-9310-fe6b78b36515 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:24:06.172854 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af41e9d-a533-4776-9310-fe6b78b36515 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:24:06.175032 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af41e9d-a533-4776-9310-fe6b78b36515 service glance] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:24:06.230240 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1152/2299] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:24:06 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:24:06.328522 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc7563-046d-4664-90ca-efebfad524c2 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:24:06.328807 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc7563-046d-4664-90ca-efebfad524c2 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:24:06.329078 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cc7563-046d-4664-90ca-efebfad524c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:24:06.331029 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d2f54-8a7b-4b95-9786-8aa76189f575 None None] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:24:06.331422 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d2f54-8a7b-4b95-9786-8aa76189f575 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:24:06.331944 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d2f54-8a7b-4b95-9786-8aa76189f575 None None] PATH_INFO: `/` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:24:06.334055 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1153/2300] 10.222.0.15 () {54 vars in 921 bytes} [Mon Nov 29 20:24:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 29 20:24:06.340712 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8808e3-93ce-4035-8a83-11b01594ff04 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:24:06.341344 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8808e3-93ce-4035-8a83-11b01594ff04 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:24:06.342406 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8808e3-93ce-4035-8a83-11b01594ff04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:24:06.352613 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-82cc7563-046d-4664-90ca-efebfad524c2 None None] MFA Rules not processed for user `19d72c913c2b4442836a991120eec243`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:24:06.354008 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-82cc7563-046d-4664-90ca-efebfad524c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:24:06.364799 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1148/2301] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Nov 29 20:24:06 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:24:06.370034 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-6f8808e3-93ce-4035-8a83-11b01594ff04 None None] MFA Rules not processed for user `821fb4ce82de47ca873fc22d29d4f957`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:24:06.371448 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-6f8808e3-93ce-4035-8a83-11b01594ff04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:24:06.380393 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc7563-046d-4664-90ca-efebfad524c2 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:24:06.397551 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cc7563-046d-4664-90ca-efebfad524c2 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:24:06.412701 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2546c7-8f94-4797-b72c-68c63b676d86 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51fc6fd9b37447bba1759a702b86ce6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:24:06.413364 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2546c7-8f94-4797-b72c-68c63b676d86 service swift] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:24:06.413643 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2546c7-8f94-4797-b72c-68c63b676d86 service swift] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:24:06.413911 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2546c7-8f94-4797-b72c-68c63b676d86 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:24:06.426776 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2546c7-8f94-4797-b72c-68c63b676d86 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:24:06.428480 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2546c7-8f94-4797-b72c-68c63b676d86 service swift] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:24:06.447244 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1149/2302] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Nov 29 20:24:06 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 29 20:24:06.462607 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1154/2303] 10.222.0.15 () {58 vars in 1018 bytes} [Mon Nov 29 20:24:06 2021] POST /identity/v3/auth/tokens => generated 3111 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:24:06.480214 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2546c7-8f94-4797-b72c-68c63b676d86 service swift] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:24:06.482277 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-fd2546c7-8f94-4797-b72c-68c63b676d86 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:24:06.496786 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2546c7-8f94-4797-b72c-68c63b676d86 service swift] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:24:06.513628 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154e4d8-a9f4-47dd-a326-cba18a52b70d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:24:06.516987 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154e4d8-a9f4-47dd-a326-cba18a52b70d service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:24:06.517761 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154e4d8-a9f4-47dd-a326-cba18a52b70d service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:24:06.518536 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154e4d8-a9f4-47dd-a326-cba18a52b70d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:24:06.546524 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b154e4d8-a9f4-47dd-a326-cba18a52b70d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:24:06.549990 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b154e4d8-a9f4-47dd-a326-cba18a52b70d service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:24:06.561135 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1150/2304] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:24:06 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:24:10.750316 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8808e3-93ce-4035-8a83-11b01594ff04 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:24:10.751861 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-6f8808e3-93ce-4035-8a83-11b01594ff04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:24:10.835537 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8808e3-93ce-4035-8a83-11b01594ff04 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:24:10.840545 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1a73a-abea-4e18-b3eb-4ad3e2af64a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:24:10.841662 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1a73a-abea-4e18-b3eb-4ad3e2af64a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:24:10.842153 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1a73a-abea-4e18-b3eb-4ad3e2af64a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:24:10.842613 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb1a73a-abea-4e18-b3eb-4ad3e2af64a6 admin admin] PATH_INFO: `/v3/users/0f38d07e06654204a3353e4af1a64b8a` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:24:10.844374 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1a73a-abea-4e18-b3eb-4ad3e2af64a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f38d07e06654204a3353e4af1a64b8a)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:24:10.847295 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb1a73a-abea-4e18-b3eb-4ad3e2af64a6 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:24:10.898059 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-2fb1a73a-abea-4e18-b3eb-4ad3e2af64a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f38d07e06654204a3353e4af1a64b8a'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:24:10.905339 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-2fb1a73a-abea-4e18-b3eb-4ad3e2af64a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f38d07e06654204a3353e4af1a64b8a'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:24:10.915182 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-2fb1a73a-abea-4e18-b3eb-4ad3e2af64a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f38d07e06654204a3353e4af1a64b8a'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:24:10.936222 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-2fb1a73a-abea-4e18-b3eb-4ad3e2af64a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f38d07e06654204a3353e4af1a64b8a'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:24:10.937062 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-2fb1a73a-abea-4e18-b3eb-4ad3e2af64a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f38d07e06654204a3353e4af1a64b8a'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:24:10.943788 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1155/2305] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:24:10 2021] DELETE /identity/v3/users/0f38d07e06654204a3353e4af1a64b8a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:24:11.191861 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154e4d8-a9f4-47dd-a326-cba18a52b70d service neutron] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:24:11.213542 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154e4d8-a9f4-47dd-a326-cba18a52b70d service neutron] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:24:11.288629 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84fc79f-fedf-4b69-82a2-75bd268e6e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:24:11.289419 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84fc79f-fedf-4b69-82a2-75bd268e6e05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:24:11.289698 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84fc79f-fedf-4b69-82a2-75bd268e6e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:24:11.289969 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84fc79f-fedf-4b69-82a2-75bd268e6e05 admin admin] PATH_INFO: `/v3/projects/4e32390102a14c368c919e4b5eb1b559` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:24:11.291226 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84fc79f-fedf-4b69-82a2-75bd268e6e05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e32390102a14c368c919e4b5eb1b559)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:24:11.293317 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84fc79f-fedf-4b69-82a2-75bd268e6e05 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:24:11.358170 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-a84fc79f-fedf-4b69-82a2-75bd268e6e05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e32390102a14c368c919e4b5eb1b559', 'request_id': 'req-a84fc79f-fedf-4b69-82a2-75bd268e6e05'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:24:11.365012 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-a84fc79f-fedf-4b69-82a2-75bd268e6e05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e32390102a14c368c919e4b5eb1b559', 'request_id': 'req-a84fc79f-fedf-4b69-82a2-75bd268e6e05'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:24:11.376787 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-a84fc79f-fedf-4b69-82a2-75bd268e6e05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e32390102a14c368c919e4b5eb1b559', 'request_id': 'req-a84fc79f-fedf-4b69-82a2-75bd268e6e05'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:24:11.396817 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-a84fc79f-fedf-4b69-82a2-75bd268e6e05 admin admin] The token cache is being invalidate because project 4e32390102a14c368c919e4b5eb1b559 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:24:11.397112 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-a84fc79f-fedf-4b69-82a2-75bd268e6e05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:24:11.397749 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-a84fc79f-fedf-4b69-82a2-75bd268e6e05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:24:11.399318 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1151/2306] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:24:11 2021] DELETE /identity/v3/projects/4e32390102a14c368c919e4b5eb1b559 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:24:11.403349 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1a73a-abea-4e18-b3eb-4ad3e2af64a6 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:24:11.404841 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-2fb1a73a-abea-4e18-b3eb-4ad3e2af64a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:24:11.418800 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb1a73a-abea-4e18-b3eb-4ad3e2af64a6 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:24:11.476999 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0b2fb-970b-4c49-8473-ada061af0d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:24:11.477994 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0b2fb-970b-4c49-8473-ada061af0d59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:24:11.478340 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0b2fb-970b-4c49-8473-ada061af0d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:24:11.478681 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0b2fb-970b-4c49-8473-ada061af0d59 admin admin] PATH_INFO: `/v3/users/287dff1403884c059e491eecba659da0` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:24:11.480010 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0b2fb-970b-4c49-8473-ada061af0d59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=287dff1403884c059e491eecba659da0)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:24:11.482136 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0b2fb-970b-4c49-8473-ada061af0d59 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:24:11.535305 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-2cc0b2fb-970b-4c49-8473-ada061af0d59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '287dff1403884c059e491eecba659da0'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:24:11.542658 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-2cc0b2fb-970b-4c49-8473-ada061af0d59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '287dff1403884c059e491eecba659da0'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:24:11.554609 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-2cc0b2fb-970b-4c49-8473-ada061af0d59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '287dff1403884c059e491eecba659da0'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:24:11.574369 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-2cc0b2fb-970b-4c49-8473-ada061af0d59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '287dff1403884c059e491eecba659da0'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:24:11.575129 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-2cc0b2fb-970b-4c49-8473-ada061af0d59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '287dff1403884c059e491eecba659da0'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:24:11.581209 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1156/2307] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:24:11 2021] DELETE /identity/v3/users/287dff1403884c059e491eecba659da0 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:24:11.757925 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84fc79f-fedf-4b69-82a2-75bd268e6e05 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:24:11.759622 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-a84fc79f-fedf-4b69-82a2-75bd268e6e05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:24:11.782381 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84fc79f-fedf-4b69-82a2-75bd268e6e05 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:24:11.852655 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1cf917-87c8-4949-92c4-a27e5108cf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:24:11.853519 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1cf917-87c8-4949-92c4-a27e5108cf8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:24:11.853807 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1cf917-87c8-4949-92c4-a27e5108cf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:24:11.854081 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1cf917-87c8-4949-92c4-a27e5108cf8f admin admin] PATH_INFO: `/v3/projects/d1cb90edfc164901be51862ee6c9759b` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:24:11.855585 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1cf917-87c8-4949-92c4-a27e5108cf8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1cb90edfc164901be51862ee6c9759b)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:24:11.858011 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1cf917-87c8-4949-92c4-a27e5108cf8f admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:24:11.907381 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-ac1cf917-87c8-4949-92c4-a27e5108cf8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1cb90edfc164901be51862ee6c9759b', 'request_id': 'req-ac1cf917-87c8-4949-92c4-a27e5108cf8f'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:24:11.913448 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-ac1cf917-87c8-4949-92c4-a27e5108cf8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1cb90edfc164901be51862ee6c9759b', 'request_id': 'req-ac1cf917-87c8-4949-92c4-a27e5108cf8f'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:24:11.918686 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-ac1cf917-87c8-4949-92c4-a27e5108cf8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1cb90edfc164901be51862ee6c9759b', 'request_id': 'req-ac1cf917-87c8-4949-92c4-a27e5108cf8f'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:24:11.933409 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-ac1cf917-87c8-4949-92c4-a27e5108cf8f admin admin] The token cache is being invalidate because project d1cb90edfc164901be51862ee6c9759b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:24:11.933697 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-ac1cf917-87c8-4949-92c4-a27e5108cf8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:24:11.934337 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-ac1cf917-87c8-4949-92c4-a27e5108cf8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:24:11.935918 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1152/2308] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:24:11 2021] DELETE /identity/v3/projects/d1cb90edfc164901be51862ee6c9759b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:25:25.685600 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0b2fb-970b-4c49-8473-ada061af0d59 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:25:25.687271 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-2cc0b2fb-970b-4c49-8473-ada061af0d59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:25:25.766782 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0b2fb-970b-4c49-8473-ada061af0d59 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:25:25.816474 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0ad97-45e4-431d-8cca-2f407fff3826 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:25:25.817135 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0ad97-45e4-431d-8cca-2f407fff3826 service cinder] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:25:25.817417 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0ad97-45e4-431d-8cca-2f407fff3826 service cinder] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:25:25.817689 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0ad97-45e4-431d-8cca-2f407fff3826 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:25:25.819823 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-38e0ad97-45e4-431d-8cca-2f407fff3826 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:25:25.879150 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0ad97-45e4-431d-8cca-2f407fff3826 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:25:25.880587 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0ad97-45e4-431d-8cca-2f407fff3826 service cinder] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:25:25.889916 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1157/2309] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:25:25 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:25:26.954435 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1cf917-87c8-4949-92c4-a27e5108cf8f admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:25:26.955981 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-ac1cf917-87c8-4949-92c4-a27e5108cf8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:25:27.020598 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1cf917-87c8-4949-92c4-a27e5108cf8f admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:25:27.024080 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d176738-ed79-40fe-99b3-5e7c335a0300 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:25:27.024733 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d176738-ed79-40fe-99b3-5e7c335a0300 service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:25:27.025016 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d176738-ed79-40fe-99b3-5e7c335a0300 service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:25:27.025290 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d176738-ed79-40fe-99b3-5e7c335a0300 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:25:27.027124 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-8d176738-ed79-40fe-99b3-5e7c335a0300 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:25:27.093508 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d176738-ed79-40fe-99b3-5e7c335a0300 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:25:27.094995 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d176738-ed79-40fe-99b3-5e7c335a0300 service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:25:27.105964 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1153/2310] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:25:26 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:25:28.308654 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0ad97-45e4-431d-8cca-2f407fff3826 service cinder] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:25:28.310181 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-38e0ad97-45e4-431d-8cca-2f407fff3826 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:25:28.321590 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0ad97-45e4-431d-8cca-2f407fff3826 service cinder] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:25:28.325334 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4d872-90b9-4db8-802b-5bc42b10e55d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:25:28.325968 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4d872-90b9-4db8-802b-5bc42b10e55d service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:25:28.326243 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4d872-90b9-4db8-802b-5bc42b10e55d service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:25:28.326498 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4d872-90b9-4db8-802b-5bc42b10e55d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:25:28.328211 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-2fd4d872-90b9-4db8-802b-5bc42b10e55d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:25:28.341595 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd4d872-90b9-4db8-802b-5bc42b10e55d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:25:28.343105 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd4d872-90b9-4db8-802b-5bc42b10e55d service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:25:28.353949 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1158/2311] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:25:28 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:25:37.747230 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d176738-ed79-40fe-99b3-5e7c335a0300 service neutron] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:25:37.748987 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-8d176738-ed79-40fe-99b3-5e7c335a0300 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:25:37.761345 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d176738-ed79-40fe-99b3-5e7c335a0300 service neutron] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:25:37.765879 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f74d9-d095-4f78-8f9b-8b7b32258e2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:25:37.766549 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f74d9-d095-4f78-8f9b-8b7b32258e2f service cinder] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:25:37.766826 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f74d9-d095-4f78-8f9b-8b7b32258e2f service cinder] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:25:37.767342 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f74d9-d095-4f78-8f9b-8b7b32258e2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:25:37.769782 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-bb8f74d9-d095-4f78-8f9b-8b7b32258e2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:25:37.839159 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f74d9-d095-4f78-8f9b-8b7b32258e2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:25:37.840706 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f74d9-d095-4f78-8f9b-8b7b32258e2f service cinder] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:25:37.849915 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1154/2312] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:25:37 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:25:40.173622 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4d872-90b9-4db8-802b-5bc42b10e55d service neutron] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:25:40.175301 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-2fd4d872-90b9-4db8-802b-5bc42b10e55d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:25:40.187524 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4d872-90b9-4db8-802b-5bc42b10e55d service neutron] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:25:40.192673 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7f759-7b70-4f39-84fd-d1ef0e4279dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:25:40.193439 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7f759-7b70-4f39-84fd-d1ef0e4279dd service cinder] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:25:40.193968 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7f759-7b70-4f39-84fd-d1ef0e4279dd service cinder] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:25:40.194311 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7f759-7b70-4f39-84fd-d1ef0e4279dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:25:40.196704 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-a8b7f759-7b70-4f39-84fd-d1ef0e4279dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:25:40.261734 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7f759-7b70-4f39-84fd-d1ef0e4279dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:25:40.263271 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b7f759-7b70-4f39-84fd-d1ef0e4279dd service cinder] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:25:40.272631 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1159/2313] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:25:40 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:25:48.373770 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f74d9-d095-4f78-8f9b-8b7b32258e2f service cinder] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:25:48.375422 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-bb8f74d9-d095-4f78-8f9b-8b7b32258e2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:25:48.392224 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f74d9-d095-4f78-8f9b-8b7b32258e2f service cinder] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:25:48.399981 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a53742-0a59-4c5c-8444-1ade95b24eba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:25:48.400626 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a53742-0a59-4c5c-8444-1ade95b24eba service nova] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:25:48.400895 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a53742-0a59-4c5c-8444-1ade95b24eba service nova] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:25:48.401160 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a53742-0a59-4c5c-8444-1ade95b24eba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:25:48.403240 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-64a53742-0a59-4c5c-8444-1ade95b24eba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:25:48.462126 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a53742-0a59-4c5c-8444-1ade95b24eba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:25:48.463836 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a53742-0a59-4c5c-8444-1ade95b24eba service nova] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:25:48.472691 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1155/2314] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:25:48 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:26:39.815027 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7f759-7b70-4f39-84fd-d1ef0e4279dd service cinder] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:26:39.825126 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7f759-7b70-4f39-84fd-d1ef0e4279dd service cinder] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:26:39.829769 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d714915-8bca-4c4f-8f1b-08d5c9aef4e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:26:39.830797 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d714915-8bca-4c4f-8f1b-08d5c9aef4e2 service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:26:39.830797 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d714915-8bca-4c4f-8f1b-08d5c9aef4e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:26:39.831078 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d714915-8bca-4c4f-8f1b-08d5c9aef4e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:26:39.833097 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-8d714915-8bca-4c4f-8f1b-08d5c9aef4e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:26:39.843752 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d714915-8bca-4c4f-8f1b-08d5c9aef4e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:26:39.845187 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d714915-8bca-4c4f-8f1b-08d5c9aef4e2 service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:26:39.853438 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1160/2315] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:26:39 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:27:11.206035 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a53742-0a59-4c5c-8444-1ade95b24eba service nova] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:11.207670 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-64a53742-0a59-4c5c-8444-1ade95b24eba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:11.223435 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a53742-0a59-4c5c-8444-1ade95b24eba service nova] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:11.230441 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35193d-63a9-4c65-9e1f-6a498491ba18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:11.231126 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35193d-63a9-4c65-9e1f-6a498491ba18 service nova] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:11.231411 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35193d-63a9-4c65-9e1f-6a498491ba18 service nova] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:11.231686 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35193d-63a9-4c65-9e1f-6a498491ba18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:11.233543 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-9f35193d-63a9-4c65-9e1f-6a498491ba18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:11.246265 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35193d-63a9-4c65-9e1f-6a498491ba18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:11.247890 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35193d-63a9-4c65-9e1f-6a498491ba18 service nova] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:11.258767 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1156/2316] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:27:11 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:27:12.650293 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d714915-8bca-4c4f-8f1b-08d5c9aef4e2 service neutron] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:12.659138 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d714915-8bca-4c4f-8f1b-08d5c9aef4e2 service neutron] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:12.663298 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d716ee-5f31-4c06-922f-f51c5898bc08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:12.663952 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d716ee-5f31-4c06-922f-f51c5898bc08 service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:12.664228 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d716ee-5f31-4c06-922f-f51c5898bc08 service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:12.664499 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d716ee-5f31-4c06-922f-f51c5898bc08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:12.666451 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-59d716ee-5f31-4c06-922f-f51c5898bc08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:12.733897 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d716ee-5f31-4c06-922f-f51c5898bc08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:12.735349 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d716ee-5f31-4c06-922f-f51c5898bc08 service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:12.744953 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1161/2317] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:27:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:27:13.567393 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35193d-63a9-4c65-9e1f-6a498491ba18 service nova] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:13.568966 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-9f35193d-63a9-4c65-9e1f-6a498491ba18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:13.586214 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35193d-63a9-4c65-9e1f-6a498491ba18 service nova] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:13.591143 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857b0b7-b554-4246-ac12-a7d27882b163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:13.592038 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857b0b7-b554-4246-ac12-a7d27882b163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:13.592418 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857b0b7-b554-4246-ac12-a7d27882b163 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:13.592691 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857b0b7-b554-4246-ac12-a7d27882b163 admin admin] PATH_INFO: `/v3/users/b7b0ec8500024b14802bd38b95e822c8` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:13.593918 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a857b0b7-b554-4246-ac12-a7d27882b163 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7b0ec8500024b14802bd38b95e822c8)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:13.595925 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a857b0b7-b554-4246-ac12-a7d27882b163 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:13.644739 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-a857b0b7-b554-4246-ac12-a7d27882b163 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7b0ec8500024b14802bd38b95e822c8'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:13.651444 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-a857b0b7-b554-4246-ac12-a7d27882b163 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7b0ec8500024b14802bd38b95e822c8'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:13.663321 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-a857b0b7-b554-4246-ac12-a7d27882b163 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7b0ec8500024b14802bd38b95e822c8'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:13.664155 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-a857b0b7-b554-4246-ac12-a7d27882b163 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7b0ec8500024b14802bd38b95e822c8'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:13.664920 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-a857b0b7-b554-4246-ac12-a7d27882b163 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7b0ec8500024b14802bd38b95e822c8'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:13.680831 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1157/2318] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:27:13 2021] DELETE /identity/v3/users/b7b0ec8500024b14802bd38b95e822c8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:27:13.863410 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d716ee-5f31-4c06-922f-f51c5898bc08 service neutron] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:13.876560 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d716ee-5f31-4c06-922f-f51c5898bc08 service neutron] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:13.932653 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5a064-f1bb-405e-bc99-b84d9dca581f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:13.933522 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5a064-f1bb-405e-bc99-b84d9dca581f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:13.933803 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5a064-f1bb-405e-bc99-b84d9dca581f admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:13.934102 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5a064-f1bb-405e-bc99-b84d9dca581f admin admin] PATH_INFO: `/v3/projects/a94c1f8840c045649f25ec35f9d69558` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:13.935479 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5a064-f1bb-405e-bc99-b84d9dca581f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a94c1f8840c045649f25ec35f9d69558)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:13.937409 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5a064-f1bb-405e-bc99-b84d9dca581f admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:13.989015 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-07e5a064-f1bb-405e-bc99-b84d9dca581f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a94c1f8840c045649f25ec35f9d69558', 'request_id': 'req-07e5a064-f1bb-405e-bc99-b84d9dca581f'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:13.996557 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-07e5a064-f1bb-405e-bc99-b84d9dca581f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a94c1f8840c045649f25ec35f9d69558', 'request_id': 'req-07e5a064-f1bb-405e-bc99-b84d9dca581f'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:14.008694 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-07e5a064-f1bb-405e-bc99-b84d9dca581f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a94c1f8840c045649f25ec35f9d69558', 'request_id': 'req-07e5a064-f1bb-405e-bc99-b84d9dca581f'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:14.020702 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-07e5a064-f1bb-405e-bc99-b84d9dca581f admin admin] The token cache is being invalidate because project a94c1f8840c045649f25ec35f9d69558 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:27:14.021033 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-07e5a064-f1bb-405e-bc99-b84d9dca581f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:14.021673 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-07e5a064-f1bb-405e-bc99-b84d9dca581f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:14.023588 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1162/2319] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:27:13 2021] DELETE /identity/v3/projects/a94c1f8840c045649f25ec35f9d69558 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:27:14.029211 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc40380-f90e-4ee4-9574-88ca83e7e909 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:14.029593 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc40380-f90e-4ee4-9574-88ca83e7e909 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:14.029938 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc40380-f90e-4ee4-9574-88ca83e7e909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:14.049135 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-5dc40380-f90e-4ee4-9574-88ca83e7e909 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:27:14.050338 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-5dc40380-f90e-4ee4-9574-88ca83e7e909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:14.110299 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1158/2320] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:27:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:27:14.119158 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717fb3b-f11f-4818-8f00-6969f6952ccb None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:14.119528 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717fb3b-f11f-4818-8f00-6969f6952ccb None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:14.119813 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717fb3b-f11f-4818-8f00-6969f6952ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:14.140396 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-6717fb3b-f11f-4818-8f00-6969f6952ccb None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:27:14.141616 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-6717fb3b-f11f-4818-8f00-6969f6952ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:14.151570 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1163/2321] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:27:14 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:27:14.156272 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc40380-f90e-4ee4-9574-88ca83e7e909 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:14.169761 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc40380-f90e-4ee4-9574-88ca83e7e909 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:14.175007 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84fe3d-3c4e-4665-bb8c-4e402d92b7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:14.175665 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84fe3d-3c4e-4665-bb8c-4e402d92b7ac admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:14.175949 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84fe3d-3c4e-4665-bb8c-4e402d92b7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:14.176223 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84fe3d-3c4e-4665-bb8c-4e402d92b7ac admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:14.176949 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d84fe3d-3c4e-4665-bb8c-4e402d92b7ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:27:14.177254 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d84fe3d-3c4e-4665-bb8c-4e402d92b7ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:14.178944 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d84fe3d-3c4e-4665-bb8c-4e402d92b7ac admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:14.190828 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1159/2322] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:27:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:27:14.195650 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717fb3b-f11f-4818-8f00-6969f6952ccb None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:14.204980 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717fb3b-f11f-4818-8f00-6969f6952ccb None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:14.210139 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490dfaa-5585-4fea-b763-691ac7f8bd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:14.210808 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490dfaa-5585-4fea-b763-691ac7f8bd1b admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:14.211122 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490dfaa-5585-4fea-b763-691ac7f8bd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:14.211394 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490dfaa-5585-4fea-b763-691ac7f8bd1b admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:14.212110 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490dfaa-5585-4fea-b763-691ac7f8bd1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:14.214032 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490dfaa-5585-4fea-b763-691ac7f8bd1b admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:14.255825 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1164/2323] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:27:14 2021] POST /identity/v3/projects => generated 367 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 29 20:27:14.262119 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84fe3d-3c4e-4665-bb8c-4e402d92b7ac admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:14.276368 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84fe3d-3c4e-4665-bb8c-4e402d92b7ac admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:14.332617 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c832e-8d89-4e0d-afa2-332ae9c5a81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:14.333270 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c832e-8d89-4e0d-afa2-332ae9c5a81d admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:14.333553 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c832e-8d89-4e0d-afa2-332ae9c5a81d admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:14.333816 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c832e-8d89-4e0d-afa2-332ae9c5a81d admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:14.334506 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01c832e-8d89-4e0d-afa2-332ae9c5a81d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:14.336532 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01c832e-8d89-4e0d-afa2-332ae9c5a81d admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:14.362706 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1160/2324] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:27:14 2021] POST /identity/v3/users => generated 284 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:27:14.367065 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490dfaa-5585-4fea-b763-691ac7f8bd1b admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:14.377569 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490dfaa-5585-4fea-b763-691ac7f8bd1b admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:14.383488 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff55a0-f53f-425f-b7fe-9426c7f710f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:14.384136 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff55a0-f53f-425f-b7fe-9426c7f710f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:14.384421 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff55a0-f53f-425f-b7fe-9426c7f710f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:14.384712 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff55a0-f53f-425f-b7fe-9426c7f710f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:14.385453 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff55a0-f53f-425f-b7fe-9426c7f710f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:14.387128 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff55a0-f53f-425f-b7fe-9426c7f710f5 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:14.397954 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1165/2325] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:27:14 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:27:14.402092 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c832e-8d89-4e0d-afa2-332ae9c5a81d admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:14.412785 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c832e-8d89-4e0d-afa2-332ae9c5a81d admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:14.418439 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493381fa-e9ae-43b4-b971-d056dd8e6fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:14.419147 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493381fa-e9ae-43b4-b971-d056dd8e6fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:14.419433 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493381fa-e9ae-43b4-b971-d056dd8e6fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:14.419696 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493381fa-e9ae-43b4-b971-d056dd8e6fe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:14.420482 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493381fa-e9ae-43b4-b971-d056dd8e6fe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:14.422065 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493381fa-e9ae-43b4-b971-d056dd8e6fe5 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:14.432279 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1161/2326] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:27:14 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:27:14.437780 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff55a0-f53f-425f-b7fe-9426c7f710f5 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:14.447875 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff55a0-f53f-425f-b7fe-9426c7f710f5 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:14.452633 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01c377-e80a-4740-9d75-491188ed675d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:14.453514 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01c377-e80a-4740-9d75-491188ed675d admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:14.453797 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01c377-e80a-4740-9d75-491188ed675d admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:14.454070 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01c377-e80a-4740-9d75-491188ed675d admin admin] PATH_INFO: `/v3/projects/3eaaefd9071b4f61ab88163aaa0ba014/users/f8f403bc0bf5464791fa226d4bfdb905/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:14.468250 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01c377-e80a-4740-9d75-491188ed675d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eaaefd9071b4f61ab88163aaa0ba014, user_id=f8f403bc0bf5464791fa226d4bfdb905, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:14.470888 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01c377-e80a-4740-9d75-491188ed675d admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:14.486236 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1166/2327] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:27:14 2021] PUT /identity/v3/projects/3eaaefd9071b4f61ab88163aaa0ba014/users/f8f403bc0bf5464791fa226d4bfdb905/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:27:14.496455 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af0433-bb12-4c5c-b6bd-69368906cfd1 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:14.496853 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af0433-bb12-4c5c-b6bd-69368906cfd1 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:14.497189 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af0433-bb12-4c5c-b6bd-69368906cfd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:14.525823 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-f2af0433-bb12-4c5c-b6bd-69368906cfd1 None None] MFA Rules not processed for user `f8f403bc0bf5464791fa226d4bfdb905`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:27:14.526972 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-f2af0433-bb12-4c5c-b6bd-69368906cfd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:14.602785 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1162/2328] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:27:14 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:27:14.618416 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01c377-e80a-4740-9d75-491188ed675d admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:14.621069 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-db01c377-e80a-4740-9d75-491188ed675d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:14.689765 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01c377-e80a-4740-9d75-491188ed675d admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:14.695482 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b36b2-f5bd-4068-99bc-4f75b76cd558 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:14.696094 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b36b2-f5bd-4068-99bc-4f75b76cd558 service cinder] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:14.696403 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b36b2-f5bd-4068-99bc-4f75b76cd558 service cinder] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:14.696675 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b36b2-f5bd-4068-99bc-4f75b76cd558 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:14.709838 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b36b2-f5bd-4068-99bc-4f75b76cd558 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:14.712139 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b36b2-f5bd-4068-99bc-4f75b76cd558 service cinder] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:14.726011 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1167/2329] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:27:14 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 29 20:27:23.041027 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af0433-bb12-4c5c-b6bd-69368906cfd1 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:23.114207 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af0433-bb12-4c5c-b6bd-69368906cfd1 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:23.119609 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46810b-2e1e-422b-b99c-040d3ad98a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:23.120484 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46810b-2e1e-422b-b99c-040d3ad98a48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:23.120762 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46810b-2e1e-422b-b99c-040d3ad98a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:23.121036 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba46810b-2e1e-422b-b99c-040d3ad98a48 admin admin] PATH_INFO: `/v3/users/f8f403bc0bf5464791fa226d4bfdb905` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:23.122326 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba46810b-2e1e-422b-b99c-040d3ad98a48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8f403bc0bf5464791fa226d4bfdb905)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:23.124289 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba46810b-2e1e-422b-b99c-040d3ad98a48 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:23.174085 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-ba46810b-2e1e-422b-b99c-040d3ad98a48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8f403bc0bf5464791fa226d4bfdb905'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:23.181102 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-ba46810b-2e1e-422b-b99c-040d3ad98a48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8f403bc0bf5464791fa226d4bfdb905'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:23.193576 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-ba46810b-2e1e-422b-b99c-040d3ad98a48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8f403bc0bf5464791fa226d4bfdb905'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:23.194293 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-ba46810b-2e1e-422b-b99c-040d3ad98a48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8f403bc0bf5464791fa226d4bfdb905'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:23.194989 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-ba46810b-2e1e-422b-b99c-040d3ad98a48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8f403bc0bf5464791fa226d4bfdb905'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:23.211424 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1163/2330] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:27:23 2021] DELETE /identity/v3/users/f8f403bc0bf5464791fa226d4bfdb905 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:27:23.215922 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45f81e-bc1d-4efe-ae4f-0783e6511e3a None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:23.216432 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45f81e-bc1d-4efe-ae4f-0783e6511e3a None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:23.216525 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f45f81e-bc1d-4efe-ae4f-0783e6511e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:23.243139 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-1f45f81e-bc1d-4efe-ae4f-0783e6511e3a None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:27:23.244362 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-1f45f81e-bc1d-4efe-ae4f-0783e6511e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:23.300908 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1168/2331] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:27:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:27:23.310954 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46810b-2e1e-422b-b99c-040d3ad98a48 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:23.312411 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-ba46810b-2e1e-422b-b99c-040d3ad98a48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:23.368461 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba46810b-2e1e-422b-b99c-040d3ad98a48 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:23.372919 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d4d272-1754-42dc-a3f5-44d6577bb0c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:23.373586 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4d272-1754-42dc-a3f5-44d6577bb0c9 service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:23.373861 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4d272-1754-42dc-a3f5-44d6577bb0c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:23.374134 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4d272-1754-42dc-a3f5-44d6577bb0c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:23.383727 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d4d272-1754-42dc-a3f5-44d6577bb0c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:23.385171 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d4d272-1754-42dc-a3f5-44d6577bb0c9 service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:23.395191 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1164/2332] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:27:23 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:27:23.671934 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45f81e-bc1d-4efe-ae4f-0783e6511e3a None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:23.673382 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-1f45f81e-bc1d-4efe-ae4f-0783e6511e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:23.685312 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f45f81e-bc1d-4efe-ae4f-0783e6511e3a None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:23.690830 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427db80a-01d4-4a38-8b71-95799d28edaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:23.691731 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427db80a-01d4-4a38-8b71-95799d28edaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:23.692005 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427db80a-01d4-4a38-8b71-95799d28edaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:23.692903 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427db80a-01d4-4a38-8b71-95799d28edaa admin admin] PATH_INFO: `/v3/projects/3eaaefd9071b4f61ab88163aaa0ba014` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:23.694376 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427db80a-01d4-4a38-8b71-95799d28edaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eaaefd9071b4f61ab88163aaa0ba014)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:23.696466 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427db80a-01d4-4a38-8b71-95799d28edaa admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:23.744274 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-427db80a-01d4-4a38-8b71-95799d28edaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eaaefd9071b4f61ab88163aaa0ba014', 'request_id': 'req-427db80a-01d4-4a38-8b71-95799d28edaa'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:23.750147 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-427db80a-01d4-4a38-8b71-95799d28edaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eaaefd9071b4f61ab88163aaa0ba014', 'request_id': 'req-427db80a-01d4-4a38-8b71-95799d28edaa'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:23.759994 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-427db80a-01d4-4a38-8b71-95799d28edaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eaaefd9071b4f61ab88163aaa0ba014', 'request_id': 'req-427db80a-01d4-4a38-8b71-95799d28edaa'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:23.772121 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-427db80a-01d4-4a38-8b71-95799d28edaa admin admin] The token cache is being invalidate because project 3eaaefd9071b4f61ab88163aaa0ba014 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:27:23.772410 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-427db80a-01d4-4a38-8b71-95799d28edaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:23.773160 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-427db80a-01d4-4a38-8b71-95799d28edaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:23.774828 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1169/2333] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:27:23 2021] DELETE /identity/v3/projects/3eaaefd9071b4f61ab88163aaa0ba014 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:27:23.780716 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199ae3b-4ca1-4098-a516-18ec1855142a None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:23.780998 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199ae3b-4ca1-4098-a516-18ec1855142a None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:23.781265 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199ae3b-4ca1-4098-a516-18ec1855142a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:23.801336 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-b199ae3b-4ca1-4098-a516-18ec1855142a None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:27:23.802527 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-b199ae3b-4ca1-4098-a516-18ec1855142a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:23.861170 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1165/2334] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:27:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:27:23.869200 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33128cd6-e5b8-4e75-85c8-9212916b7277 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:23.869481 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33128cd6-e5b8-4e75-85c8-9212916b7277 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:23.869749 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33128cd6-e5b8-4e75-85c8-9212916b7277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:23.887948 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-33128cd6-e5b8-4e75-85c8-9212916b7277 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:27:23.889130 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-33128cd6-e5b8-4e75-85c8-9212916b7277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:23.898096 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1170/2335] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:27:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:27:23.902305 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199ae3b-4ca1-4098-a516-18ec1855142a None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:23.911808 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199ae3b-4ca1-4098-a516-18ec1855142a None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:23.916884 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c3b81-5132-491a-b6f9-cee1861e94b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:23.917449 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c3b81-5132-491a-b6f9-cee1861e94b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:23.917724 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c3b81-5132-491a-b6f9-cee1861e94b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:23.917991 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c3b81-5132-491a-b6f9-cee1861e94b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:23.918712 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c3b81-5132-491a-b6f9-cee1861e94b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:27:23.919042 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c3b81-5132-491a-b6f9-cee1861e94b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:23.920645 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c3b81-5132-491a-b6f9-cee1861e94b4 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:23.931933 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1166/2336] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:27:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:27:23.936073 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33128cd6-e5b8-4e75-85c8-9212916b7277 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:23.945745 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33128cd6-e5b8-4e75-85c8-9212916b7277 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:23.952209 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2edef-28fc-4896-b63a-82f9f943e34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:23.952861 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2edef-28fc-4896-b63a-82f9f943e34a admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:23.953138 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2edef-28fc-4896-b63a-82f9f943e34a admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:23.953411 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2edef-28fc-4896-b63a-82f9f943e34a admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:23.954111 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c2edef-28fc-4896-b63a-82f9f943e34a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:23.956067 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c2edef-28fc-4896-b63a-82f9f943e34a admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:23.983581 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1171/2337] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:27:23 2021] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:27:23.987719 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c3b81-5132-491a-b6f9-cee1861e94b4 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:23.997752 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c3b81-5132-491a-b6f9-cee1861e94b4 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:24.053016 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb39e64-2167-403c-9cb4-478343f9b463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:24.053695 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb39e64-2167-403c-9cb4-478343f9b463 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:24.053996 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb39e64-2167-403c-9cb4-478343f9b463 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:24.054296 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb39e64-2167-403c-9cb4-478343f9b463 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:24.055035 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb39e64-2167-403c-9cb4-478343f9b463 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:24.056955 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb39e64-2167-403c-9cb4-478343f9b463 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:24.077658 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1167/2338] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:27:23 2021] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:27:24.081938 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2edef-28fc-4896-b63a-82f9f943e34a admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:24.092268 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2edef-28fc-4896-b63a-82f9f943e34a admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:24.096816 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc7d0fa-295c-455f-ad3c-70cfd0fd179d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:24.097479 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7d0fa-295c-455f-ad3c-70cfd0fd179d admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:24.097763 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7d0fa-295c-455f-ad3c-70cfd0fd179d admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:24.098038 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc7d0fa-295c-455f-ad3c-70cfd0fd179d admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:24.098791 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc7d0fa-295c-455f-ad3c-70cfd0fd179d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:24.100394 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc7d0fa-295c-455f-ad3c-70cfd0fd179d admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:24.110782 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1172/2339] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:27:24 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:27:24.115071 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb39e64-2167-403c-9cb4-478343f9b463 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:24.125415 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb39e64-2167-403c-9cb4-478343f9b463 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:24.131034 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168c7b2-1903-43e8-ac35-20d5fbdd86ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:24.131687 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168c7b2-1903-43e8-ac35-20d5fbdd86ed admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:24.131974 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168c7b2-1903-43e8-ac35-20d5fbdd86ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:24.132306 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168c7b2-1903-43e8-ac35-20d5fbdd86ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:24.133040 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6168c7b2-1903-43e8-ac35-20d5fbdd86ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:24.134623 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6168c7b2-1903-43e8-ac35-20d5fbdd86ed admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:24.145040 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1168/2340] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:27:24 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:27:24.149984 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc7d0fa-295c-455f-ad3c-70cfd0fd179d admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:24.160367 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc7d0fa-295c-455f-ad3c-70cfd0fd179d admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:24.165994 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78ea4f-64e4-4315-9e4f-653510424ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:24.166961 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78ea4f-64e4-4315-9e4f-653510424ace admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:24.167188 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78ea4f-64e4-4315-9e4f-653510424ace admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:24.167464 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78ea4f-64e4-4315-9e4f-653510424ace admin admin] PATH_INFO: `/v3/projects/1682c6245fef4a10a4a9fdc5ec3d87f6/users/c8edd0ab17ca4618adcc57fb8ecf2a0c/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:24.185405 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea78ea4f-64e4-4315-9e4f-653510424ace admin admin] RBAC: Authorizing `identity:create_grant(project_id=1682c6245fef4a10a4a9fdc5ec3d87f6, user_id=c8edd0ab17ca4618adcc57fb8ecf2a0c, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:24.189463 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea78ea4f-64e4-4315-9e4f-653510424ace admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:24.204689 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1173/2341] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:27:24 2021] PUT /identity/v3/projects/1682c6245fef4a10a4a9fdc5ec3d87f6/users/c8edd0ab17ca4618adcc57fb8ecf2a0c/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:27:24.215019 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a9c6c-effa-40c5-bcb0-86171279757e None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:24.215323 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a9c6c-effa-40c5-bcb0-86171279757e None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:24.215592 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a9c6c-effa-40c5-bcb0-86171279757e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:24.242796 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-787a9c6c-effa-40c5-bcb0-86171279757e None None] MFA Rules not processed for user `c8edd0ab17ca4618adcc57fb8ecf2a0c`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:27:24.244037 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-787a9c6c-effa-40c5-bcb0-86171279757e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:24.309297 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1169/2342] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:27:24 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:27:24.313861 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78ea4f-64e4-4315-9e4f-653510424ace admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:24.372475 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78ea4f-64e4-4315-9e4f-653510424ace admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:24.377811 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd3f84-9a51-439b-9403-cd14c63f4109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:24.378459 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd3f84-9a51-439b-9403-cd14c63f4109 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:24.378734 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd3f84-9a51-439b-9403-cd14c63f4109 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:24.379040 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cd3f84-9a51-439b-9403-cd14c63f4109 admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:24.379733 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd3f84-9a51-439b-9403-cd14c63f4109 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:24.382897 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cd3f84-9a51-439b-9403-cd14c63f4109 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:24.409591 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1174/2343] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:27:24 2021] POST /identity/v3/projects => generated 389 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:27:24.413625 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a9c6c-effa-40c5-bcb0-86171279757e None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:24.424718 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a9c6c-effa-40c5-bcb0-86171279757e None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:24.483494 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3289d-56e7-4e94-a2e1-9d46238b899b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:24.484162 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3289d-56e7-4e94-a2e1-9d46238b899b admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:24.484437 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3289d-56e7-4e94-a2e1-9d46238b899b admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:24.484704 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3289d-56e7-4e94-a2e1-9d46238b899b admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:24.485389 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f3289d-56e7-4e94-a2e1-9d46238b899b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:24.487316 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f3289d-56e7-4e94-a2e1-9d46238b899b admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:24.507853 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1170/2344] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:27:24 2021] POST /identity/v3/users => generated 301 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:27:24.511908 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd3f84-9a51-439b-9403-cd14c63f4109 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:24.524266 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cd3f84-9a51-439b-9403-cd14c63f4109 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:24.528924 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c474c-6930-4f28-b9fc-a7084cd692e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:24.529584 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c474c-6930-4f28-b9fc-a7084cd692e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:24.530061 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c474c-6930-4f28-b9fc-a7084cd692e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:24.530173 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c474c-6930-4f28-b9fc-a7084cd692e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:24.531011 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c474c-6930-4f28-b9fc-a7084cd692e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:24.532579 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3c474c-6930-4f28-b9fc-a7084cd692e7 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:24.546649 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1175/2345] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:27:24 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:27:24.547802 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3289d-56e7-4e94-a2e1-9d46238b899b admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:24.557799 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3289d-56e7-4e94-a2e1-9d46238b899b admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:24.562417 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d7331-5668-45e5-ac40-24d2c2ccf1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:24.563320 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d7331-5668-45e5-ac40-24d2c2ccf1b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:24.563598 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d7331-5668-45e5-ac40-24d2c2ccf1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:24.563862 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d7331-5668-45e5-ac40-24d2c2ccf1b8 admin admin] PATH_INFO: `/v3/projects/40eff1469733423c98191d1ef6c93b5f/users/2791de4a2afc4c5088b61f7920b6769b/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:24.577964 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d7331-5668-45e5-ac40-24d2c2ccf1b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40eff1469733423c98191d1ef6c93b5f, user_id=2791de4a2afc4c5088b61f7920b6769b, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:24.580626 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d7331-5668-45e5-ac40-24d2c2ccf1b8 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:24.594361 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1171/2346] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:27:24 2021] PUT /identity/v3/projects/40eff1469733423c98191d1ef6c93b5f/users/2791de4a2afc4c5088b61f7920b6769b/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:27:24.598271 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c474c-6930-4f28-b9fc-a7084cd692e7 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:24.608815 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3c474c-6930-4f28-b9fc-a7084cd692e7 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:24.663798 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed7574-760f-4ff6-a148-b2444a5567fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:24.664453 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed7574-760f-4ff6-a148-b2444a5567fb admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:24.664730 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed7574-760f-4ff6-a148-b2444a5567fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:24.664999 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed7574-760f-4ff6-a148-b2444a5567fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:24.665722 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed7574-760f-4ff6-a148-b2444a5567fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:24.667446 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed7574-760f-4ff6-a148-b2444a5567fb admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:24.676990 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1176/2347] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:27:24 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:27:24.681216 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d7331-5668-45e5-ac40-24d2c2ccf1b8 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:24.691630 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d7331-5668-45e5-ac40-24d2c2ccf1b8 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:24.697226 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a17c8-6e54-4ca3-8c76-9402415a25b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:24.698100 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a17c8-6e54-4ca3-8c76-9402415a25b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:24.698375 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a17c8-6e54-4ca3-8c76-9402415a25b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:24.698642 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3a17c8-6e54-4ca3-8c76-9402415a25b2 admin admin] PATH_INFO: `/v3/projects/40eff1469733423c98191d1ef6c93b5f/users/2791de4a2afc4c5088b61f7920b6769b/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:24.700826 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a17c8-6e54-4ca3-8c76-9402415a25b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40eff1469733423c98191d1ef6c93b5f, user_id=2791de4a2afc4c5088b61f7920b6769b, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:24.703502 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3a17c8-6e54-4ca3-8c76-9402415a25b2 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:24.714723 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1172/2348] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:27:24 2021] PUT /identity/v3/projects/40eff1469733423c98191d1ef6c93b5f/users/2791de4a2afc4c5088b61f7920b6769b/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:27:24.726743 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898e451-4770-48d7-8c95-fb93d13d5fd7 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:24.727136 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898e451-4770-48d7-8c95-fb93d13d5fd7 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:24.727490 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898e451-4770-48d7-8c95-fb93d13d5fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:24.759633 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-8898e451-4770-48d7-8c95-fb93d13d5fd7 None None] MFA Rules not processed for user `2791de4a2afc4c5088b61f7920b6769b`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:27:24.760835 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-8898e451-4770-48d7-8c95-fb93d13d5fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:24.830253 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1177/2349] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:27:24 2021] POST /identity/v3/auth/tokens => generated 3323 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:27:24.839468 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a17c8-6e54-4ca3-8c76-9402415a25b2 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:24.841407 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-8c3a17c8-6e54-4ca3-8c76-9402415a25b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:24.901011 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3a17c8-6e54-4ca3-8c76-9402415a25b2 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:24.905512 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014cffdd-6797-4779-b76e-9ba3d5a3abbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:24.906151 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cffdd-6797-4779-b76e-9ba3d5a3abbd service cinder] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:24.906436 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cffdd-6797-4779-b76e-9ba3d5a3abbd service cinder] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:24.906709 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cffdd-6797-4779-b76e-9ba3d5a3abbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:24.916060 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014cffdd-6797-4779-b76e-9ba3d5a3abbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:24.917494 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014cffdd-6797-4779-b76e-9ba3d5a3abbd service cinder] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:24.926876 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1173/2350] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:27:24 2021] GET /identity/v3/auth/tokens => generated 3323 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:27:25.045660 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898e451-4770-48d7-8c95-fb93d13d5fd7 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:25.108156 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898e451-4770-48d7-8c95-fb93d13d5fd7 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:25.113157 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829cbf6d-519d-4762-94f5-34a7ffde7a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:25.114016 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829cbf6d-519d-4762-94f5-34a7ffde7a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:25.114291 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829cbf6d-519d-4762-94f5-34a7ffde7a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:25.114557 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829cbf6d-519d-4762-94f5-34a7ffde7a0a admin admin] PATH_INFO: `/v3/users/c8edd0ab17ca4618adcc57fb8ecf2a0c` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:25.115796 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829cbf6d-519d-4762-94f5-34a7ffde7a0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8edd0ab17ca4618adcc57fb8ecf2a0c)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:25.117731 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829cbf6d-519d-4762-94f5-34a7ffde7a0a admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:25.167036 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-829cbf6d-519d-4762-94f5-34a7ffde7a0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8edd0ab17ca4618adcc57fb8ecf2a0c'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:25.174057 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-829cbf6d-519d-4762-94f5-34a7ffde7a0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8edd0ab17ca4618adcc57fb8ecf2a0c'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:25.183770 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-829cbf6d-519d-4762-94f5-34a7ffde7a0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8edd0ab17ca4618adcc57fb8ecf2a0c'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:25.196198 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-829cbf6d-519d-4762-94f5-34a7ffde7a0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8edd0ab17ca4618adcc57fb8ecf2a0c'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:25.196819 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-829cbf6d-519d-4762-94f5-34a7ffde7a0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8edd0ab17ca4618adcc57fb8ecf2a0c'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:25.202702 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1178/2351] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:27:25 2021] DELETE /identity/v3/users/c8edd0ab17ca4618adcc57fb8ecf2a0c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:27:25.207307 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bde55-045f-4942-9a2e-9d6d6f63e746 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:25.207803 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bde55-045f-4942-9a2e-9d6d6f63e746 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:25.207912 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5bde55-045f-4942-9a2e-9d6d6f63e746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:25.225481 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-ad5bde55-045f-4942-9a2e-9d6d6f63e746 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:27:25.226730 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-ad5bde55-045f-4942-9a2e-9d6d6f63e746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:25.289472 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1174/2352] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:27:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:27:25.299511 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829cbf6d-519d-4762-94f5-34a7ffde7a0a admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:25.301142 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-829cbf6d-519d-4762-94f5-34a7ffde7a0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:25.361150 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829cbf6d-519d-4762-94f5-34a7ffde7a0a admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:25.365270 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426cf3a-560f-49fd-845e-51703d46f172 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:25.365924 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426cf3a-560f-49fd-845e-51703d46f172 service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:25.366174 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426cf3a-560f-49fd-845e-51703d46f172 service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:25.366511 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426cf3a-560f-49fd-845e-51703d46f172 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:25.381776 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b426cf3a-560f-49fd-845e-51703d46f172 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:25.383316 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b426cf3a-560f-49fd-845e-51703d46f172 service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:25.392819 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1179/2353] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:27:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:27:25.742236 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5bde55-045f-4942-9a2e-9d6d6f63e746 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:25.743859 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-ad5bde55-045f-4942-9a2e-9d6d6f63e746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:25.756062 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5bde55-045f-4942-9a2e-9d6d6f63e746 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:25.761456 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0046c-3e4a-450f-a9e8-16d207423dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:25.762550 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0046c-3e4a-450f-a9e8-16d207423dec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:25.762817 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0046c-3e4a-450f-a9e8-16d207423dec admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:25.763124 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0046c-3e4a-450f-a9e8-16d207423dec admin admin] PATH_INFO: `/v3/projects/1682c6245fef4a10a4a9fdc5ec3d87f6` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:25.764424 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0046c-3e4a-450f-a9e8-16d207423dec admin admin] RBAC: Authorizing `identity:delete_project(project_id=1682c6245fef4a10a4a9fdc5ec3d87f6)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:25.766354 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0046c-3e4a-450f-a9e8-16d207423dec admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:25.813560 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-84b0046c-3e4a-450f-a9e8-16d207423dec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1682c6245fef4a10a4a9fdc5ec3d87f6', 'request_id': 'req-84b0046c-3e4a-450f-a9e8-16d207423dec'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:25.819902 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-84b0046c-3e4a-450f-a9e8-16d207423dec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1682c6245fef4a10a4a9fdc5ec3d87f6', 'request_id': 'req-84b0046c-3e4a-450f-a9e8-16d207423dec'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:25.825534 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-84b0046c-3e4a-450f-a9e8-16d207423dec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1682c6245fef4a10a4a9fdc5ec3d87f6', 'request_id': 'req-84b0046c-3e4a-450f-a9e8-16d207423dec'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:25.839536 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-84b0046c-3e4a-450f-a9e8-16d207423dec admin admin] The token cache is being invalidate because project 1682c6245fef4a10a4a9fdc5ec3d87f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:27:25.839820 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-84b0046c-3e4a-450f-a9e8-16d207423dec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:25.840422 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-84b0046c-3e4a-450f-a9e8-16d207423dec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:25.841974 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1175/2354] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:27:25 2021] DELETE /identity/v3/projects/1682c6245fef4a10a4a9fdc5ec3d87f6 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:27:25.845982 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426cf3a-560f-49fd-845e-51703d46f172 service neutron] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:25.856072 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b426cf3a-560f-49fd-845e-51703d46f172 service neutron] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:25.917708 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39fb77-6459-4531-9554-0badad3f15ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:25.918573 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39fb77-6459-4531-9554-0badad3f15ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:25.918886 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39fb77-6459-4531-9554-0badad3f15ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:25.919159 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39fb77-6459-4531-9554-0badad3f15ca admin admin] PATH_INFO: `/v3/users/2791de4a2afc4c5088b61f7920b6769b` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:25.920396 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c39fb77-6459-4531-9554-0badad3f15ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=2791de4a2afc4c5088b61f7920b6769b)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:25.922330 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c39fb77-6459-4531-9554-0badad3f15ca admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:25.968271 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-5c39fb77-6459-4531-9554-0badad3f15ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2791de4a2afc4c5088b61f7920b6769b'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:25.975489 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-5c39fb77-6459-4531-9554-0badad3f15ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2791de4a2afc4c5088b61f7920b6769b'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:25.986605 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-5c39fb77-6459-4531-9554-0badad3f15ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2791de4a2afc4c5088b61f7920b6769b'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:25.999214 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-5c39fb77-6459-4531-9554-0badad3f15ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2791de4a2afc4c5088b61f7920b6769b'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:25.999912 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-5c39fb77-6459-4531-9554-0badad3f15ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2791de4a2afc4c5088b61f7920b6769b'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:26.005811 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1180/2355] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:27:25 2021] DELETE /identity/v3/users/2791de4a2afc4c5088b61f7920b6769b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:27:26.295008 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0046c-3e4a-450f-a9e8-16d207423dec admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:26.296940 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-84b0046c-3e4a-450f-a9e8-16d207423dec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:26.312630 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0046c-3e4a-450f-a9e8-16d207423dec admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:26.372252 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e52378-3b1c-41cc-bb9f-c3f4ea061c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:26.373123 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e52378-3b1c-41cc-bb9f-c3f4ea061c06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:26.373409 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e52378-3b1c-41cc-bb9f-c3f4ea061c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:26.373677 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e52378-3b1c-41cc-bb9f-c3f4ea061c06 admin admin] PATH_INFO: `/v3/projects/40eff1469733423c98191d1ef6c93b5f` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:26.374870 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e52378-3b1c-41cc-bb9f-c3f4ea061c06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40eff1469733423c98191d1ef6c93b5f)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:26.376789 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e52378-3b1c-41cc-bb9f-c3f4ea061c06 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:26.424772 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-04e52378-3b1c-41cc-bb9f-c3f4ea061c06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40eff1469733423c98191d1ef6c93b5f', 'request_id': 'req-04e52378-3b1c-41cc-bb9f-c3f4ea061c06'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:26.430870 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-04e52378-3b1c-41cc-bb9f-c3f4ea061c06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40eff1469733423c98191d1ef6c93b5f', 'request_id': 'req-04e52378-3b1c-41cc-bb9f-c3f4ea061c06'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:26.436256 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-04e52378-3b1c-41cc-bb9f-c3f4ea061c06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40eff1469733423c98191d1ef6c93b5f', 'request_id': 'req-04e52378-3b1c-41cc-bb9f-c3f4ea061c06'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:26.449956 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-04e52378-3b1c-41cc-bb9f-c3f4ea061c06 admin admin] The token cache is being invalidate because project 40eff1469733423c98191d1ef6c93b5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:27:26.450238 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-04e52378-3b1c-41cc-bb9f-c3f4ea061c06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:26.450865 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-04e52378-3b1c-41cc-bb9f-c3f4ea061c06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:26.452391 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1176/2356] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:27:26 2021] DELETE /identity/v3/projects/40eff1469733423c98191d1ef6c93b5f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:27:26.458521 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f36f6-5b69-47d9-a9f4-1fc6f64e2725 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:26.459060 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f36f6-5b69-47d9-a9f4-1fc6f64e2725 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:26.459160 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f36f6-5b69-47d9-a9f4-1fc6f64e2725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:26.477076 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-6f6f36f6-5b69-47d9-a9f4-1fc6f64e2725 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:27:26.478268 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-6f6f36f6-5b69-47d9-a9f4-1fc6f64e2725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:26.543967 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1181/2357] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:27:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:27:26.551822 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ad08e-0edd-4334-9d40-e72ab095287a None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:26.552079 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ad08e-0edd-4334-9d40-e72ab095287a None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:26.552353 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ad08e-0edd-4334-9d40-e72ab095287a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:26.574651 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-c67ad08e-0edd-4334-9d40-e72ab095287a None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:27:26.576049 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-c67ad08e-0edd-4334-9d40-e72ab095287a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:26.584722 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1177/2358] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:27:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:27:26.589376 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f36f6-5b69-47d9-a9f4-1fc6f64e2725 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:26.599473 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f36f6-5b69-47d9-a9f4-1fc6f64e2725 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:26.604473 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c6c6d-243f-48d2-ad06-dfab9a272b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:26.605119 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c6c6d-243f-48d2-ad06-dfab9a272b84 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:26.605360 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c6c6d-243f-48d2-ad06-dfab9a272b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:26.605636 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c6c6d-243f-48d2-ad06-dfab9a272b84 admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:26.606380 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c6c6d-243f-48d2-ad06-dfab9a272b84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:27:26.606680 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c6c6d-243f-48d2-ad06-dfab9a272b84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:26.608286 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5c6c6d-243f-48d2-ad06-dfab9a272b84 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:26.623198 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1182/2359] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:27:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:27:26.624318 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ad08e-0edd-4334-9d40-e72ab095287a None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:26.633969 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67ad08e-0edd-4334-9d40-e72ab095287a None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:26.639264 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e8df4-0bc0-4451-b88e-19925e6daac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:26.639924 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e8df4-0bc0-4451-b88e-19925e6daac5 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:26.640206 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e8df4-0bc0-4451-b88e-19925e6daac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:26.640477 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e8df4-0bc0-4451-b88e-19925e6daac5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:26.641185 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e8df4-0bc0-4451-b88e-19925e6daac5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:26.650613 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e8df4-0bc0-4451-b88e-19925e6daac5 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:26.671241 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1178/2360] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:27:26 2021] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:27:26.675274 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c6c6d-243f-48d2-ad06-dfab9a272b84 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:26.684902 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c6c6d-243f-48d2-ad06-dfab9a272b84 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:26.739173 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b773315-9916-49c2-9239-a0db8c509de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:26.739853 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b773315-9916-49c2-9239-a0db8c509de4 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:26.740133 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b773315-9916-49c2-9239-a0db8c509de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:26.740409 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b773315-9916-49c2-9239-a0db8c509de4 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:26.741113 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b773315-9916-49c2-9239-a0db8c509de4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:26.743122 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b773315-9916-49c2-9239-a0db8c509de4 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:26.773236 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1183/2361] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:27:26 2021] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:27:26.774609 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e8df4-0bc0-4451-b88e-19925e6daac5 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:26.785186 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e8df4-0bc0-4451-b88e-19925e6daac5 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:26.790808 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96bd37b-2740-4eda-ba74-03598bde97ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:26.791510 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bd37b-2740-4eda-ba74-03598bde97ec admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:26.791786 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bd37b-2740-4eda-ba74-03598bde97ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:26.792081 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96bd37b-2740-4eda-ba74-03598bde97ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:26.792891 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96bd37b-2740-4eda-ba74-03598bde97ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:26.794546 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96bd37b-2740-4eda-ba74-03598bde97ec admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:26.808506 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1179/2362] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:27:26 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:27:26.809758 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b773315-9916-49c2-9239-a0db8c509de4 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:26.823617 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b773315-9916-49c2-9239-a0db8c509de4 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:26.832745 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da4a20-4fca-4a44-8415-fbc7700dfa44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:26.833449 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da4a20-4fca-4a44-8415-fbc7700dfa44 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:26.833759 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da4a20-4fca-4a44-8415-fbc7700dfa44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:26.834026 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da4a20-4fca-4a44-8415-fbc7700dfa44 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:26.834781 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da4a20-4fca-4a44-8415-fbc7700dfa44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:26.836469 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da4a20-4fca-4a44-8415-fbc7700dfa44 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:26.847298 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1184/2363] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:27:26 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:27:26.851471 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96bd37b-2740-4eda-ba74-03598bde97ec admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:26.861197 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96bd37b-2740-4eda-ba74-03598bde97ec admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:26.865822 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4430b097-a0b2-4aa4-8cc6-71b7bd336fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:26.866770 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4430b097-a0b2-4aa4-8cc6-71b7bd336fc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:26.867081 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4430b097-a0b2-4aa4-8cc6-71b7bd336fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:26.867352 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4430b097-a0b2-4aa4-8cc6-71b7bd336fc9 admin admin] PATH_INFO: `/v3/projects/39393df8b8c54ef39b67650fa50253de/users/ebef0d2c089c4469b4255e33fac79de2/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:26.895405 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4430b097-a0b2-4aa4-8cc6-71b7bd336fc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39393df8b8c54ef39b67650fa50253de, user_id=ebef0d2c089c4469b4255e33fac79de2, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:26.898775 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4430b097-a0b2-4aa4-8cc6-71b7bd336fc9 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:26.916958 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1180/2364] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:27:26 2021] PUT /identity/v3/projects/39393df8b8c54ef39b67650fa50253de/users/ebef0d2c089c4469b4255e33fac79de2/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:27:26.927734 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f44ab9-7f90-4d4c-92e8-8b79e14ddd88 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:26.928017 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f44ab9-7f90-4d4c-92e8-8b79e14ddd88 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:26.928304 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f44ab9-7f90-4d4c-92e8-8b79e14ddd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:26.954870 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-d2f44ab9-7f90-4d4c-92e8-8b79e14ddd88 None None] MFA Rules not processed for user `ebef0d2c089c4469b4255e33fac79de2`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:27:26.956105 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-d2f44ab9-7f90-4d4c-92e8-8b79e14ddd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:27.018906 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1185/2365] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:27:26 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:27:27.029741 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4430b097-a0b2-4aa4-8cc6-71b7bd336fc9 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:27.031490 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-4430b097-a0b2-4aa4-8cc6-71b7bd336fc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:27.087345 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4430b097-a0b2-4aa4-8cc6-71b7bd336fc9 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:27.091793 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cfaa5a-e92c-42e7-b61a-e50dca9b0ac2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:27.092442 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfaa5a-e92c-42e7-b61a-e50dca9b0ac2 service cinder] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:27.092721 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfaa5a-e92c-42e7-b61a-e50dca9b0ac2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:27.092990 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfaa5a-e92c-42e7-b61a-e50dca9b0ac2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:27.102374 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cfaa5a-e92c-42e7-b61a-e50dca9b0ac2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:27.103847 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cfaa5a-e92c-42e7-b61a-e50dca9b0ac2 service cinder] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:27.112737 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1181/2366] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:27:27 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:27:27.133389 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f44ab9-7f90-4d4c-92e8-8b79e14ddd88 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:27.196862 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f44ab9-7f90-4d4c-92e8-8b79e14ddd88 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:27.202040 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeafe9c-dba0-47ee-949d-1490549f54af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:27.202955 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeafe9c-dba0-47ee-949d-1490549f54af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:27.203235 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeafe9c-dba0-47ee-949d-1490549f54af admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:27.203508 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeafe9c-dba0-47ee-949d-1490549f54af admin admin] PATH_INFO: `/v3/users/ebef0d2c089c4469b4255e33fac79de2` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:27.204780 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeafe9c-dba0-47ee-949d-1490549f54af admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebef0d2c089c4469b4255e33fac79de2)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:27.206702 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeafe9c-dba0-47ee-949d-1490549f54af admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:27.261668 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-abeafe9c-dba0-47ee-949d-1490549f54af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebef0d2c089c4469b4255e33fac79de2'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:27.268306 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-abeafe9c-dba0-47ee-949d-1490549f54af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebef0d2c089c4469b4255e33fac79de2'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:27.277338 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-abeafe9c-dba0-47ee-949d-1490549f54af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebef0d2c089c4469b4255e33fac79de2'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:27.289853 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-abeafe9c-dba0-47ee-949d-1490549f54af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebef0d2c089c4469b4255e33fac79de2'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:27.290521 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-abeafe9c-dba0-47ee-949d-1490549f54af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebef0d2c089c4469b4255e33fac79de2'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:27.296527 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1186/2367] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:27:27 2021] DELETE /identity/v3/users/ebef0d2c089c4469b4255e33fac79de2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:27:27.301196 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc203d-437b-424d-a4e0-41fa1c88d7f8 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:27.301710 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc203d-437b-424d-a4e0-41fa1c88d7f8 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:27.301710 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc203d-437b-424d-a4e0-41fa1c88d7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:27.319248 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-20dc203d-437b-424d-a4e0-41fa1c88d7f8 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:27:27.320497 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-20dc203d-437b-424d-a4e0-41fa1c88d7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:27.380991 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1182/2368] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:27:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:27:27.390995 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeafe9c-dba0-47ee-949d-1490549f54af admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:27.392617 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-abeafe9c-dba0-47ee-949d-1490549f54af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:27.449376 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeafe9c-dba0-47ee-949d-1490549f54af admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:27.453347 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9a331-a3d5-47c4-8fc1-24f4eb3e1ad1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:27.453987 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9a331-a3d5-47c4-8fc1-24f4eb3e1ad1 service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:27.454266 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9a331-a3d5-47c4-8fc1-24f4eb3e1ad1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:27.454537 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9a331-a3d5-47c4-8fc1-24f4eb3e1ad1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:27.463628 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb9a331-a3d5-47c4-8fc1-24f4eb3e1ad1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:27.465037 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb9a331-a3d5-47c4-8fc1-24f4eb3e1ad1 service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:27.474675 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1187/2369] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:27:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:27:27.743701 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc203d-437b-424d-a4e0-41fa1c88d7f8 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:27.745309 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-20dc203d-437b-424d-a4e0-41fa1c88d7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:27.757336 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc203d-437b-424d-a4e0-41fa1c88d7f8 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:27.762192 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0deb14e-5bd9-41bd-81cd-d913873c1c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:27.763092 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0deb14e-5bd9-41bd-81cd-d913873c1c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:27.763370 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0deb14e-5bd9-41bd-81cd-d913873c1c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:27.763640 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0deb14e-5bd9-41bd-81cd-d913873c1c8a admin admin] PATH_INFO: `/v3/projects/39393df8b8c54ef39b67650fa50253de` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:27.764838 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0deb14e-5bd9-41bd-81cd-d913873c1c8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=39393df8b8c54ef39b67650fa50253de)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:27.766744 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0deb14e-5bd9-41bd-81cd-d913873c1c8a admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:27.814752 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-e0deb14e-5bd9-41bd-81cd-d913873c1c8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39393df8b8c54ef39b67650fa50253de', 'request_id': 'req-e0deb14e-5bd9-41bd-81cd-d913873c1c8a'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:27.821332 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-e0deb14e-5bd9-41bd-81cd-d913873c1c8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39393df8b8c54ef39b67650fa50253de', 'request_id': 'req-e0deb14e-5bd9-41bd-81cd-d913873c1c8a'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:27.827609 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-e0deb14e-5bd9-41bd-81cd-d913873c1c8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39393df8b8c54ef39b67650fa50253de', 'request_id': 'req-e0deb14e-5bd9-41bd-81cd-d913873c1c8a'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:27.842413 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-e0deb14e-5bd9-41bd-81cd-d913873c1c8a admin admin] The token cache is being invalidate because project 39393df8b8c54ef39b67650fa50253de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:27:27.842729 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-e0deb14e-5bd9-41bd-81cd-d913873c1c8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:27.843394 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-e0deb14e-5bd9-41bd-81cd-d913873c1c8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:27.844957 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1183/2370] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:27:27 2021] DELETE /identity/v3/projects/39393df8b8c54ef39b67650fa50253de => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:27:27.851080 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20e5f7-2fe5-42e0-81c7-9e46e2588f57 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:27.851366 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20e5f7-2fe5-42e0-81c7-9e46e2588f57 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:27.851638 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c20e5f7-2fe5-42e0-81c7-9e46e2588f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:27.869241 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-2c20e5f7-2fe5-42e0-81c7-9e46e2588f57 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:27:27.870577 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-2c20e5f7-2fe5-42e0-81c7-9e46e2588f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:27.932386 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1188/2371] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:27:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:27:27.941368 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a29dfe-6a4d-4d3d-98d9-c1c460b2ad46 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:27.941653 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a29dfe-6a4d-4d3d-98d9-c1c460b2ad46 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:27.941931 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a29dfe-6a4d-4d3d-98d9-c1c460b2ad46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:27.961170 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-22a29dfe-6a4d-4d3d-98d9-c1c460b2ad46 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:27:27.962569 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-22a29dfe-6a4d-4d3d-98d9-c1c460b2ad46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:27.971754 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1184/2372] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:27:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:27:27.975905 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20e5f7-2fe5-42e0-81c7-9e46e2588f57 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:27.985329 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c20e5f7-2fe5-42e0-81c7-9e46e2588f57 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:27.989986 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0fde2f-ab83-46f7-85f5-528b01b5acf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:27.990645 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fde2f-ab83-46f7-85f5-528b01b5acf2 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:27.990959 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fde2f-ab83-46f7-85f5-528b01b5acf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:27.991261 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0fde2f-ab83-46f7-85f5-528b01b5acf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:27.992005 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0fde2f-ab83-46f7-85f5-528b01b5acf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:27:27.992566 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0fde2f-ab83-46f7-85f5-528b01b5acf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:27.993926 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0fde2f-ab83-46f7-85f5-528b01b5acf2 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:28.005457 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1189/2373] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:27:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:27:28.009900 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a29dfe-6a4d-4d3d-98d9-c1c460b2ad46 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:28.019617 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a29dfe-6a4d-4d3d-98d9-c1c460b2ad46 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:28.024719 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec448e2d-ea13-4c14-94aa-b0286371bbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:28.025379 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec448e2d-ea13-4c14-94aa-b0286371bbc8 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:28.025655 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec448e2d-ea13-4c14-94aa-b0286371bbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:28.025927 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec448e2d-ea13-4c14-94aa-b0286371bbc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:28.026634 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec448e2d-ea13-4c14-94aa-b0286371bbc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:28.028576 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec448e2d-ea13-4c14-94aa-b0286371bbc8 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:28.058903 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1185/2374] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:27:28 2021] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 29 20:27:28.060422 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0fde2f-ab83-46f7-85f5-528b01b5acf2 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:28.071015 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0fde2f-ab83-46f7-85f5-528b01b5acf2 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:28.129049 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2051496-6106-4d75-8454-80bf13569a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:28.129713 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2051496-6106-4d75-8454-80bf13569a54 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:28.129984 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2051496-6106-4d75-8454-80bf13569a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:28.130269 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2051496-6106-4d75-8454-80bf13569a54 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:28.131000 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2051496-6106-4d75-8454-80bf13569a54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:28.132958 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2051496-6106-4d75-8454-80bf13569a54 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:28.156706 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1190/2375] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:27:28 2021] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 29 20:27:28.160980 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec448e2d-ea13-4c14-94aa-b0286371bbc8 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:28.171458 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec448e2d-ea13-4c14-94aa-b0286371bbc8 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:28.176549 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48bf6a-fba6-4f07-863d-c35a670b1e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:28.177207 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48bf6a-fba6-4f07-863d-c35a670b1e11 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:28.177479 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48bf6a-fba6-4f07-863d-c35a670b1e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:28.177749 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48bf6a-fba6-4f07-863d-c35a670b1e11 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:28.178478 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f48bf6a-fba6-4f07-863d-c35a670b1e11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:28.180107 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f48bf6a-fba6-4f07-863d-c35a670b1e11 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:28.190897 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1186/2376] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:27:28 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:27:28.194702 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2051496-6106-4d75-8454-80bf13569a54 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:28.204414 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2051496-6106-4d75-8454-80bf13569a54 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:28.209083 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33de973-67d2-4bf1-8c9a-1d6653f8fd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:28.209759 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33de973-67d2-4bf1-8c9a-1d6653f8fd28 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:28.210036 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33de973-67d2-4bf1-8c9a-1d6653f8fd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:28.210283 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33de973-67d2-4bf1-8c9a-1d6653f8fd28 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:28.211042 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33de973-67d2-4bf1-8c9a-1d6653f8fd28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:28.212601 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33de973-67d2-4bf1-8c9a-1d6653f8fd28 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:28.222393 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1191/2377] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:27:28 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:27:28.227031 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48bf6a-fba6-4f07-863d-c35a670b1e11 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:28.238685 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48bf6a-fba6-4f07-863d-c35a670b1e11 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:28.246653 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1cad47-45ee-4464-8014-2ff2237f5e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:28.248155 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1cad47-45ee-4464-8014-2ff2237f5e95 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:28.248500 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1cad47-45ee-4464-8014-2ff2237f5e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:28.248847 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1cad47-45ee-4464-8014-2ff2237f5e95 admin admin] PATH_INFO: `/v3/projects/05bf3dc354884d85a3f1a647ac09c95b/users/6572a1168a984de09bfada2f5a32a95c/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:28.267111 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1cad47-45ee-4464-8014-2ff2237f5e95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05bf3dc354884d85a3f1a647ac09c95b, user_id=6572a1168a984de09bfada2f5a32a95c, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:28.270109 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1cad47-45ee-4464-8014-2ff2237f5e95 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:28.285512 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1187/2378] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:27:28 2021] PUT /identity/v3/projects/05bf3dc354884d85a3f1a647ac09c95b/users/6572a1168a984de09bfada2f5a32a95c/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:27:28.296088 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b49278-478f-486b-9cfb-e8759c5a219c None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:28.296373 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b49278-478f-486b-9cfb-e8759c5a219c None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:28.296659 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b49278-478f-486b-9cfb-e8759c5a219c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:28.323494 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-80b49278-478f-486b-9cfb-e8759c5a219c None None] MFA Rules not processed for user `6572a1168a984de09bfada2f5a32a95c`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:27:28.324706 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-80b49278-478f-486b-9cfb-e8759c5a219c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:28.398053 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1192/2379] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:27:28 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:27:28.402815 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1cad47-45ee-4464-8014-2ff2237f5e95 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:28.464841 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1cad47-45ee-4464-8014-2ff2237f5e95 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:28.470085 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4713ed5c-4247-420e-9126-1f7ac58615b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:28.470746 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713ed5c-4247-420e-9126-1f7ac58615b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:28.471058 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713ed5c-4247-420e-9126-1f7ac58615b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:28.471334 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713ed5c-4247-420e-9126-1f7ac58615b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:28.472072 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4713ed5c-4247-420e-9126-1f7ac58615b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:28.473962 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4713ed5c-4247-420e-9126-1f7ac58615b6 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:28.501231 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1188/2380] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:27:28 2021] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:27:28.505428 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b49278-478f-486b-9cfb-e8759c5a219c None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:28.516795 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b49278-478f-486b-9cfb-e8759c5a219c None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:28.590945 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a6080-d448-4e49-b96f-0dc4badf8456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:28.591618 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a6080-d448-4e49-b96f-0dc4badf8456 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:28.591894 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a6080-d448-4e49-b96f-0dc4badf8456 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:28.592167 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a6080-d448-4e49-b96f-0dc4badf8456 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:28.592908 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25a6080-d448-4e49-b96f-0dc4badf8456 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:28.594806 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25a6080-d448-4e49-b96f-0dc4badf8456 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:28.618525 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1193/2381] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:27:28 2021] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 29 20:27:28.624252 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4713ed5c-4247-420e-9126-1f7ac58615b6 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:28.634705 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4713ed5c-4247-420e-9126-1f7ac58615b6 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:28.645880 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec6473d-26a0-4c68-8c75-6d91d5ff5aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:28.646563 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6473d-26a0-4c68-8c75-6d91d5ff5aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:28.646842 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6473d-26a0-4c68-8c75-6d91d5ff5aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:28.647147 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec6473d-26a0-4c68-8c75-6d91d5ff5aa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:28.647904 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec6473d-26a0-4c68-8c75-6d91d5ff5aa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:28.649644 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec6473d-26a0-4c68-8c75-6d91d5ff5aa7 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:28.660741 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1189/2382] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:27:28 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:27:28.664980 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a6080-d448-4e49-b96f-0dc4badf8456 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:28.674877 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a6080-d448-4e49-b96f-0dc4badf8456 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:28.679774 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8218a-a544-439f-920d-878deea461c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:28.680419 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8218a-a544-439f-920d-878deea461c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:28.680713 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8218a-a544-439f-920d-878deea461c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:28.680960 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8218a-a544-439f-920d-878deea461c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:28.681717 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8218a-a544-439f-920d-878deea461c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:28.683382 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8218a-a544-439f-920d-878deea461c8 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:28.693114 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1194/2383] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:27:28 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:27:28.697042 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec6473d-26a0-4c68-8c75-6d91d5ff5aa7 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:28.707179 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec6473d-26a0-4c68-8c75-6d91d5ff5aa7 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:28.712225 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad36c09-a645-4529-a060-2fcca9781183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:28.713300 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad36c09-a645-4529-a060-2fcca9781183 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:28.713580 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad36c09-a645-4529-a060-2fcca9781183 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:28.713850 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad36c09-a645-4529-a060-2fcca9781183 admin admin] PATH_INFO: `/v3/projects/1c0575e9c2134bc5839263dbf17af2ec/users/45af56455afb48f2900da066d65cf25b/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:28.731602 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad36c09-a645-4529-a060-2fcca9781183 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c0575e9c2134bc5839263dbf17af2ec, user_id=45af56455afb48f2900da066d65cf25b, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:28.734478 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad36c09-a645-4529-a060-2fcca9781183 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:28.754594 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1190/2384] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:27:28 2021] PUT /identity/v3/projects/1c0575e9c2134bc5839263dbf17af2ec/users/45af56455afb48f2900da066d65cf25b/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:27:28.764917 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41dd64-a7b2-464e-9f13-77f3d132ec2d None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:28.765200 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41dd64-a7b2-464e-9f13-77f3d132ec2d None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:28.765478 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41dd64-a7b2-464e-9f13-77f3d132ec2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:28.792608 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-bd41dd64-a7b2-464e-9f13-77f3d132ec2d None None] MFA Rules not processed for user `45af56455afb48f2900da066d65cf25b`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:27:28.793830 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-bd41dd64-a7b2-464e-9f13-77f3d132ec2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:28.857714 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1195/2385] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:27:28 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:27:28.862516 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad36c09-a645-4529-a060-2fcca9781183 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:28.927194 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad36c09-a645-4529-a060-2fcca9781183 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:28.932684 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f65fa-8a3c-44f3-8f9d-8fcde4173574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:28.933348 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f65fa-8a3c-44f3-8f9d-8fcde4173574 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:28.933702 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f65fa-8a3c-44f3-8f9d-8fcde4173574 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:28.933872 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f65fa-8a3c-44f3-8f9d-8fcde4173574 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:28.934590 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f65fa-8a3c-44f3-8f9d-8fcde4173574 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:28.936526 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f65fa-8a3c-44f3-8f9d-8fcde4173574 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:28.965200 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1191/2386] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:27:28 2021] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:27:28.971403 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd41dd64-a7b2-464e-9f13-77f3d132ec2d None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:28.984627 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd41dd64-a7b2-464e-9f13-77f3d132ec2d None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:29.046315 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f784b13-918c-4ca2-bd35-48c16124bc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:29.047033 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f784b13-918c-4ca2-bd35-48c16124bc09 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:29.047313 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f784b13-918c-4ca2-bd35-48c16124bc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:29.047584 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f784b13-918c-4ca2-bd35-48c16124bc09 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:29.048282 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f784b13-918c-4ca2-bd35-48c16124bc09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:29.050215 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f784b13-918c-4ca2-bd35-48c16124bc09 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:29.074354 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1196/2387] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:27:28 2021] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:27:29.078439 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f65fa-8a3c-44f3-8f9d-8fcde4173574 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:29.089245 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f65fa-8a3c-44f3-8f9d-8fcde4173574 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:29.094404 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97655597-8c04-4b83-bd23-0fff746f837d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:29.095126 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97655597-8c04-4b83-bd23-0fff746f837d admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:29.095408 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97655597-8c04-4b83-bd23-0fff746f837d admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:29.095683 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97655597-8c04-4b83-bd23-0fff746f837d admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:29.096423 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97655597-8c04-4b83-bd23-0fff746f837d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:29.098013 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97655597-8c04-4b83-bd23-0fff746f837d admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:29.108643 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1192/2388] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:27:29 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:27:29.112986 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f784b13-918c-4ca2-bd35-48c16124bc09 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:29.123313 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f784b13-918c-4ca2-bd35-48c16124bc09 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:29.128387 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c9144-ea68-4c45-b25f-09b7207d5e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:29.129275 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c9144-ea68-4c45-b25f-09b7207d5e07 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:29.129569 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c9144-ea68-4c45-b25f-09b7207d5e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:29.129819 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c9144-ea68-4c45-b25f-09b7207d5e07 admin admin] PATH_INFO: `/v3/projects/fe45129c2da9428283b3aeee6bbeb353/users/c318df5fb20a48d6956c1efe5a01d42c/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:29.145759 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652c9144-ea68-4c45-b25f-09b7207d5e07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe45129c2da9428283b3aeee6bbeb353, user_id=c318df5fb20a48d6956c1efe5a01d42c, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:29.148498 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652c9144-ea68-4c45-b25f-09b7207d5e07 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:29.163143 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1197/2389] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:27:29 2021] PUT /identity/v3/projects/fe45129c2da9428283b3aeee6bbeb353/users/c318df5fb20a48d6956c1efe5a01d42c/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:27:29.167251 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97655597-8c04-4b83-bd23-0fff746f837d admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:29.177356 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97655597-8c04-4b83-bd23-0fff746f837d admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:29.232761 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d48cddb-cd5b-4ea4-9519-c4897d78bbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:29.233418 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48cddb-cd5b-4ea4-9519-c4897d78bbd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:29.233698 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48cddb-cd5b-4ea4-9519-c4897d78bbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:29.233965 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48cddb-cd5b-4ea4-9519-c4897d78bbd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:29.234940 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d48cddb-cd5b-4ea4-9519-c4897d78bbd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:29.236620 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d48cddb-cd5b-4ea4-9519-c4897d78bbd2 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:29.247037 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1193/2390] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:27:29 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:27:29.251154 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c9144-ea68-4c45-b25f-09b7207d5e07 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:29.261288 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c9144-ea68-4c45-b25f-09b7207d5e07 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:29.265939 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6281595-1e01-4717-b413-2680f796af60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:29.266815 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6281595-1e01-4717-b413-2680f796af60 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:29.267126 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6281595-1e01-4717-b413-2680f796af60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:29.267402 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6281595-1e01-4717-b413-2680f796af60 admin admin] PATH_INFO: `/v3/projects/fe45129c2da9428283b3aeee6bbeb353/users/c318df5fb20a48d6956c1efe5a01d42c/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:29.269772 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6281595-1e01-4717-b413-2680f796af60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe45129c2da9428283b3aeee6bbeb353, user_id=c318df5fb20a48d6956c1efe5a01d42c, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:29.272453 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6281595-1e01-4717-b413-2680f796af60 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:29.282532 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1198/2391] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:27:29 2021] PUT /identity/v3/projects/fe45129c2da9428283b3aeee6bbeb353/users/c318df5fb20a48d6956c1efe5a01d42c/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:27:29.293691 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f091dd-21dc-475e-ba60-f2895e519590 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:29.293979 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f091dd-21dc-475e-ba60-f2895e519590 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:29.294252 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f091dd-21dc-475e-ba60-f2895e519590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:29.323327 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-90f091dd-21dc-475e-ba60-f2895e519590 None None] MFA Rules not processed for user `c318df5fb20a48d6956c1efe5a01d42c`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:27:29.324515 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-90f091dd-21dc-475e-ba60-f2895e519590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:29.398739 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1194/2392] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:27:29 2021] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:27:29.409424 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6281595-1e01-4717-b413-2680f796af60 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:29.411411 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-a6281595-1e01-4717-b413-2680f796af60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:29.467964 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6281595-1e01-4717-b413-2680f796af60 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:29.472044 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a16466-de91-4631-a8db-3f0f0e22587f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:29.472608 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a16466-de91-4631-a8db-3f0f0e22587f service cinder] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:29.472886 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a16466-de91-4631-a8db-3f0f0e22587f service cinder] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:29.473147 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a16466-de91-4631-a8db-3f0f0e22587f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:29.530968 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a16466-de91-4631-a8db-3f0f0e22587f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:29.532407 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a16466-de91-4631-a8db-3f0f0e22587f service cinder] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:29.540930 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1199/2393] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:27:29 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:27:31.069686 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f091dd-21dc-475e-ba60-f2895e519590 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:31.079582 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f091dd-21dc-475e-ba60-f2895e519590 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:31.083820 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632eb09-1795-452b-87a8-2fce058b1612 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:31.084483 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632eb09-1795-452b-87a8-2fce058b1612 service cinder] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:31.084757 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632eb09-1795-452b-87a8-2fce058b1612 service cinder] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:31.085019 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632eb09-1795-452b-87a8-2fce058b1612 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:31.140204 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632eb09-1795-452b-87a8-2fce058b1612 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:31.141627 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f632eb09-1795-452b-87a8-2fce058b1612 service cinder] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:31.150582 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1195/2394] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:27:31 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:27:31.694290 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a16466-de91-4631-a8db-3f0f0e22587f service cinder] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:31.696085 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-f2a16466-de91-4631-a8db-3f0f0e22587f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:31.707261 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a16466-de91-4631-a8db-3f0f0e22587f service cinder] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:31.711203 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb13b57-1ff8-4feb-962e-829f763732c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:31.711831 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb13b57-1ff8-4feb-962e-829f763732c3 service cinder] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:31.712106 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb13b57-1ff8-4feb-962e-829f763732c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:31.712375 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb13b57-1ff8-4feb-962e-829f763732c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:31.722514 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb13b57-1ff8-4feb-962e-829f763732c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:31.724009 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb13b57-1ff8-4feb-962e-829f763732c3 service cinder] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:31.733922 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1200/2395] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:27:31 2021] GET /identity/v3/auth/tokens => generated 3319 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:27:35.595818 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632eb09-1795-452b-87a8-2fce058b1612 service cinder] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:35.666352 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632eb09-1795-452b-87a8-2fce058b1612 service cinder] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:35.673177 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08069a8-f264-4176-b3be-5a54a33b645f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:35.674368 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08069a8-f264-4176-b3be-5a54a33b645f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:35.674676 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08069a8-f264-4176-b3be-5a54a33b645f admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:35.675252 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08069a8-f264-4176-b3be-5a54a33b645f admin admin] PATH_INFO: `/v3/users/6572a1168a984de09bfada2f5a32a95c` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:35.677346 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08069a8-f264-4176-b3be-5a54a33b645f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6572a1168a984de09bfada2f5a32a95c)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:35.680348 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08069a8-f264-4176-b3be-5a54a33b645f admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:35.734733 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-a08069a8-f264-4176-b3be-5a54a33b645f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6572a1168a984de09bfada2f5a32a95c'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:35.741774 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-a08069a8-f264-4176-b3be-5a54a33b645f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6572a1168a984de09bfada2f5a32a95c'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:35.753483 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-a08069a8-f264-4176-b3be-5a54a33b645f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6572a1168a984de09bfada2f5a32a95c'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:35.754179 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-a08069a8-f264-4176-b3be-5a54a33b645f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6572a1168a984de09bfada2f5a32a95c'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:35.754816 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-a08069a8-f264-4176-b3be-5a54a33b645f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6572a1168a984de09bfada2f5a32a95c'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:35.769119 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1196/2396] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:27:35 2021] DELETE /identity/v3/users/6572a1168a984de09bfada2f5a32a95c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:27:35.774274 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde78101-b0ed-4a8c-9697-d42be916ece3 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:35.774761 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde78101-b0ed-4a8c-9697-d42be916ece3 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:35.774873 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde78101-b0ed-4a8c-9697-d42be916ece3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:35.792986 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-fde78101-b0ed-4a8c-9697-d42be916ece3 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:27:35.794120 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-fde78101-b0ed-4a8c-9697-d42be916ece3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:35.858650 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1201/2397] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:27:35 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:27:35.870315 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08069a8-f264-4176-b3be-5a54a33b645f admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:35.871718 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-a08069a8-f264-4176-b3be-5a54a33b645f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:35.928611 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08069a8-f264-4176-b3be-5a54a33b645f admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:35.932552 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455dbead-d684-42f6-b336-b89cef99ade2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:35.933184 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455dbead-d684-42f6-b336-b89cef99ade2 service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:35.933441 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455dbead-d684-42f6-b336-b89cef99ade2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:35.933710 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455dbead-d684-42f6-b336-b89cef99ade2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:35.942700 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455dbead-d684-42f6-b336-b89cef99ade2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:35.944144 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455dbead-d684-42f6-b336-b89cef99ade2 service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:35.957413 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1197/2398] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:27:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 29 20:27:36.236244 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde78101-b0ed-4a8c-9697-d42be916ece3 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:36.237876 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-fde78101-b0ed-4a8c-9697-d42be916ece3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:36.250294 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde78101-b0ed-4a8c-9697-d42be916ece3 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:36.255686 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7ab79-35c4-4f7a-9198-dd7bb665becd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:36.256555 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7ab79-35c4-4f7a-9198-dd7bb665becd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:36.256835 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7ab79-35c4-4f7a-9198-dd7bb665becd admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:36.257104 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7ab79-35c4-4f7a-9198-dd7bb665becd admin admin] PATH_INFO: `/v3/projects/05bf3dc354884d85a3f1a647ac09c95b` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:36.258435 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b7ab79-35c4-4f7a-9198-dd7bb665becd admin admin] RBAC: Authorizing `identity:delete_project(project_id=05bf3dc354884d85a3f1a647ac09c95b)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:36.260529 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b7ab79-35c4-4f7a-9198-dd7bb665becd admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:36.320376 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-79b7ab79-35c4-4f7a-9198-dd7bb665becd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05bf3dc354884d85a3f1a647ac09c95b', 'request_id': 'req-79b7ab79-35c4-4f7a-9198-dd7bb665becd'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:36.326336 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-79b7ab79-35c4-4f7a-9198-dd7bb665becd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05bf3dc354884d85a3f1a647ac09c95b', 'request_id': 'req-79b7ab79-35c4-4f7a-9198-dd7bb665becd'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:36.334719 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-79b7ab79-35c4-4f7a-9198-dd7bb665becd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05bf3dc354884d85a3f1a647ac09c95b', 'request_id': 'req-79b7ab79-35c4-4f7a-9198-dd7bb665becd'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:36.345134 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-79b7ab79-35c4-4f7a-9198-dd7bb665becd admin admin] The token cache is being invalidate because project 05bf3dc354884d85a3f1a647ac09c95b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:27:36.345418 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-79b7ab79-35c4-4f7a-9198-dd7bb665becd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:36.346031 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-79b7ab79-35c4-4f7a-9198-dd7bb665becd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:36.347597 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1202/2399] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:27:36 2021] DELETE /identity/v3/projects/05bf3dc354884d85a3f1a647ac09c95b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:27:36.351525 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455dbead-d684-42f6-b336-b89cef99ade2 service neutron] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:36.361163 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455dbead-d684-42f6-b336-b89cef99ade2 service neutron] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:36.423606 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1e7f9-6f22-481c-8533-6ec938dab714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:36.424517 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1e7f9-6f22-481c-8533-6ec938dab714 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:36.424797 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1e7f9-6f22-481c-8533-6ec938dab714 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:36.425067 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1e7f9-6f22-481c-8533-6ec938dab714 admin admin] PATH_INFO: `/v3/users/45af56455afb48f2900da066d65cf25b` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:36.426347 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d1e7f9-6f22-481c-8533-6ec938dab714 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45af56455afb48f2900da066d65cf25b)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:36.428302 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d1e7f9-6f22-481c-8533-6ec938dab714 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:36.477355 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-30d1e7f9-6f22-481c-8533-6ec938dab714 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45af56455afb48f2900da066d65cf25b'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:36.484485 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-30d1e7f9-6f22-481c-8533-6ec938dab714 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45af56455afb48f2900da066d65cf25b'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:36.496569 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-30d1e7f9-6f22-481c-8533-6ec938dab714 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45af56455afb48f2900da066d65cf25b'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:36.497266 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-30d1e7f9-6f22-481c-8533-6ec938dab714 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45af56455afb48f2900da066d65cf25b'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:36.497931 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-30d1e7f9-6f22-481c-8533-6ec938dab714 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45af56455afb48f2900da066d65cf25b'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:36.512858 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1198/2400] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:27:36 2021] DELETE /identity/v3/users/45af56455afb48f2900da066d65cf25b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:27:36.786923 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7ab79-35c4-4f7a-9198-dd7bb665becd admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:36.788526 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-79b7ab79-35c4-4f7a-9198-dd7bb665becd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:36.801703 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7ab79-35c4-4f7a-9198-dd7bb665becd admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:36.861827 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b56cb-94f4-4150-a1ea-a7c2ece2c8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:36.862634 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b56cb-94f4-4150-a1ea-a7c2ece2c8a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:36.863062 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b56cb-94f4-4150-a1ea-a7c2ece2c8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:36.863325 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b56cb-94f4-4150-a1ea-a7c2ece2c8a3 admin admin] PATH_INFO: `/v3/projects/1c0575e9c2134bc5839263dbf17af2ec` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:36.864634 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b56cb-94f4-4150-a1ea-a7c2ece2c8a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c0575e9c2134bc5839263dbf17af2ec)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:36.866531 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b56cb-94f4-4150-a1ea-a7c2ece2c8a3 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:36.912217 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-724b56cb-94f4-4150-a1ea-a7c2ece2c8a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c0575e9c2134bc5839263dbf17af2ec', 'request_id': 'req-724b56cb-94f4-4150-a1ea-a7c2ece2c8a3'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:36.918166 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-724b56cb-94f4-4150-a1ea-a7c2ece2c8a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c0575e9c2134bc5839263dbf17af2ec', 'request_id': 'req-724b56cb-94f4-4150-a1ea-a7c2ece2c8a3'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:36.927294 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-724b56cb-94f4-4150-a1ea-a7c2ece2c8a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c0575e9c2134bc5839263dbf17af2ec', 'request_id': 'req-724b56cb-94f4-4150-a1ea-a7c2ece2c8a3'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:36.938009 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-724b56cb-94f4-4150-a1ea-a7c2ece2c8a3 admin admin] The token cache is being invalidate because project 1c0575e9c2134bc5839263dbf17af2ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:27:36.938292 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-724b56cb-94f4-4150-a1ea-a7c2ece2c8a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:36.938970 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-724b56cb-94f4-4150-a1ea-a7c2ece2c8a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:36.940528 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1203/2401] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:27:36 2021] DELETE /identity/v3/projects/1c0575e9c2134bc5839263dbf17af2ec => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:27:36.944567 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1e7f9-6f22-481c-8533-6ec938dab714 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:36.946010 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-30d1e7f9-6f22-481c-8533-6ec938dab714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:36.958506 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1e7f9-6f22-481c-8533-6ec938dab714 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:37.011864 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d2f9a5-3aaa-43e7-bc0f-8e89bc812df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:37.012775 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2f9a5-3aaa-43e7-bc0f-8e89bc812df9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:37.013054 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2f9a5-3aaa-43e7-bc0f-8e89bc812df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:37.013319 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d2f9a5-3aaa-43e7-bc0f-8e89bc812df9 admin admin] PATH_INFO: `/v3/users/c318df5fb20a48d6956c1efe5a01d42c` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:37.014521 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d2f9a5-3aaa-43e7-bc0f-8e89bc812df9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c318df5fb20a48d6956c1efe5a01d42c)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:37.016471 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d2f9a5-3aaa-43e7-bc0f-8e89bc812df9 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:37.065095 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-96d2f9a5-3aaa-43e7-bc0f-8e89bc812df9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c318df5fb20a48d6956c1efe5a01d42c'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:37.071449 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-96d2f9a5-3aaa-43e7-bc0f-8e89bc812df9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c318df5fb20a48d6956c1efe5a01d42c'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:37.083494 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-96d2f9a5-3aaa-43e7-bc0f-8e89bc812df9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c318df5fb20a48d6956c1efe5a01d42c'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:37.084337 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-96d2f9a5-3aaa-43e7-bc0f-8e89bc812df9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c318df5fb20a48d6956c1efe5a01d42c'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:37.084977 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-96d2f9a5-3aaa-43e7-bc0f-8e89bc812df9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c318df5fb20a48d6956c1efe5a01d42c'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:37.099738 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1199/2402] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:27:36 2021] DELETE /identity/v3/users/c318df5fb20a48d6956c1efe5a01d42c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:27:37.372513 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b56cb-94f4-4150-a1ea-a7c2ece2c8a3 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:37.373995 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-724b56cb-94f4-4150-a1ea-a7c2ece2c8a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:37.386249 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b56cb-94f4-4150-a1ea-a7c2ece2c8a3 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:37.446434 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e6a0eb-40f4-4af0-8a6a-c1fa97b219cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:37.447343 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6a0eb-40f4-4af0-8a6a-c1fa97b219cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:37.447621 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6a0eb-40f4-4af0-8a6a-c1fa97b219cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:37.447892 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6a0eb-40f4-4af0-8a6a-c1fa97b219cf admin admin] PATH_INFO: `/v3/projects/fe45129c2da9428283b3aeee6bbeb353` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:37.449263 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e6a0eb-40f4-4af0-8a6a-c1fa97b219cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe45129c2da9428283b3aeee6bbeb353)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:37.451228 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e6a0eb-40f4-4af0-8a6a-c1fa97b219cf admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:37.497041 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-76e6a0eb-40f4-4af0-8a6a-c1fa97b219cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe45129c2da9428283b3aeee6bbeb353', 'request_id': 'req-76e6a0eb-40f4-4af0-8a6a-c1fa97b219cf'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:37.503359 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-76e6a0eb-40f4-4af0-8a6a-c1fa97b219cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe45129c2da9428283b3aeee6bbeb353', 'request_id': 'req-76e6a0eb-40f4-4af0-8a6a-c1fa97b219cf'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:37.511947 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-76e6a0eb-40f4-4af0-8a6a-c1fa97b219cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe45129c2da9428283b3aeee6bbeb353', 'request_id': 'req-76e6a0eb-40f4-4af0-8a6a-c1fa97b219cf'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:37.522404 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-76e6a0eb-40f4-4af0-8a6a-c1fa97b219cf admin admin] The token cache is being invalidate because project fe45129c2da9428283b3aeee6bbeb353 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:27:37.522685 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-76e6a0eb-40f4-4af0-8a6a-c1fa97b219cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:37.523333 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-76e6a0eb-40f4-4af0-8a6a-c1fa97b219cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:27:37.525078 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1204/2403] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:27:37 2021] DELETE /identity/v3/projects/fe45129c2da9428283b3aeee6bbeb353 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:27:37.532741 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f0551-c082-4420-b624-c1c3ab16e75b None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:37.533030 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f0551-c082-4420-b624-c1c3ab16e75b None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:37.533311 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f0551-c082-4420-b624-c1c3ab16e75b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:37.552536 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-d18f0551-c082-4420-b624-c1c3ab16e75b None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:27:37.553758 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-d18f0551-c082-4420-b624-c1c3ab16e75b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:37.611886 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1200/2404] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:27:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:27:37.620259 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa42b1a-2023-4f01-a31b-130c847d4c97 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:37.620435 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa42b1a-2023-4f01-a31b-130c847d4c97 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:37.620730 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa42b1a-2023-4f01-a31b-130c847d4c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:37.645310 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-4aa42b1a-2023-4f01-a31b-130c847d4c97 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:27:37.646521 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-4aa42b1a-2023-4f01-a31b-130c847d4c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:37.655910 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1205/2405] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:27:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:27:37.660287 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f0551-c082-4420-b624-c1c3ab16e75b None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:37.670153 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f0551-c082-4420-b624-c1c3ab16e75b None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:37.675189 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b116d5-adcb-4d96-88ef-1a6f1a1ab296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:37.675838 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b116d5-adcb-4d96-88ef-1a6f1a1ab296 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:37.676115 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b116d5-adcb-4d96-88ef-1a6f1a1ab296 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:37.676382 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b116d5-adcb-4d96-88ef-1a6f1a1ab296 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:37.677099 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b116d5-adcb-4d96-88ef-1a6f1a1ab296 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:27:37.677399 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b116d5-adcb-4d96-88ef-1a6f1a1ab296 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:37.679021 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b116d5-adcb-4d96-88ef-1a6f1a1ab296 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:37.690330 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1201/2406] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:27:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:27:37.694484 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa42b1a-2023-4f01-a31b-130c847d4c97 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:37.703618 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa42b1a-2023-4f01-a31b-130c847d4c97 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:37.708513 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e7ae7-e174-4acb-b8fa-160a2a1f97dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:37.709151 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e7ae7-e174-4acb-b8fa-160a2a1f97dd admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:37.709430 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e7ae7-e174-4acb-b8fa-160a2a1f97dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:37.709698 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e7ae7-e174-4acb-b8fa-160a2a1f97dd admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:37.710399 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e7ae7-e174-4acb-b8fa-160a2a1f97dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:37.712316 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e7ae7-e174-4acb-b8fa-160a2a1f97dd admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:37.741162 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1206/2407] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:27:37 2021] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:27:37.745207 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b116d5-adcb-4d96-88ef-1a6f1a1ab296 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:37.755578 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b116d5-adcb-4d96-88ef-1a6f1a1ab296 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:37.810357 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a1875-ed0c-4d4e-9357-53b38682a172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:37.811059 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a1875-ed0c-4d4e-9357-53b38682a172 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:37.811356 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a1875-ed0c-4d4e-9357-53b38682a172 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:37.811608 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69a1875-ed0c-4d4e-9357-53b38682a172 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:37.812308 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69a1875-ed0c-4d4e-9357-53b38682a172 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:37.814250 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69a1875-ed0c-4d4e-9357-53b38682a172 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:37.837543 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1202/2408] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:27:37 2021] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:27:37.841902 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e7ae7-e174-4acb-b8fa-160a2a1f97dd admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:37.852611 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e7ae7-e174-4acb-b8fa-160a2a1f97dd admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:37.858336 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bbd18a-a639-46f5-9611-95efca90c1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:37.859059 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbd18a-a639-46f5-9611-95efca90c1ed admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:37.859342 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbd18a-a639-46f5-9611-95efca90c1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:37.859610 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bbd18a-a639-46f5-9611-95efca90c1ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:37.860352 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bbd18a-a639-46f5-9611-95efca90c1ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:37.861946 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bbd18a-a639-46f5-9611-95efca90c1ed admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:37.872395 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1207/2409] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:27:37 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:27:37.876330 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a1875-ed0c-4d4e-9357-53b38682a172 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:37.886504 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69a1875-ed0c-4d4e-9357-53b38682a172 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:37.892070 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988a3e5-0bcc-4416-8496-7010f49becd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:37.892734 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988a3e5-0bcc-4416-8496-7010f49becd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:37.892981 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988a3e5-0bcc-4416-8496-7010f49becd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:37.893251 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988a3e5-0bcc-4416-8496-7010f49becd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:37.893980 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988a3e5-0bcc-4416-8496-7010f49becd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:37.895925 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988a3e5-0bcc-4416-8496-7010f49becd8 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:37.906674 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1203/2410] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:27:37 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 29 20:27:37.911080 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bbd18a-a639-46f5-9611-95efca90c1ed admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:37.922034 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bbd18a-a639-46f5-9611-95efca90c1ed admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:37.927349 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93955e-4650-4334-b96d-f95d45064c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:37.928251 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93955e-4650-4334-b96d-f95d45064c5c admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:37.928539 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93955e-4650-4334-b96d-f95d45064c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:37.928816 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93955e-4650-4334-b96d-f95d45064c5c admin admin] PATH_INFO: `/v3/projects/21d9fbd7b5cb4760aa9e1a8f96470225/users/3d8c1982d6b9455a97e38992a687e6f3/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:37.943907 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93955e-4650-4334-b96d-f95d45064c5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=21d9fbd7b5cb4760aa9e1a8f96470225, user_id=3d8c1982d6b9455a97e38992a687e6f3, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:37.946580 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93955e-4650-4334-b96d-f95d45064c5c admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:37.961555 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1208/2411] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:27:37 2021] PUT /identity/v3/projects/21d9fbd7b5cb4760aa9e1a8f96470225/users/3d8c1982d6b9455a97e38992a687e6f3/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:27:37.966754 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876c0d7-e94b-498d-a2d3-50c771180c1b None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:37.967245 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876c0d7-e94b-498d-a2d3-50c771180c1b None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:37.967460 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b876c0d7-e94b-498d-a2d3-50c771180c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:37.985639 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-b876c0d7-e94b-498d-a2d3-50c771180c1b None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:27:37.986877 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-b876c0d7-e94b-498d-a2d3-50c771180c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:38.046301 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1204/2412] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:27:37 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:27:38.056256 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93955e-4650-4334-b96d-f95d45064c5c admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:38.058956 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-af93955e-4650-4334-b96d-f95d45064c5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:38.116133 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93955e-4650-4334-b96d-f95d45064c5c admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:38.120032 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357f3cc-c03c-4f92-8ea2-8c4af03a9537 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:38.120683 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357f3cc-c03c-4f92-8ea2-8c4af03a9537 service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:38.120953 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357f3cc-c03c-4f92-8ea2-8c4af03a9537 service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:38.121238 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357f3cc-c03c-4f92-8ea2-8c4af03a9537 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:38.130705 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3357f3cc-c03c-4f92-8ea2-8c4af03a9537 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:38.132095 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3357f3cc-c03c-4f92-8ea2-8c4af03a9537 service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:38.142145 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1209/2413] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:27:38 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:27:38.810447 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d70a6-b1ce-455e-86b2-9faae65ab8b4 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:38.810756 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d70a6-b1ce-455e-86b2-9faae65ab8b4 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:38.811048 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d70a6-b1ce-455e-86b2-9faae65ab8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:38.838576 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-0e0d70a6-b1ce-455e-86b2-9faae65ab8b4 None None] MFA Rules not processed for user `3d8c1982d6b9455a97e38992a687e6f3`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:27:38.839871 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-0e0d70a6-b1ce-455e-86b2-9faae65ab8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:38.904221 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1205/2414] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:27:38 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:27:38.914199 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357f3cc-c03c-4f92-8ea2-8c4af03a9537 service neutron] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:38.916215 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-3357f3cc-c03c-4f92-8ea2-8c4af03a9537 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:38.987545 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357f3cc-c03c-4f92-8ea2-8c4af03a9537 service neutron] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:38.991352 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9bc73-baa3-41d9-b0b1-789a23ac98cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:38.992001 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9bc73-baa3-41d9-b0b1-789a23ac98cc service cinder] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:38.992284 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9bc73-baa3-41d9-b0b1-789a23ac98cc service cinder] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:38.992564 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e9bc73-baa3-41d9-b0b1-789a23ac98cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:39.001001 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e9bc73-baa3-41d9-b0b1-789a23ac98cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:39.002437 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e9bc73-baa3-41d9-b0b1-789a23ac98cc service cinder] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:39.011145 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1210/2415] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:27:38 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:27:40.354378 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331c8a2-bdf7-4b54-ba4c-bfb8187b24cb None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:40.354956 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331c8a2-bdf7-4b54-ba4c-bfb8187b24cb None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:40.354956 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9331c8a2-bdf7-4b54-ba4c-bfb8187b24cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:40.373720 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-9331c8a2-bdf7-4b54-ba4c-bfb8187b24cb None None] MFA Rules not processed for user `3d8c1982d6b9455a97e38992a687e6f3`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:27:40.374966 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-9331c8a2-bdf7-4b54-ba4c-bfb8187b24cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:40.384648 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1206/2416] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:27:40 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:27:40.616285 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9bc73-baa3-41d9-b0b1-789a23ac98cc service cinder] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:40.617869 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-03e9bc73-baa3-41d9-b0b1-789a23ac98cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:40.631210 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e9bc73-baa3-41d9-b0b1-789a23ac98cc service cinder] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:40.635165 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b786525-bed8-4173-ba57-6bee3ac35d86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:40.635802 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b786525-bed8-4173-ba57-6bee3ac35d86 service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:40.636078 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b786525-bed8-4173-ba57-6bee3ac35d86 service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:40.636345 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b786525-bed8-4173-ba57-6bee3ac35d86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:40.638430 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-4b786525-bed8-4173-ba57-6bee3ac35d86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:40.648549 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b786525-bed8-4173-ba57-6bee3ac35d86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:40.649976 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b786525-bed8-4173-ba57-6bee3ac35d86 service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:40.658119 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1211/2417] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:27:40 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:27:40.982207 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331c8a2-bdf7-4b54-ba4c-bfb8187b24cb None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:40.983818 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-9331c8a2-bdf7-4b54-ba4c-bfb8187b24cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:41.058908 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9331c8a2-bdf7-4b54-ba4c-bfb8187b24cb None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:41.065789 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fbffc6-205c-4a73-8702-db3d1ccb4529 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b954c18d7e9349e899f4c1cd42b89166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:41.066538 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbffc6-205c-4a73-8702-db3d1ccb4529 service placement] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:41.066917 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbffc6-205c-4a73-8702-db3d1ccb4529 service placement] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:41.067370 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fbffc6-205c-4a73-8702-db3d1ccb4529 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:41.070215 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-13fbffc6-205c-4a73-8702-db3d1ccb4529 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:41.082731 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fbffc6-205c-4a73-8702-db3d1ccb4529 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:41.084291 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fbffc6-205c-4a73-8702-db3d1ccb4529 service placement] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:41.095441 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1207/2418] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:27:40 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:27:48.107714 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b786525-bed8-4173-ba57-6bee3ac35d86 service neutron] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:48.109794 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-4b786525-bed8-4173-ba57-6bee3ac35d86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:48.193393 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b786525-bed8-4173-ba57-6bee3ac35d86 service neutron] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:48.198834 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a8c95-e880-4e5e-9918-9a137bf09f55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:48.199521 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a8c95-e880-4e5e-9918-9a137bf09f55 service nova] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:48.199801 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a8c95-e880-4e5e-9918-9a137bf09f55 service nova] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:48.200073 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a8c95-e880-4e5e-9918-9a137bf09f55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:48.201889 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-f32a8c95-e880-4e5e-9918-9a137bf09f55 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:48.217002 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a8c95-e880-4e5e-9918-9a137bf09f55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:48.218700 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a8c95-e880-4e5e-9918-9a137bf09f55 service nova] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:48.230152 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1212/2419] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:27:48 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:27:54.581823 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ae054-c14b-40e4-8e83-cbcf72d4b413 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:54.582336 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ae054-c14b-40e4-8e83-cbcf72d4b413 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:54.582336 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ae054-c14b-40e4-8e83-cbcf72d4b413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:54.600591 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-e95ae054-c14b-40e4-8e83-cbcf72d4b413 None None] MFA Rules not processed for user `3d8c1982d6b9455a97e38992a687e6f3`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:27:54.601805 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-e95ae054-c14b-40e4-8e83-cbcf72d4b413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:54.609998 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1208/2420] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:27:54 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:27:54.847162 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a8c95-e880-4e5e-9918-9a137bf09f55 service nova] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:27:54.856867 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a8c95-e880-4e5e-9918-9a137bf09f55 service nova] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:27:54.860844 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e658e-2fb9-4449-a6e6-54bf83d60c72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:27:54.861488 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e658e-2fb9-4449-a6e6-54bf83d60c72 service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:27:54.861772 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e658e-2fb9-4449-a6e6-54bf83d60c72 service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:27:54.862047 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e658e-2fb9-4449-a6e6-54bf83d60c72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:27:54.864342 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-3b2e658e-2fb9-4449-a6e6-54bf83d60c72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:27:54.874235 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e658e-2fb9-4449-a6e6-54bf83d60c72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:27:54.875716 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e658e-2fb9-4449-a6e6-54bf83d60c72 service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:27:54.883708 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1213/2421] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:27:54 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:28:13.543884 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e1937-664b-40c4-a890-fc91487bec73 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:28:13.544456 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e1937-664b-40c4-a890-fc91487bec73 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:28:13.544456 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e1937-664b-40c4-a890-fc91487bec73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:28:13.593371 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-ae5e1937-664b-40c4-a890-fc91487bec73 None None] MFA Rules not processed for user `19d72c913c2b4442836a991120eec243`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:28:13.594559 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-ae5e1937-664b-40c4-a890-fc91487bec73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:28:13.661636 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1209/2422] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Nov 29 20:28:13 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:28:13.704532 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e658e-2fb9-4449-a6e6-54bf83d60c72 service neutron] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:28:13.706021 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-3b2e658e-2fb9-4449-a6e6-54bf83d60c72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:28:13.798601 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e658e-2fb9-4449-a6e6-54bf83d60c72 service neutron] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:28:13.805855 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b805d54-edeb-4536-9158-9f165c937428 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51fc6fd9b37447bba1759a702b86ce6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:28:13.806508 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b805d54-edeb-4536-9158-9f165c937428 service swift] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:28:13.806788 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b805d54-edeb-4536-9158-9f165c937428 service swift] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:28:13.807091 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b805d54-edeb-4536-9158-9f165c937428 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:28:13.816166 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b805d54-edeb-4536-9158-9f165c937428 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:28:13.817933 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b805d54-edeb-4536-9158-9f165c937428 service swift] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:28:13.826359 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1214/2423] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Nov 29 20:28:13 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:28:29.196817 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a4a16-23d5-4080-a93b-8dd1f8bba5af None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:28:29.197419 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a4a16-23d5-4080-a93b-8dd1f8bba5af None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:28:29.197419 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05a4a16-23d5-4080-a93b-8dd1f8bba5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:28:29.220978 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-f05a4a16-23d5-4080-a93b-8dd1f8bba5af None None] MFA Rules not processed for user `19d72c913c2b4442836a991120eec243`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:28:29.222186 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-f05a4a16-23d5-4080-a93b-8dd1f8bba5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:28:29.230734 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1210/2424] 10.222.0.15 () {58 vars in 967 bytes} [Mon Nov 29 20:28:29 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:28:29.244009 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b805d54-edeb-4536-9158-9f165c937428 service swift] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:28:29.254757 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b805d54-edeb-4536-9158-9f165c937428 service swift] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:28:29.260791 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef19e9-7394-43da-8812-8b028569570a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51fc6fd9b37447bba1759a702b86ce6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:28:29.261425 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef19e9-7394-43da-8812-8b028569570a service swift] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:28:29.261705 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef19e9-7394-43da-8812-8b028569570a service swift] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:28:29.261974 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef19e9-7394-43da-8812-8b028569570a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:28:29.272086 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef19e9-7394-43da-8812-8b028569570a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:28:29.273112 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef19e9-7394-43da-8812-8b028569570a service swift] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:28:29.282088 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1215/2425] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Nov 29 20:28:29 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:28:31.308188 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a4a16-23d5-4080-a93b-8dd1f8bba5af None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:28:31.319922 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05a4a16-23d5-4080-a93b-8dd1f8bba5af None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:28:31.325433 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed500432-40c2-4b29-8a7a-bbb750a8115b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:28:31.326378 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed500432-40c2-4b29-8a7a-bbb750a8115b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:28:31.326590 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed500432-40c2-4b29-8a7a-bbb750a8115b admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:28:31.326994 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed500432-40c2-4b29-8a7a-bbb750a8115b admin admin] PATH_INFO: `/v3/users/3d8c1982d6b9455a97e38992a687e6f3` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:28:31.328099 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed500432-40c2-4b29-8a7a-bbb750a8115b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d8c1982d6b9455a97e38992a687e6f3)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:28:31.330014 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed500432-40c2-4b29-8a7a-bbb750a8115b admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:28:31.376970 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-ed500432-40c2-4b29-8a7a-bbb750a8115b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d8c1982d6b9455a97e38992a687e6f3'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:28:31.383276 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-ed500432-40c2-4b29-8a7a-bbb750a8115b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d8c1982d6b9455a97e38992a687e6f3'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:28:31.394118 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-ed500432-40c2-4b29-8a7a-bbb750a8115b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d8c1982d6b9455a97e38992a687e6f3'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:28:31.395126 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-ed500432-40c2-4b29-8a7a-bbb750a8115b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d8c1982d6b9455a97e38992a687e6f3'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:28:31.395720 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-ed500432-40c2-4b29-8a7a-bbb750a8115b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d8c1982d6b9455a97e38992a687e6f3'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:28:31.410647 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1211/2426] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:28:31 2021] DELETE /identity/v3/users/3d8c1982d6b9455a97e38992a687e6f3 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:28:31.581517 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef19e9-7394-43da-8812-8b028569570a service swift] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:28:31.598535 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef19e9-7394-43da-8812-8b028569570a service swift] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:28:31.659441 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1dfc7e-d8cf-4e9a-b8b0-0d413319d6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:28:31.660221 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1dfc7e-d8cf-4e9a-b8b0-0d413319d6cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:28:31.660504 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1dfc7e-d8cf-4e9a-b8b0-0d413319d6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:28:31.660768 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1dfc7e-d8cf-4e9a-b8b0-0d413319d6cc admin admin] PATH_INFO: `/v3/projects/21d9fbd7b5cb4760aa9e1a8f96470225` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:28:31.662030 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1dfc7e-d8cf-4e9a-b8b0-0d413319d6cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=21d9fbd7b5cb4760aa9e1a8f96470225)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:28:31.664334 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1dfc7e-d8cf-4e9a-b8b0-0d413319d6cc admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:28:31.714517 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-de1dfc7e-d8cf-4e9a-b8b0-0d413319d6cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21d9fbd7b5cb4760aa9e1a8f96470225', 'request_id': 'req-de1dfc7e-d8cf-4e9a-b8b0-0d413319d6cc'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:28:31.720749 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-de1dfc7e-d8cf-4e9a-b8b0-0d413319d6cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21d9fbd7b5cb4760aa9e1a8f96470225', 'request_id': 'req-de1dfc7e-d8cf-4e9a-b8b0-0d413319d6cc'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:28:31.730191 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-de1dfc7e-d8cf-4e9a-b8b0-0d413319d6cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21d9fbd7b5cb4760aa9e1a8f96470225', 'request_id': 'req-de1dfc7e-d8cf-4e9a-b8b0-0d413319d6cc'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:28:31.740530 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-de1dfc7e-d8cf-4e9a-b8b0-0d413319d6cc admin admin] The token cache is being invalidate because project 21d9fbd7b5cb4760aa9e1a8f96470225 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:28:31.740815 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-de1dfc7e-d8cf-4e9a-b8b0-0d413319d6cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:28:31.741527 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-de1dfc7e-d8cf-4e9a-b8b0-0d413319d6cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:28:31.743169 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1216/2427] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:28:31 2021] DELETE /identity/v3/projects/21d9fbd7b5cb4760aa9e1a8f96470225 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:28:31.751644 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638ebd2-fa98-42ee-bf26-a77ed9f77980 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:28:31.751918 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638ebd2-fa98-42ee-bf26-a77ed9f77980 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:28:31.752197 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c638ebd2-fa98-42ee-bf26-a77ed9f77980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:28:31.771049 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-c638ebd2-fa98-42ee-bf26-a77ed9f77980 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:28:31.772255 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-c638ebd2-fa98-42ee-bf26-a77ed9f77980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:28:31.831721 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1212/2428] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:28:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:28:31.839167 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f82f7-2e9f-4451-be5e-3dbffafabc21 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:28:31.839452 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f82f7-2e9f-4451-be5e-3dbffafabc21 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:28:31.839726 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f82f7-2e9f-4451-be5e-3dbffafabc21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:28:31.859144 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-221f82f7-2e9f-4451-be5e-3dbffafabc21 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:28:31.860372 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-221f82f7-2e9f-4451-be5e-3dbffafabc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:28:31.869932 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1217/2429] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:28:31 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:28:31.874272 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c638ebd2-fa98-42ee-bf26-a77ed9f77980 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:28:31.884568 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c638ebd2-fa98-42ee-bf26-a77ed9f77980 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:28:31.890481 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8479d0-76fd-4953-bac9-db0efd60d0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:28:31.891162 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8479d0-76fd-4953-bac9-db0efd60d0e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:28:31.891437 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8479d0-76fd-4953-bac9-db0efd60d0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:28:31.891703 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8479d0-76fd-4953-bac9-db0efd60d0e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:28:31.892436 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8479d0-76fd-4953-bac9-db0efd60d0e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:28:31.892744 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8479d0-76fd-4953-bac9-db0efd60d0e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:28:31.894321 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8479d0-76fd-4953-bac9-db0efd60d0e5 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:28:31.906677 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1213/2430] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:28:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:28:31.911205 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f82f7-2e9f-4451-be5e-3dbffafabc21 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:28:31.920751 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f82f7-2e9f-4451-be5e-3dbffafabc21 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:28:31.926638 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3dd11-f7ad-40ab-af82-13ece4b62341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:28:31.927319 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3dd11-f7ad-40ab-af82-13ece4b62341 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:28:31.927607 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3dd11-f7ad-40ab-af82-13ece4b62341 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:28:31.927880 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3dd11-f7ad-40ab-af82-13ece4b62341 admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:28:31.928580 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3dd11-f7ad-40ab-af82-13ece4b62341 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:28:31.930478 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3dd11-f7ad-40ab-af82-13ece4b62341 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:28:31.959447 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1218/2431] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:28:31 2021] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:28:31.963760 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8479d0-76fd-4953-bac9-db0efd60d0e5 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:28:31.973658 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8479d0-76fd-4953-bac9-db0efd60d0e5 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:28:32.029799 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35c79c-6b1f-4b73-971e-a5eca4e45f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:28:32.030550 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35c79c-6b1f-4b73-971e-a5eca4e45f6b admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:28:32.030831 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35c79c-6b1f-4b73-971e-a5eca4e45f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:28:32.031130 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35c79c-6b1f-4b73-971e-a5eca4e45f6b admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:28:32.031823 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f35c79c-6b1f-4b73-971e-a5eca4e45f6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:28:32.033724 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f35c79c-6b1f-4b73-971e-a5eca4e45f6b admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:28:32.055262 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1214/2432] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:28:31 2021] POST /identity/v3/users => generated 282 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:28:32.059319 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3dd11-f7ad-40ab-af82-13ece4b62341 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:28:32.069407 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3dd11-f7ad-40ab-af82-13ece4b62341 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:28:32.074141 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be39c4-ee37-4404-b5a0-33d26d46df38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:28:32.074798 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be39c4-ee37-4404-b5a0-33d26d46df38 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:28:32.075114 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be39c4-ee37-4404-b5a0-33d26d46df38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:28:32.075387 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be39c4-ee37-4404-b5a0-33d26d46df38 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:28:32.076125 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5be39c4-ee37-4404-b5a0-33d26d46df38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:28:32.077708 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5be39c4-ee37-4404-b5a0-33d26d46df38 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:28:32.088013 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1219/2433] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:28:32 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:28:32.092037 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35c79c-6b1f-4b73-971e-a5eca4e45f6b admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:28:32.102371 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35c79c-6b1f-4b73-971e-a5eca4e45f6b admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:28:32.108614 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ca8dc-e210-4819-992f-f56ed6651032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:28:32.109287 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ca8dc-e210-4819-992f-f56ed6651032 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:28:32.109638 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ca8dc-e210-4819-992f-f56ed6651032 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:28:32.109834 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ca8dc-e210-4819-992f-f56ed6651032 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:28:32.110638 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ca8dc-e210-4819-992f-f56ed6651032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:28:32.112396 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ca8dc-e210-4819-992f-f56ed6651032 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:28:32.123083 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1215/2434] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:28:32 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:28:32.127075 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be39c4-ee37-4404-b5a0-33d26d46df38 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:28:32.136912 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be39c4-ee37-4404-b5a0-33d26d46df38 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:28:32.141701 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07a516-2922-4e13-878c-d6451cb69ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:28:32.142573 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07a516-2922-4e13-878c-d6451cb69ddc admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:28:32.142872 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07a516-2922-4e13-878c-d6451cb69ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:28:32.143190 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07a516-2922-4e13-878c-d6451cb69ddc admin admin] PATH_INFO: `/v3/projects/cf850ecdc20d4c1a94199767f42f672f/users/003d00a61e374abc8a5e10734284f3c6/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:28:32.158341 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe07a516-2922-4e13-878c-d6451cb69ddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf850ecdc20d4c1a94199767f42f672f, user_id=003d00a61e374abc8a5e10734284f3c6, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:28:32.161010 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe07a516-2922-4e13-878c-d6451cb69ddc admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:28:32.176091 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1220/2435] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:28:32 2021] PUT /identity/v3/projects/cf850ecdc20d4c1a94199767f42f672f/users/003d00a61e374abc8a5e10734284f3c6/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:28:32.186216 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3ee71-fcf9-4b89-8e66-2ff00e8e0710 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:28:32.186504 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3ee71-fcf9-4b89-8e66-2ff00e8e0710 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:28:32.186784 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3ee71-fcf9-4b89-8e66-2ff00e8e0710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:28:32.213063 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-89a3ee71-fcf9-4b89-8e66-2ff00e8e0710 None None] MFA Rules not processed for user `003d00a61e374abc8a5e10734284f3c6`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:28:32.214276 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-89a3ee71-fcf9-4b89-8e66-2ff00e8e0710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:28:32.287305 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1216/2436] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:28:32 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:28:32.298052 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07a516-2922-4e13-878c-d6451cb69ddc admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:28:32.299997 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-fe07a516-2922-4e13-878c-d6451cb69ddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:28:32.361309 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07a516-2922-4e13-878c-d6451cb69ddc admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:28:32.365625 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354c9c3-d728-4b8a-89ae-02acdc9377b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:28:32.366269 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354c9c3-d728-4b8a-89ae-02acdc9377b5 service cinder] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:28:32.366549 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354c9c3-d728-4b8a-89ae-02acdc9377b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:28:32.366824 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354c9c3-d728-4b8a-89ae-02acdc9377b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:28:32.375432 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b354c9c3-d728-4b8a-89ae-02acdc9377b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:28:32.376845 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b354c9c3-d728-4b8a-89ae-02acdc9377b5 service cinder] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:28:32.385642 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1221/2437] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:28:32 2021] GET /identity/v3/auth/tokens => generated 3230 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:28:42.526324 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a3ee71-fcf9-4b89-8e66-2ff00e8e0710 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:28:42.527902 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-89a3ee71-fcf9-4b89-8e66-2ff00e8e0710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:28:42.597827 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a3ee71-fcf9-4b89-8e66-2ff00e8e0710 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:28:42.603614 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a440a5e-e68a-4d43-b1f4-dc0c2da66680 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b954c18d7e9349e899f4c1cd42b89166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:28:42.604264 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a440a5e-e68a-4d43-b1f4-dc0c2da66680 service placement] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:28:42.604546 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a440a5e-e68a-4d43-b1f4-dc0c2da66680 service placement] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:28:42.604821 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a440a5e-e68a-4d43-b1f4-dc0c2da66680 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:28:42.606789 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-7a440a5e-e68a-4d43-b1f4-dc0c2da66680 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:28:42.618371 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a440a5e-e68a-4d43-b1f4-dc0c2da66680 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:28:42.619991 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a440a5e-e68a-4d43-b1f4-dc0c2da66680 service placement] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:28:42.629816 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1217/2438] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:28:42 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:28:48.767261 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354c9c3-d728-4b8a-89ae-02acdc9377b5 service cinder] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:28:48.776504 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354c9c3-d728-4b8a-89ae-02acdc9377b5 service cinder] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:28:48.781190 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea37dab-c7e6-4be5-aea9-6ff646184571 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:28:48.781839 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea37dab-c7e6-4be5-aea9-6ff646184571 service cinder] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:28:48.782149 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea37dab-c7e6-4be5-aea9-6ff646184571 service cinder] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:28:48.782390 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea37dab-c7e6-4be5-aea9-6ff646184571 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:28:48.784505 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-1ea37dab-c7e6-4be5-aea9-6ff646184571 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:28:48.845395 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea37dab-c7e6-4be5-aea9-6ff646184571 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:28:48.847082 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea37dab-c7e6-4be5-aea9-6ff646184571 service cinder] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:28:48.856196 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1222/2439] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:28:48 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:29:08.401539 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a440a5e-e68a-4d43-b1f4-dc0c2da66680 service placement] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:08.465932 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a440a5e-e68a-4d43-b1f4-dc0c2da66680 service placement] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:08.471388 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad162dd-66d1-4d69-8c1d-a584bc1b7a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:08.472251 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad162dd-66d1-4d69-8c1d-a584bc1b7a55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:08.472540 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad162dd-66d1-4d69-8c1d-a584bc1b7a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:08.472810 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad162dd-66d1-4d69-8c1d-a584bc1b7a55 admin admin] PATH_INFO: `/v3/users/003d00a61e374abc8a5e10734284f3c6` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:08.474106 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad162dd-66d1-4d69-8c1d-a584bc1b7a55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=003d00a61e374abc8a5e10734284f3c6)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:08.476081 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad162dd-66d1-4d69-8c1d-a584bc1b7a55 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:08.525621 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-8ad162dd-66d1-4d69-8c1d-a584bc1b7a55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '003d00a61e374abc8a5e10734284f3c6'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:08.532203 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-8ad162dd-66d1-4d69-8c1d-a584bc1b7a55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '003d00a61e374abc8a5e10734284f3c6'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:08.543724 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-8ad162dd-66d1-4d69-8c1d-a584bc1b7a55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '003d00a61e374abc8a5e10734284f3c6'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:08.544425 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-8ad162dd-66d1-4d69-8c1d-a584bc1b7a55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '003d00a61e374abc8a5e10734284f3c6'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:08.545087 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-8ad162dd-66d1-4d69-8c1d-a584bc1b7a55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '003d00a61e374abc8a5e10734284f3c6'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:08.559426 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1218/2440] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:29:08 2021] DELETE /identity/v3/users/003d00a61e374abc8a5e10734284f3c6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:29:08.564122 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d381b8-a821-4eaf-98c2-e3853858c8ea None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:08.564678 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d381b8-a821-4eaf-98c2-e3853858c8ea None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:08.564678 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d381b8-a821-4eaf-98c2-e3853858c8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:08.582113 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-43d381b8-a821-4eaf-98c2-e3853858c8ea None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:29:08.583345 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-43d381b8-a821-4eaf-98c2-e3853858c8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:29:08.643876 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1223/2441] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:29:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:29:08.654215 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad162dd-66d1-4d69-8c1d-a584bc1b7a55 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:08.655930 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-8ad162dd-66d1-4d69-8c1d-a584bc1b7a55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:29:08.714612 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad162dd-66d1-4d69-8c1d-a584bc1b7a55 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:08.718712 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262caf1-2f43-43fb-9d9c-15f6a6d6972c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:08.719386 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262caf1-2f43-43fb-9d9c-15f6a6d6972c service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:08.719672 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262caf1-2f43-43fb-9d9c-15f6a6d6972c service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:08.719947 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262caf1-2f43-43fb-9d9c-15f6a6d6972c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:08.729393 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7262caf1-2f43-43fb-9d9c-15f6a6d6972c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:08.730833 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7262caf1-2f43-43fb-9d9c-15f6a6d6972c service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:08.740327 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1219/2442] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:29:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:29:09.006484 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d381b8-a821-4eaf-98c2-e3853858c8ea None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:09.008058 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-43d381b8-a821-4eaf-98c2-e3853858c8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:29:09.023127 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d381b8-a821-4eaf-98c2-e3853858c8ea None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:09.029597 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4699658-04a4-42d0-8f77-efd31c2421c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:09.030479 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4699658-04a4-42d0-8f77-efd31c2421c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:09.030776 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4699658-04a4-42d0-8f77-efd31c2421c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:09.031146 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4699658-04a4-42d0-8f77-efd31c2421c2 admin admin] PATH_INFO: `/v3/projects/cf850ecdc20d4c1a94199767f42f672f` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:09.032390 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4699658-04a4-42d0-8f77-efd31c2421c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf850ecdc20d4c1a94199767f42f672f)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:09.034328 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4699658-04a4-42d0-8f77-efd31c2421c2 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:09.084919 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-b4699658-04a4-42d0-8f77-efd31c2421c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf850ecdc20d4c1a94199767f42f672f', 'request_id': 'req-b4699658-04a4-42d0-8f77-efd31c2421c2'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:09.091046 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-b4699658-04a4-42d0-8f77-efd31c2421c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf850ecdc20d4c1a94199767f42f672f', 'request_id': 'req-b4699658-04a4-42d0-8f77-efd31c2421c2'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:09.100440 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-b4699658-04a4-42d0-8f77-efd31c2421c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf850ecdc20d4c1a94199767f42f672f', 'request_id': 'req-b4699658-04a4-42d0-8f77-efd31c2421c2'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:09.111085 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-b4699658-04a4-42d0-8f77-efd31c2421c2 admin admin] The token cache is being invalidate because project cf850ecdc20d4c1a94199767f42f672f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:29:09.111371 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-b4699658-04a4-42d0-8f77-efd31c2421c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:09.112099 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-b4699658-04a4-42d0-8f77-efd31c2421c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:09.113704 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1224/2443] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:29:09 2021] DELETE /identity/v3/projects/cf850ecdc20d4c1a94199767f42f672f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:29:18.073756 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262caf1-2f43-43fb-9d9c-15f6a6d6972c service neutron] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:18.075780 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-7262caf1-2f43-43fb-9d9c-15f6a6d6972c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:29:18.087198 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262caf1-2f43-43fb-9d9c-15f6a6d6972c service neutron] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:18.135227 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af1dfe-9514-494e-9a7e-4b56fb0e617e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:18.135832 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af1dfe-9514-494e-9a7e-4b56fb0e617e service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:18.136124 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af1dfe-9514-494e-9a7e-4b56fb0e617e service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:18.136582 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af1dfe-9514-494e-9a7e-4b56fb0e617e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:18.138601 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-25af1dfe-9514-494e-9a7e-4b56fb0e617e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:29:18.205137 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25af1dfe-9514-494e-9a7e-4b56fb0e617e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:18.206659 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25af1dfe-9514-494e-9a7e-4b56fb0e617e service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:18.216725 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1220/2444] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:29:18 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:29:21.703237 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4d376-bf12-489f-94d0-1778028285a7 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:21.703237 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4d376-bf12-489f-94d0-1778028285a7 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:21.703237 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4d376-bf12-489f-94d0-1778028285a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:21.703752 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af1dfe-9514-494e-9a7e-4b56fb0e617e service neutron] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:21.704130 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-25af1dfe-9514-494e-9a7e-4b56fb0e617e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:29:21.718989 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af1dfe-9514-494e-9a7e-4b56fb0e617e service neutron] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:21.724232 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-d4c4d376-bf12-489f-94d0-1778028285a7 None None] MFA Rules not processed for user `682a8ea75de1423199659f6f850d2ade`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:29:21.725143 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49783f34-edc3-4103-9d87-40127de54f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:21.725662 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-d4c4d376-bf12-489f-94d0-1778028285a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:29:21.726216 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49783f34-edc3-4103-9d87-40127de54f7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:21.726696 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49783f34-edc3-4103-9d87-40127de54f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:21.726989 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49783f34-edc3-4103-9d87-40127de54f7c admin admin] PATH_INFO: `/v3/users/2ed842b05ab04f0a807a60c34ad9198a` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:21.728283 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49783f34-edc3-4103-9d87-40127de54f7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ed842b05ab04f0a807a60c34ad9198a)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:21.730359 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49783f34-edc3-4103-9d87-40127de54f7c admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:21.783931 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-49783f34-edc3-4103-9d87-40127de54f7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ed842b05ab04f0a807a60c34ad9198a'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:21.784189 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1225/2445] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:29:21 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:29:21.791691 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-49783f34-edc3-4103-9d87-40127de54f7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ed842b05ab04f0a807a60c34ad9198a'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:21.805141 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-49783f34-edc3-4103-9d87-40127de54f7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ed842b05ab04f0a807a60c34ad9198a'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:21.806406 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-49783f34-edc3-4103-9d87-40127de54f7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ed842b05ab04f0a807a60c34ad9198a'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:21.807106 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-49783f34-edc3-4103-9d87-40127de54f7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ed842b05ab04f0a807a60c34ad9198a'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:21.827852 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1221/2446] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:29:21 2021] DELETE /identity/v3/users/2ed842b05ab04f0a807a60c34ad9198a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:29:22.009847 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4d376-bf12-489f-94d0-1778028285a7 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:22.021586 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4d376-bf12-489f-94d0-1778028285a7 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:22.084488 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729bfd2-76c0-44c6-9982-ca2105e336ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:22.085379 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729bfd2-76c0-44c6-9982-ca2105e336ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:22.085660 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729bfd2-76c0-44c6-9982-ca2105e336ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:22.085935 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729bfd2-76c0-44c6-9982-ca2105e336ed admin admin] PATH_INFO: `/v3/projects/a80c484003d7406c92104a6a57ea50af` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:22.087160 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1729bfd2-76c0-44c6-9982-ca2105e336ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=a80c484003d7406c92104a6a57ea50af)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:22.089067 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1729bfd2-76c0-44c6-9982-ca2105e336ed admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:22.140013 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-1729bfd2-76c0-44c6-9982-ca2105e336ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a80c484003d7406c92104a6a57ea50af', 'request_id': 'req-1729bfd2-76c0-44c6-9982-ca2105e336ed'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:22.151025 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-1729bfd2-76c0-44c6-9982-ca2105e336ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a80c484003d7406c92104a6a57ea50af', 'request_id': 'req-1729bfd2-76c0-44c6-9982-ca2105e336ed'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:22.162110 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-1729bfd2-76c0-44c6-9982-ca2105e336ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a80c484003d7406c92104a6a57ea50af', 'request_id': 'req-1729bfd2-76c0-44c6-9982-ca2105e336ed'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:22.173454 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-1729bfd2-76c0-44c6-9982-ca2105e336ed admin admin] The token cache is being invalidate because project a80c484003d7406c92104a6a57ea50af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:29:22.173743 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-1729bfd2-76c0-44c6-9982-ca2105e336ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:22.174378 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-1729bfd2-76c0-44c6-9982-ca2105e336ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:22.176050 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1226/2447] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:29:22 2021] DELETE /identity/v3/projects/a80c484003d7406c92104a6a57ea50af => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:29:22.182065 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42df0ff-6a1b-4e96-8bf2-f57ba0ba13ec None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:22.182353 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42df0ff-6a1b-4e96-8bf2-f57ba0ba13ec None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:22.182751 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42df0ff-6a1b-4e96-8bf2-f57ba0ba13ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:22.204762 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-a42df0ff-6a1b-4e96-8bf2-f57ba0ba13ec None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:29:22.205954 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-a42df0ff-6a1b-4e96-8bf2-f57ba0ba13ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:29:22.271106 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1222/2448] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:29:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:29:22.272969 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fab63-8190-4509-9dfd-7b590d06e175 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:22.273254 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fab63-8190-4509-9dfd-7b590d06e175 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:22.274080 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fab63-8190-4509-9dfd-7b590d06e175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:22.296618 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-cb5fab63-8190-4509-9dfd-7b590d06e175 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:29:22.297814 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-cb5fab63-8190-4509-9dfd-7b590d06e175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:29:22.306396 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1227/2449] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:29:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:29:22.310672 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42df0ff-6a1b-4e96-8bf2-f57ba0ba13ec None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:22.320826 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42df0ff-6a1b-4e96-8bf2-f57ba0ba13ec None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:22.325483 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b8416-3fcf-4b74-bece-a08f224103f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:22.326214 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b8416-3fcf-4b74-bece-a08f224103f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:22.326497 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b8416-3fcf-4b74-bece-a08f224103f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:22.326768 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b8416-3fcf-4b74-bece-a08f224103f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:22.327534 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b8416-3fcf-4b74-bece-a08f224103f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:29:22.327844 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b8416-3fcf-4b74-bece-a08f224103f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:22.329430 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b8416-3fcf-4b74-bece-a08f224103f7 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:22.344520 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1223/2450] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:29:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:29:22.345732 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5fab63-8190-4509-9dfd-7b590d06e175 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:22.355354 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5fab63-8190-4509-9dfd-7b590d06e175 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:22.360603 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e33a8d-ffa4-47c0-aa3d-850f48f9deb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:22.361281 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e33a8d-ffa4-47c0-aa3d-850f48f9deb2 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:22.361558 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e33a8d-ffa4-47c0-aa3d-850f48f9deb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:22.361847 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e33a8d-ffa4-47c0-aa3d-850f48f9deb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:22.362651 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e33a8d-ffa4-47c0-aa3d-850f48f9deb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:22.364751 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e33a8d-ffa4-47c0-aa3d-850f48f9deb2 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:22.396668 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1228/2451] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:29:22 2021] POST /identity/v3/projects => generated 399 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:29:22.400686 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b8416-3fcf-4b74-bece-a08f224103f7 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:22.413169 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b8416-3fcf-4b74-bece-a08f224103f7 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:22.479701 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb816c-3905-44ec-a05b-1d501d9c615c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:22.480461 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb816c-3905-44ec-a05b-1d501d9c615c admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:22.480905 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb816c-3905-44ec-a05b-1d501d9c615c admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:22.481239 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb816c-3905-44ec-a05b-1d501d9c615c admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:22.482878 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb816c-3905-44ec-a05b-1d501d9c615c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:22.484307 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb816c-3905-44ec-a05b-1d501d9c615c admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:22.519760 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1224/2452] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:29:22 2021] POST /identity/v3/users => generated 300 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:29:22.522397 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e33a8d-ffa4-47c0-aa3d-850f48f9deb2 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:22.534795 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e33a8d-ffa4-47c0-aa3d-850f48f9deb2 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:22.539859 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86962f3a-108c-4003-9620-7b2a587553c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:22.540543 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86962f3a-108c-4003-9620-7b2a587553c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:22.540830 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86962f3a-108c-4003-9620-7b2a587553c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:22.541109 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86962f3a-108c-4003-9620-7b2a587553c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:22.541859 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86962f3a-108c-4003-9620-7b2a587553c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:22.543665 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86962f3a-108c-4003-9620-7b2a587553c1 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:22.554663 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1229/2453] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:29:22 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:29:22.558535 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb816c-3905-44ec-a05b-1d501d9c615c admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:22.570431 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb816c-3905-44ec-a05b-1d501d9c615c admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:22.575453 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983841e4-677b-40bd-83bd-e251853a1038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:22.576126 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983841e4-677b-40bd-83bd-e251853a1038 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:22.576416 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983841e4-677b-40bd-83bd-e251853a1038 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:22.576732 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983841e4-677b-40bd-83bd-e251853a1038 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:22.577415 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983841e4-677b-40bd-83bd-e251853a1038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:22.579040 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983841e4-677b-40bd-83bd-e251853a1038 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:22.595194 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1225/2454] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:29:22 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:29:22.595330 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86962f3a-108c-4003-9620-7b2a587553c1 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:22.608166 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86962f3a-108c-4003-9620-7b2a587553c1 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:22.612989 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112b429-8fe5-4126-8006-6332c2ee17c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:22.614027 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112b429-8fe5-4126-8006-6332c2ee17c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:22.614315 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112b429-8fe5-4126-8006-6332c2ee17c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:22.614590 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112b429-8fe5-4126-8006-6332c2ee17c4 admin admin] PATH_INFO: `/v3/projects/c74b24f2de6b47488be179c5f57bcd1c/users/53eca78312b949ca90c18d55517bca38/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:22.630057 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e112b429-8fe5-4126-8006-6332c2ee17c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c74b24f2de6b47488be179c5f57bcd1c, user_id=53eca78312b949ca90c18d55517bca38, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:22.632838 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e112b429-8fe5-4126-8006-6332c2ee17c4 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:22.646947 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1230/2455] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:29:22 2021] PUT /identity/v3/projects/c74b24f2de6b47488be179c5f57bcd1c/users/53eca78312b949ca90c18d55517bca38/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:29:22.656984 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733725cd-85a8-4a11-b9bf-5143f7c5e215 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:22.657272 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733725cd-85a8-4a11-b9bf-5143f7c5e215 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:22.657621 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733725cd-85a8-4a11-b9bf-5143f7c5e215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:22.684922 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-733725cd-85a8-4a11-b9bf-5143f7c5e215 None None] MFA Rules not processed for user `53eca78312b949ca90c18d55517bca38`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:29:22.686333 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-733725cd-85a8-4a11-b9bf-5143f7c5e215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:29:22.752736 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1226/2456] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:29:22 2021] POST /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:29:22.757190 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112b429-8fe5-4126-8006-6332c2ee17c4 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:22.818279 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112b429-8fe5-4126-8006-6332c2ee17c4 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:22.823349 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e7806-020e-43fe-97f7-7a454b8360ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:22.824010 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e7806-020e-43fe-97f7-7a454b8360ad admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:22.824317 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e7806-020e-43fe-97f7-7a454b8360ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:22.824590 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e7806-020e-43fe-97f7-7a454b8360ad admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:22.825307 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e7806-020e-43fe-97f7-7a454b8360ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:22.827247 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e7806-020e-43fe-97f7-7a454b8360ad admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:22.856094 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1231/2457] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:29:22 2021] POST /identity/v3/projects => generated 399 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:29:22.857413 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733725cd-85a8-4a11-b9bf-5143f7c5e215 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:22.869587 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733725cd-85a8-4a11-b9bf-5143f7c5e215 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:22.927739 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a231064-3455-4be2-a7f2-07b5097f1937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:22.928435 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a231064-3455-4be2-a7f2-07b5097f1937 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:22.928719 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a231064-3455-4be2-a7f2-07b5097f1937 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:22.929013 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a231064-3455-4be2-a7f2-07b5097f1937 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:22.929725 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a231064-3455-4be2-a7f2-07b5097f1937 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:22.931703 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a231064-3455-4be2-a7f2-07b5097f1937 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:22.955952 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1227/2458] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:29:22 2021] POST /identity/v3/users => generated 306 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:29:22.957109 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e7806-020e-43fe-97f7-7a454b8360ad admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:22.967304 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e7806-020e-43fe-97f7-7a454b8360ad admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:22.972408 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b85fb13-7dac-4bff-9c8c-2af7c80ab034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:22.973101 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85fb13-7dac-4bff-9c8c-2af7c80ab034 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:22.973382 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85fb13-7dac-4bff-9c8c-2af7c80ab034 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:22.973659 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85fb13-7dac-4bff-9c8c-2af7c80ab034 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:22.974390 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b85fb13-7dac-4bff-9c8c-2af7c80ab034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:22.976031 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b85fb13-7dac-4bff-9c8c-2af7c80ab034 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:22.986731 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1232/2459] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:29:22 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 29 20:29:22.991323 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a231064-3455-4be2-a7f2-07b5097f1937 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:23.001520 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a231064-3455-4be2-a7f2-07b5097f1937 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:23.006729 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c36667-6abc-467a-bdf9-c7a7889b7876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:23.007651 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c36667-6abc-467a-bdf9-c7a7889b7876 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:23.007928 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c36667-6abc-467a-bdf9-c7a7889b7876 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:23.008208 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c36667-6abc-467a-bdf9-c7a7889b7876 admin admin] PATH_INFO: `/v3/projects/44b8efc761e34077b944cac4d797c1d7/users/055e1045b3074b2aa6296d4dc1675432/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:23.023693 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c36667-6abc-467a-bdf9-c7a7889b7876 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44b8efc761e34077b944cac4d797c1d7, user_id=055e1045b3074b2aa6296d4dc1675432, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:23.026388 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c36667-6abc-467a-bdf9-c7a7889b7876 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:23.041421 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1228/2460] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:29:22 2021] PUT /identity/v3/projects/44b8efc761e34077b944cac4d797c1d7/users/055e1045b3074b2aa6296d4dc1675432/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:29:23.045450 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b85fb13-7dac-4bff-9c8c-2af7c80ab034 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:23.055626 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b85fb13-7dac-4bff-9c8c-2af7c80ab034 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:23.111715 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c956e-e7b7-427e-a870-0c00f9d9ded6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:23.112427 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c956e-e7b7-427e-a870-0c00f9d9ded6 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:23.112711 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c956e-e7b7-427e-a870-0c00f9d9ded6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:23.112988 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c956e-e7b7-427e-a870-0c00f9d9ded6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:23.113757 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c956e-e7b7-427e-a870-0c00f9d9ded6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:23.115414 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232c956e-e7b7-427e-a870-0c00f9d9ded6 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:23.125295 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1233/2461] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:29:23 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:29:23.129653 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c36667-6abc-467a-bdf9-c7a7889b7876 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:23.140116 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c36667-6abc-467a-bdf9-c7a7889b7876 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:23.145342 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51d445-174f-48f4-8533-86d3fc166ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:23.146195 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51d445-174f-48f4-8533-86d3fc166ed5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:23.146504 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51d445-174f-48f4-8533-86d3fc166ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:23.146760 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f51d445-174f-48f4-8533-86d3fc166ed5 admin admin] PATH_INFO: `/v3/projects/44b8efc761e34077b944cac4d797c1d7/users/055e1045b3074b2aa6296d4dc1675432/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:23.148861 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f51d445-174f-48f4-8533-86d3fc166ed5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44b8efc761e34077b944cac4d797c1d7, user_id=055e1045b3074b2aa6296d4dc1675432, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:23.151539 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f51d445-174f-48f4-8533-86d3fc166ed5 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:23.161889 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1229/2462] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:29:23 2021] PUT /identity/v3/projects/44b8efc761e34077b944cac4d797c1d7/users/055e1045b3074b2aa6296d4dc1675432/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:29:23.174108 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c0f33-f7b4-4d93-bebb-67867876f3b7 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:23.174457 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c0f33-f7b4-4d93-bebb-67867876f3b7 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:23.174821 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c0f33-f7b4-4d93-bebb-67867876f3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:23.209501 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-125c0f33-f7b4-4d93-bebb-67867876f3b7 None None] MFA Rules not processed for user `055e1045b3074b2aa6296d4dc1675432`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:29:23.210713 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-125c0f33-f7b4-4d93-bebb-67867876f3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:29:23.285568 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1234/2463] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:29:23 2021] POST /identity/v3/auth/tokens => generated 3333 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:29:23.295279 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51d445-174f-48f4-8533-86d3fc166ed5 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:23.297083 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-0f51d445-174f-48f4-8533-86d3fc166ed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:29:23.356802 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f51d445-174f-48f4-8533-86d3fc166ed5 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:23.360903 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea634f-bdd3-439e-8f6b-d1726721e1f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:23.361724 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea634f-bdd3-439e-8f6b-d1726721e1f7 service cinder] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:23.362102 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea634f-bdd3-439e-8f6b-d1726721e1f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:23.362475 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ea634f-bdd3-439e-8f6b-d1726721e1f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:23.373511 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ea634f-bdd3-439e-8f6b-d1726721e1f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:23.375238 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ea634f-bdd3-439e-8f6b-d1726721e1f7 service cinder] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:23.386484 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1230/2464] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:29:23 2021] GET /identity/v3/auth/tokens => generated 3333 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:29:23.465515 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c0f33-f7b4-4d93-bebb-67867876f3b7 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:23.476081 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c0f33-f7b4-4d93-bebb-67867876f3b7 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:23.480784 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e321450-bc0d-441b-95b8-0e945b8b103a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:23.481461 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e321450-bc0d-441b-95b8-0e945b8b103a service cinder] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:23.481733 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e321450-bc0d-441b-95b8-0e945b8b103a service cinder] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:23.482010 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e321450-bc0d-441b-95b8-0e945b8b103a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:23.546693 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e321450-bc0d-441b-95b8-0e945b8b103a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:23.548265 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e321450-bc0d-441b-95b8-0e945b8b103a service cinder] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:23.560301 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1235/2465] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:29:23 2021] GET /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:29:27.677574 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea634f-bdd3-439e-8f6b-d1726721e1f7 service cinder] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:27.736877 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ea634f-bdd3-439e-8f6b-d1726721e1f7 service cinder] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:27.742147 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce25016-967e-44d6-b6d9-63282c037e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:27.743048 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce25016-967e-44d6-b6d9-63282c037e1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:27.743326 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce25016-967e-44d6-b6d9-63282c037e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:27.743598 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce25016-967e-44d6-b6d9-63282c037e1b admin admin] PATH_INFO: `/v3/users/53eca78312b949ca90c18d55517bca38` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:27.744908 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce25016-967e-44d6-b6d9-63282c037e1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=53eca78312b949ca90c18d55517bca38)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:27.746834 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce25016-967e-44d6-b6d9-63282c037e1b admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:27.794127 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-1ce25016-967e-44d6-b6d9-63282c037e1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53eca78312b949ca90c18d55517bca38'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:27.800810 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-1ce25016-967e-44d6-b6d9-63282c037e1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53eca78312b949ca90c18d55517bca38'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:27.811930 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-1ce25016-967e-44d6-b6d9-63282c037e1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53eca78312b949ca90c18d55517bca38'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:27.812626 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-1ce25016-967e-44d6-b6d9-63282c037e1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53eca78312b949ca90c18d55517bca38'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:27.813294 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-1ce25016-967e-44d6-b6d9-63282c037e1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53eca78312b949ca90c18d55517bca38'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:27.829791 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1231/2466] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:29:27 2021] DELETE /identity/v3/users/53eca78312b949ca90c18d55517bca38 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:29:27.834912 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932a59c-56b6-4194-a24b-2a8d4720cc40 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:27.835707 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932a59c-56b6-4194-a24b-2a8d4720cc40 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:27.836129 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932a59c-56b6-4194-a24b-2a8d4720cc40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:27.854842 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-c932a59c-56b6-4194-a24b-2a8d4720cc40 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:29:27.856251 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-c932a59c-56b6-4194-a24b-2a8d4720cc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:29:27.916268 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1236/2467] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:29:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:29:27.926397 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce25016-967e-44d6-b6d9-63282c037e1b admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:27.928016 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-1ce25016-967e-44d6-b6d9-63282c037e1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:29:27.982459 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce25016-967e-44d6-b6d9-63282c037e1b admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:27.986005 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd4f685-6db1-4e4c-87b2-a18852983cdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:27.986642 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4f685-6db1-4e4c-87b2-a18852983cdd service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:27.986951 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4f685-6db1-4e4c-87b2-a18852983cdd service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:27.987223 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4f685-6db1-4e4c-87b2-a18852983cdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:27.996167 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd4f685-6db1-4e4c-87b2-a18852983cdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:27.997697 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd4f685-6db1-4e4c-87b2-a18852983cdd service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:28.007419 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1232/2468] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:29:27 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:29:28.281512 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c932a59c-56b6-4194-a24b-2a8d4720cc40 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:28.282997 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-c932a59c-56b6-4194-a24b-2a8d4720cc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:29:28.294621 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c932a59c-56b6-4194-a24b-2a8d4720cc40 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:28.299998 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a6e38-6d07-43f5-8c18-7ab0fc32a378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:28.300881 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a6e38-6d07-43f5-8c18-7ab0fc32a378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:28.301154 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a6e38-6d07-43f5-8c18-7ab0fc32a378 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:28.301466 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a6e38-6d07-43f5-8c18-7ab0fc32a378 admin admin] PATH_INFO: `/v3/projects/c74b24f2de6b47488be179c5f57bcd1c` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:28.302818 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a6e38-6d07-43f5-8c18-7ab0fc32a378 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c74b24f2de6b47488be179c5f57bcd1c)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:28.304823 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a6e38-6d07-43f5-8c18-7ab0fc32a378 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:28.352268 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-355a6e38-6d07-43f5-8c18-7ab0fc32a378 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c74b24f2de6b47488be179c5f57bcd1c', 'request_id': 'req-355a6e38-6d07-43f5-8c18-7ab0fc32a378'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:28.358299 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-355a6e38-6d07-43f5-8c18-7ab0fc32a378 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c74b24f2de6b47488be179c5f57bcd1c', 'request_id': 'req-355a6e38-6d07-43f5-8c18-7ab0fc32a378'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:28.369063 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-355a6e38-6d07-43f5-8c18-7ab0fc32a378 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c74b24f2de6b47488be179c5f57bcd1c', 'request_id': 'req-355a6e38-6d07-43f5-8c18-7ab0fc32a378'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:28.380583 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-355a6e38-6d07-43f5-8c18-7ab0fc32a378 admin admin] The token cache is being invalidate because project c74b24f2de6b47488be179c5f57bcd1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:29:28.380996 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-355a6e38-6d07-43f5-8c18-7ab0fc32a378 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:28.381664 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-355a6e38-6d07-43f5-8c18-7ab0fc32a378 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:28.383626 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1237/2469] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:29:28 2021] DELETE /identity/v3/projects/c74b24f2de6b47488be179c5f57bcd1c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:29:28.387573 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd4f685-6db1-4e4c-87b2-a18852983cdd service neutron] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:28.399961 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd4f685-6db1-4e4c-87b2-a18852983cdd service neutron] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:28.466087 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c93bfc-15e1-4883-851d-c8005cf64c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:28.467016 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c93bfc-15e1-4883-851d-c8005cf64c1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:28.467289 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c93bfc-15e1-4883-851d-c8005cf64c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:28.467556 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c93bfc-15e1-4883-851d-c8005cf64c1b admin admin] PATH_INFO: `/v3/users/055e1045b3074b2aa6296d4dc1675432` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:28.468786 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c93bfc-15e1-4883-851d-c8005cf64c1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=055e1045b3074b2aa6296d4dc1675432)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:28.470731 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c93bfc-15e1-4883-851d-c8005cf64c1b admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:28.529882 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-f8c93bfc-15e1-4883-851d-c8005cf64c1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '055e1045b3074b2aa6296d4dc1675432'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:28.542414 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-f8c93bfc-15e1-4883-851d-c8005cf64c1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '055e1045b3074b2aa6296d4dc1675432'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:28.572854 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-f8c93bfc-15e1-4883-851d-c8005cf64c1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '055e1045b3074b2aa6296d4dc1675432'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:28.573736 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-f8c93bfc-15e1-4883-851d-c8005cf64c1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '055e1045b3074b2aa6296d4dc1675432'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:28.574638 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-f8c93bfc-15e1-4883-851d-c8005cf64c1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '055e1045b3074b2aa6296d4dc1675432'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:28.594881 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1233/2470] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:29:28 2021] DELETE /identity/v3/users/055e1045b3074b2aa6296d4dc1675432 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:29:29.003758 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a6e38-6d07-43f5-8c18-7ab0fc32a378 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:29.005372 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-355a6e38-6d07-43f5-8c18-7ab0fc32a378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:29:29.021965 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a6e38-6d07-43f5-8c18-7ab0fc32a378 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:29.080841 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e1581-8d90-4060-9c03-f28504885f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:29.081525 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e1581-8d90-4060-9c03-f28504885f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:29.081804 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e1581-8d90-4060-9c03-f28504885f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:29.082073 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e1581-8d90-4060-9c03-f28504885f81 admin admin] PATH_INFO: `/v3/projects/44b8efc761e34077b944cac4d797c1d7` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:29.083354 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e1581-8d90-4060-9c03-f28504885f81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44b8efc761e34077b944cac4d797c1d7)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:29.085263 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e1581-8d90-4060-9c03-f28504885f81 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:29.140072 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-7a3e1581-8d90-4060-9c03-f28504885f81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44b8efc761e34077b944cac4d797c1d7', 'request_id': 'req-7a3e1581-8d90-4060-9c03-f28504885f81'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:29.146270 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-7a3e1581-8d90-4060-9c03-f28504885f81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44b8efc761e34077b944cac4d797c1d7', 'request_id': 'req-7a3e1581-8d90-4060-9c03-f28504885f81'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:29.155317 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-7a3e1581-8d90-4060-9c03-f28504885f81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44b8efc761e34077b944cac4d797c1d7', 'request_id': 'req-7a3e1581-8d90-4060-9c03-f28504885f81'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:29.165446 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-7a3e1581-8d90-4060-9c03-f28504885f81 admin admin] The token cache is being invalidate because project 44b8efc761e34077b944cac4d797c1d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:29:29.165716 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-7a3e1581-8d90-4060-9c03-f28504885f81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:29.166370 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-7a3e1581-8d90-4060-9c03-f28504885f81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:29.167972 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1238/2471] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:29:29 2021] DELETE /identity/v3/projects/44b8efc761e34077b944cac4d797c1d7 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:29:29.174698 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914e32c-dad1-4385-83ec-daba92dd5d4b None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:29.175262 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914e32c-dad1-4385-83ec-daba92dd5d4b None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:29.175372 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0914e32c-dad1-4385-83ec-daba92dd5d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:29.200521 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-0914e32c-dad1-4385-83ec-daba92dd5d4b None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:29:29.201855 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-0914e32c-dad1-4385-83ec-daba92dd5d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:29:29.263631 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1234/2472] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:29:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:29:29.272854 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f09f0-1b30-46ce-a576-a083364330a3 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:29.273211 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f09f0-1b30-46ce-a576-a083364330a3 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:29.273594 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f09f0-1b30-46ce-a576-a083364330a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:29.296476 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-3a4f09f0-1b30-46ce-a576-a083364330a3 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:29:29.297636 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-3a4f09f0-1b30-46ce-a576-a083364330a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:29:29.307218 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1239/2473] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:29:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:29:29.311537 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914e32c-dad1-4385-83ec-daba92dd5d4b None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:29.321297 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0914e32c-dad1-4385-83ec-daba92dd5d4b None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:29.326372 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5413fab-1a78-4c2b-9999-4aeb67f97fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:29.327057 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5413fab-1a78-4c2b-9999-4aeb67f97fdc admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:29.327337 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5413fab-1a78-4c2b-9999-4aeb67f97fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:29.327627 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5413fab-1a78-4c2b-9999-4aeb67f97fdc admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:29.328362 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5413fab-1a78-4c2b-9999-4aeb67f97fdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:29:29.328671 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5413fab-1a78-4c2b-9999-4aeb67f97fdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:29.330271 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5413fab-1a78-4c2b-9999-4aeb67f97fdc admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:29.341874 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1235/2474] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:29:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:29:29.346079 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f09f0-1b30-46ce-a576-a083364330a3 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:29.355445 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f09f0-1b30-46ce-a576-a083364330a3 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:29.360658 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600cafb6-98cf-4b37-a0e5-1107d93da5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:29.361308 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cafb6-98cf-4b37-a0e5-1107d93da5e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:29.361609 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cafb6-98cf-4b37-a0e5-1107d93da5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:29.361882 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600cafb6-98cf-4b37-a0e5-1107d93da5e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:29.362582 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600cafb6-98cf-4b37-a0e5-1107d93da5e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:29.364548 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600cafb6-98cf-4b37-a0e5-1107d93da5e6 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:29.391108 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1240/2475] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:29:29 2021] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:29:29.395487 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5413fab-1a78-4c2b-9999-4aeb67f97fdc admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:29.405587 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5413fab-1a78-4c2b-9999-4aeb67f97fdc admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:29.460919 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b703fb-28ce-440d-abc8-35eb8514dc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:29.461575 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b703fb-28ce-440d-abc8-35eb8514dc5a admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:29.461856 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b703fb-28ce-440d-abc8-35eb8514dc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:29.462131 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b703fb-28ce-440d-abc8-35eb8514dc5a admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:29.462869 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b703fb-28ce-440d-abc8-35eb8514dc5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:29.464794 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b703fb-28ce-440d-abc8-35eb8514dc5a admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:29.486503 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1236/2476] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:29:29 2021] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 29 20:29:29.491456 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600cafb6-98cf-4b37-a0e5-1107d93da5e6 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:29.501789 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600cafb6-98cf-4b37-a0e5-1107d93da5e6 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:29.506824 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2056cf4c-ee73-4e64-9366-4814d606834b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:29.507625 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056cf4c-ee73-4e64-9366-4814d606834b admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:29.507902 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056cf4c-ee73-4e64-9366-4814d606834b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:29.508191 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056cf4c-ee73-4e64-9366-4814d606834b admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:29.509028 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2056cf4c-ee73-4e64-9366-4814d606834b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:29.510668 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2056cf4c-ee73-4e64-9366-4814d606834b admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:29.521488 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1241/2477] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:29:29 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 29 20:29:29.525720 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b703fb-28ce-440d-abc8-35eb8514dc5a admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:29.535680 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b703fb-28ce-440d-abc8-35eb8514dc5a admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:29.540815 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ee1c3-da0e-415e-8254-4531da26ffba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:29.541459 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ee1c3-da0e-415e-8254-4531da26ffba admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:29.541737 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ee1c3-da0e-415e-8254-4531da26ffba admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:29.542009 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ee1c3-da0e-415e-8254-4531da26ffba admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:29.542732 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ee1c3-da0e-415e-8254-4531da26ffba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:29.544373 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ee1c3-da0e-415e-8254-4531da26ffba admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:29.554357 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1237/2478] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:29:29 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:29:29.558237 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2056cf4c-ee73-4e64-9366-4814d606834b admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:29.568657 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2056cf4c-ee73-4e64-9366-4814d606834b admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:29.574474 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf34b6-214f-4fb1-9b5d-4e20e39950ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:29.575777 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf34b6-214f-4fb1-9b5d-4e20e39950ab admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:29.575777 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf34b6-214f-4fb1-9b5d-4e20e39950ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:29.575984 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf34b6-214f-4fb1-9b5d-4e20e39950ab admin admin] PATH_INFO: `/v3/projects/c61e632641fc4ad4b1a39afe868182c7/users/a42a8ef6478a4c9bad1c834c3a7f1e46/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:29.591334 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf34b6-214f-4fb1-9b5d-4e20e39950ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=c61e632641fc4ad4b1a39afe868182c7, user_id=a42a8ef6478a4c9bad1c834c3a7f1e46, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:29.594044 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf34b6-214f-4fb1-9b5d-4e20e39950ab admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:29.610074 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1242/2479] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:29:29 2021] PUT /identity/v3/projects/c61e632641fc4ad4b1a39afe868182c7/users/a42a8ef6478a4c9bad1c834c3a7f1e46/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:29:29.615597 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0f228-4e0f-4ff1-bdcb-d52e7713dd82 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:29.615881 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0f228-4e0f-4ff1-bdcb-d52e7713dd82 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:29.616150 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0f228-4e0f-4ff1-bdcb-d52e7713dd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:29.635700 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-40d0f228-4e0f-4ff1-bdcb-d52e7713dd82 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:29:29.636893 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-40d0f228-4e0f-4ff1-bdcb-d52e7713dd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:29:29.695267 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1238/2480] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:29:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:29:29.705141 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf34b6-214f-4fb1-9b5d-4e20e39950ab admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:29.706945 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-2ebf34b6-214f-4fb1-9b5d-4e20e39950ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:29:29.762698 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf34b6-214f-4fb1-9b5d-4e20e39950ab admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:29.766266 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98832c8d-2aaa-4d27-a402-6d4ea0aaee23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:29.766940 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98832c8d-2aaa-4d27-a402-6d4ea0aaee23 service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:29.767221 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98832c8d-2aaa-4d27-a402-6d4ea0aaee23 service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:29.767489 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98832c8d-2aaa-4d27-a402-6d4ea0aaee23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:29.776530 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98832c8d-2aaa-4d27-a402-6d4ea0aaee23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:29.777945 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98832c8d-2aaa-4d27-a402-6d4ea0aaee23 service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:29.786970 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1243/2481] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:29:29 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:29:30.477857 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8ff98-045f-4ac8-94fd-6e46c42b0ff4 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:30.478429 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8ff98-045f-4ac8-94fd-6e46c42b0ff4 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:30.478429 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8ff98-045f-4ac8-94fd-6e46c42b0ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:30.504144 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-a1f8ff98-045f-4ac8-94fd-6e46c42b0ff4 None None] MFA Rules not processed for user `a42a8ef6478a4c9bad1c834c3a7f1e46`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:29:30.505382 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-a1f8ff98-045f-4ac8-94fd-6e46c42b0ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:29:30.575743 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1239/2482] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:29:30 2021] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:29:30.580429 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98832c8d-2aaa-4d27-a402-6d4ea0aaee23 service neutron] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:30.590461 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98832c8d-2aaa-4d27-a402-6d4ea0aaee23 service neutron] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:30.595577 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216bfdda-d8e8-4f32-a16a-2eefa579671b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:30.596348 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bfdda-d8e8-4f32-a16a-2eefa579671b admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:30.596714 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bfdda-d8e8-4f32-a16a-2eefa579671b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:30.597056 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216bfdda-d8e8-4f32-a16a-2eefa579671b admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:30.597769 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216bfdda-d8e8-4f32-a16a-2eefa579671b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:30.599811 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216bfdda-d8e8-4f32-a16a-2eefa579671b admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:30.628954 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1244/2483] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:29:30 2021] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 29 20:29:30.633159 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8ff98-045f-4ac8-94fd-6e46c42b0ff4 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:30.644115 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8ff98-045f-4ac8-94fd-6e46c42b0ff4 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:30.701412 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd089dfa-b095-4e37-a006-3be7e38271c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:30.702094 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd089dfa-b095-4e37-a006-3be7e38271c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:30.702375 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd089dfa-b095-4e37-a006-3be7e38271c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:30.702648 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd089dfa-b095-4e37-a006-3be7e38271c2 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:30.703398 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd089dfa-b095-4e37-a006-3be7e38271c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:30.705414 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd089dfa-b095-4e37-a006-3be7e38271c2 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:30.727321 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1240/2484] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:29:30 2021] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:29:30.731560 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216bfdda-d8e8-4f32-a16a-2eefa579671b admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:30.742043 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216bfdda-d8e8-4f32-a16a-2eefa579671b admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:30.748172 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e918b-f035-4d83-9fba-87033dbede13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:30.748836 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e918b-f035-4d83-9fba-87033dbede13 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:30.749472 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e918b-f035-4d83-9fba-87033dbede13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:30.749472 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e918b-f035-4d83-9fba-87033dbede13 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:30.750138 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e918b-f035-4d83-9fba-87033dbede13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:30.751762 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e918b-f035-4d83-9fba-87033dbede13 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:30.763060 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1245/2485] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:29:30 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:29:30.767413 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd089dfa-b095-4e37-a006-3be7e38271c2 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:30.778014 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd089dfa-b095-4e37-a006-3be7e38271c2 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:30.783766 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7df1ee-2f7f-4272-957f-f4f0a3d7b033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:30.784650 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7df1ee-2f7f-4272-957f-f4f0a3d7b033 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:30.784925 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7df1ee-2f7f-4272-957f-f4f0a3d7b033 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:30.785201 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7df1ee-2f7f-4272-957f-f4f0a3d7b033 admin admin] PATH_INFO: `/v3/projects/f0f80496ada5476e956657748c0b6a41/users/2cc6faa8798a4ce1991e9887b6b03777/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:30.801720 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7df1ee-2f7f-4272-957f-f4f0a3d7b033 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0f80496ada5476e956657748c0b6a41, user_id=2cc6faa8798a4ce1991e9887b6b03777, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:30.804447 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7df1ee-2f7f-4272-957f-f4f0a3d7b033 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:30.822231 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1241/2486] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:29:30 2021] PUT /identity/v3/projects/f0f80496ada5476e956657748c0b6a41/users/2cc6faa8798a4ce1991e9887b6b03777/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:29:30.830810 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e918b-f035-4d83-9fba-87033dbede13 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:30.841999 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e918b-f035-4d83-9fba-87033dbede13 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:30.897607 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2230298-94d7-4ae0-8e96-81e3bd696e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:30.898221 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2230298-94d7-4ae0-8e96-81e3bd696e69 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:30.898744 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2230298-94d7-4ae0-8e96-81e3bd696e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:30.898991 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2230298-94d7-4ae0-8e96-81e3bd696e69 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:30.899863 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2230298-94d7-4ae0-8e96-81e3bd696e69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:30.907839 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2230298-94d7-4ae0-8e96-81e3bd696e69 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:30.922218 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1246/2487] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:29:30 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:29:30.923626 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7df1ee-2f7f-4272-957f-f4f0a3d7b033 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:30.933835 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7df1ee-2f7f-4272-957f-f4f0a3d7b033 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:30.938698 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45db8d1-62f5-45a5-b2d3-159d546f2a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:30.939635 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45db8d1-62f5-45a5-b2d3-159d546f2a95 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:30.939919 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45db8d1-62f5-45a5-b2d3-159d546f2a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:30.940195 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45db8d1-62f5-45a5-b2d3-159d546f2a95 admin admin] PATH_INFO: `/v3/projects/f0f80496ada5476e956657748c0b6a41/users/2cc6faa8798a4ce1991e9887b6b03777/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:30.942268 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45db8d1-62f5-45a5-b2d3-159d546f2a95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0f80496ada5476e956657748c0b6a41, user_id=2cc6faa8798a4ce1991e9887b6b03777, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:30.944990 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45db8d1-62f5-45a5-b2d3-159d546f2a95 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:30.955061 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1242/2488] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:29:30 2021] PUT /identity/v3/projects/f0f80496ada5476e956657748c0b6a41/users/2cc6faa8798a4ce1991e9887b6b03777/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:29:31.677955 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664c6ab-d288-49f6-8041-dba7d15312f7 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:31.679024 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664c6ab-d288-49f6-8041-dba7d15312f7 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:31.679306 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d664c6ab-d288-49f6-8041-dba7d15312f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:31.721706 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-d664c6ab-d288-49f6-8041-dba7d15312f7 None None] MFA Rules not processed for user `2cc6faa8798a4ce1991e9887b6b03777`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:29:31.722875 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-d664c6ab-d288-49f6-8041-dba7d15312f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:29:31.794061 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1247/2489] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:29:31 2021] POST /identity/v3/auth/tokens => generated 3307 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:29:31.805371 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45db8d1-62f5-45a5-b2d3-159d546f2a95 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:31.807736 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-a45db8d1-62f5-45a5-b2d3-159d546f2a95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:29:31.880100 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45db8d1-62f5-45a5-b2d3-159d546f2a95 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:31.884043 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27a00d-a027-40d5-b9a4-b0c5a5c4a0dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:31.884864 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27a00d-a027-40d5-b9a4-b0c5a5c4a0dd service cinder] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:31.885250 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27a00d-a027-40d5-b9a4-b0c5a5c4a0dd service cinder] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:31.885792 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27a00d-a027-40d5-b9a4-b0c5a5c4a0dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:31.952244 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27a00d-a027-40d5-b9a4-b0c5a5c4a0dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:31.953702 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27a00d-a027-40d5-b9a4-b0c5a5c4a0dd service cinder] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:31.964395 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1243/2490] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:29:31 2021] GET /identity/v3/auth/tokens => generated 3238 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:29:32.691931 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664c6ab-d288-49f6-8041-dba7d15312f7 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:32.693432 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-d664c6ab-d288-49f6-8041-dba7d15312f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:29:32.778406 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d664c6ab-d288-49f6-8041-dba7d15312f7 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:32.784606 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7e5df-0b61-4de8-b7f6-ada799a64a73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:32.785295 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7e5df-0b61-4de8-b7f6-ada799a64a73 service nova] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:32.785575 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7e5df-0b61-4de8-b7f6-ada799a64a73 service nova] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:32.785846 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7e5df-0b61-4de8-b7f6-ada799a64a73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:32.787947 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-91f7e5df-0b61-4de8-b7f6-ada799a64a73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:29:32.800629 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f7e5df-0b61-4de8-b7f6-ada799a64a73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:32.802298 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f7e5df-0b61-4de8-b7f6-ada799a64a73 service nova] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:32.813233 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1248/2491] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:29:32 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:29:33.328596 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27a00d-a027-40d5-b9a4-b0c5a5c4a0dd service cinder] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:33.338796 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27a00d-a027-40d5-b9a4-b0c5a5c4a0dd service cinder] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:33.343233 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c976d47-3b41-4480-ac14-4c818d9300c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:33.344078 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c976d47-3b41-4480-ac14-4c818d9300c4 service cinder] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:33.344531 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c976d47-3b41-4480-ac14-4c818d9300c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:33.344995 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c976d47-3b41-4480-ac14-4c818d9300c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:33.359176 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c976d47-3b41-4480-ac14-4c818d9300c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:33.360628 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c976d47-3b41-4480-ac14-4c818d9300c4 service cinder] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:33.373255 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1244/2492] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:29:33 2021] GET /identity/v3/auth/tokens => generated 3307 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:29:46.357566 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7e5df-0b61-4de8-b7f6-ada799a64a73 service nova] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:46.419814 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7e5df-0b61-4de8-b7f6-ada799a64a73 service nova] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:46.425214 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c49c4-16a3-4605-bc52-d6d2c517bd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:46.426103 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c49c4-16a3-4605-bc52-d6d2c517bd65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:46.426386 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c49c4-16a3-4605-bc52-d6d2c517bd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:46.426662 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c49c4-16a3-4605-bc52-d6d2c517bd65 admin admin] PATH_INFO: `/v3/users/a42a8ef6478a4c9bad1c834c3a7f1e46` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:46.428087 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c49c4-16a3-4605-bc52-d6d2c517bd65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a42a8ef6478a4c9bad1c834c3a7f1e46)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:46.430037 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c49c4-16a3-4605-bc52-d6d2c517bd65 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:46.481827 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-bb1c49c4-16a3-4605-bc52-d6d2c517bd65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a42a8ef6478a4c9bad1c834c3a7f1e46'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:46.489081 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-bb1c49c4-16a3-4605-bc52-d6d2c517bd65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a42a8ef6478a4c9bad1c834c3a7f1e46'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:46.498508 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-bb1c49c4-16a3-4605-bc52-d6d2c517bd65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a42a8ef6478a4c9bad1c834c3a7f1e46'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:46.511473 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-bb1c49c4-16a3-4605-bc52-d6d2c517bd65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a42a8ef6478a4c9bad1c834c3a7f1e46'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:46.512144 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-bb1c49c4-16a3-4605-bc52-d6d2c517bd65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a42a8ef6478a4c9bad1c834c3a7f1e46'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:46.518002 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1249/2493] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:29:46 2021] DELETE /identity/v3/users/a42a8ef6478a4c9bad1c834c3a7f1e46 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:29:46.699251 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c976d47-3b41-4480-ac14-4c818d9300c4 service cinder] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:46.710446 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c976d47-3b41-4480-ac14-4c818d9300c4 service cinder] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:46.777747 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7371bc-9999-48b1-9161-ab352b73a31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:46.778616 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7371bc-9999-48b1-9161-ab352b73a31c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:46.778896 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7371bc-9999-48b1-9161-ab352b73a31c admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:46.779174 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7371bc-9999-48b1-9161-ab352b73a31c admin admin] PATH_INFO: `/v3/projects/c61e632641fc4ad4b1a39afe868182c7` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:46.780373 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7371bc-9999-48b1-9161-ab352b73a31c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c61e632641fc4ad4b1a39afe868182c7)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:46.782277 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7371bc-9999-48b1-9161-ab352b73a31c admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:46.831523 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-8f7371bc-9999-48b1-9161-ab352b73a31c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c61e632641fc4ad4b1a39afe868182c7', 'request_id': 'req-8f7371bc-9999-48b1-9161-ab352b73a31c'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:46.837735 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-8f7371bc-9999-48b1-9161-ab352b73a31c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c61e632641fc4ad4b1a39afe868182c7', 'request_id': 'req-8f7371bc-9999-48b1-9161-ab352b73a31c'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:46.842970 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-8f7371bc-9999-48b1-9161-ab352b73a31c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c61e632641fc4ad4b1a39afe868182c7', 'request_id': 'req-8f7371bc-9999-48b1-9161-ab352b73a31c'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:46.856811 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-8f7371bc-9999-48b1-9161-ab352b73a31c admin admin] The token cache is being invalidate because project c61e632641fc4ad4b1a39afe868182c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:29:46.857121 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-8f7371bc-9999-48b1-9161-ab352b73a31c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:46.857736 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-8f7371bc-9999-48b1-9161-ab352b73a31c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:46.859610 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1245/2494] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:29:46 2021] DELETE /identity/v3/projects/c61e632641fc4ad4b1a39afe868182c7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:29:46.863342 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c49c4-16a3-4605-bc52-d6d2c517bd65 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:46.864764 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-bb1c49c4-16a3-4605-bc52-d6d2c517bd65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:29:46.877792 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c49c4-16a3-4605-bc52-d6d2c517bd65 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:46.942416 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d7d20-571b-4b4e-92f2-f5753c806138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:46.958514 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d7d20-571b-4b4e-92f2-f5753c806138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:46.958514 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d7d20-571b-4b4e-92f2-f5753c806138 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:46.958514 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d7d20-571b-4b4e-92f2-f5753c806138 admin admin] PATH_INFO: `/v3/users/2cc6faa8798a4ce1991e9887b6b03777` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:46.958514 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d7d20-571b-4b4e-92f2-f5753c806138 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cc6faa8798a4ce1991e9887b6b03777)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:46.958514 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d7d20-571b-4b4e-92f2-f5753c806138 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:47.008651 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-a77d7d20-571b-4b4e-92f2-f5753c806138 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cc6faa8798a4ce1991e9887b6b03777'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:47.015783 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-a77d7d20-571b-4b4e-92f2-f5753c806138 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cc6faa8798a4ce1991e9887b6b03777'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:47.025242 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-a77d7d20-571b-4b4e-92f2-f5753c806138 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cc6faa8798a4ce1991e9887b6b03777'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:47.037280 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-a77d7d20-571b-4b4e-92f2-f5753c806138 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cc6faa8798a4ce1991e9887b6b03777'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:47.037970 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-a77d7d20-571b-4b4e-92f2-f5753c806138 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cc6faa8798a4ce1991e9887b6b03777'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:47.043921 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1250/2495] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:29:46 2021] DELETE /identity/v3/users/2cc6faa8798a4ce1991e9887b6b03777 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:29:47.220072 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7371bc-9999-48b1-9161-ab352b73a31c admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:47.222105 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-8f7371bc-9999-48b1-9161-ab352b73a31c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:29:47.237012 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7371bc-9999-48b1-9161-ab352b73a31c admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:47.293479 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67b907-4984-4b43-af5f-e88d4f9e0e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:47.294361 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67b907-4984-4b43-af5f-e88d4f9e0e53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:47.294624 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67b907-4984-4b43-af5f-e88d4f9e0e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:47.294914 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67b907-4984-4b43-af5f-e88d4f9e0e53 admin admin] PATH_INFO: `/v3/projects/f0f80496ada5476e956657748c0b6a41` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:47.296097 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac67b907-4984-4b43-af5f-e88d4f9e0e53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0f80496ada5476e956657748c0b6a41)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:47.297997 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac67b907-4984-4b43-af5f-e88d4f9e0e53 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:47.345554 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-ac67b907-4984-4b43-af5f-e88d4f9e0e53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0f80496ada5476e956657748c0b6a41', 'request_id': 'req-ac67b907-4984-4b43-af5f-e88d4f9e0e53'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:47.351970 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-ac67b907-4984-4b43-af5f-e88d4f9e0e53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0f80496ada5476e956657748c0b6a41', 'request_id': 'req-ac67b907-4984-4b43-af5f-e88d4f9e0e53'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:47.357887 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-ac67b907-4984-4b43-af5f-e88d4f9e0e53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0f80496ada5476e956657748c0b6a41', 'request_id': 'req-ac67b907-4984-4b43-af5f-e88d4f9e0e53'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:47.372872 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-ac67b907-4984-4b43-af5f-e88d4f9e0e53 admin admin] The token cache is being invalidate because project f0f80496ada5476e956657748c0b6a41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:29:47.373159 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-ac67b907-4984-4b43-af5f-e88d4f9e0e53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:47.373800 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-ac67b907-4984-4b43-af5f-e88d4f9e0e53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:29:47.381606 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1246/2496] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:29:47 2021] DELETE /identity/v3/projects/f0f80496ada5476e956657748c0b6a41 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:29:47.383980 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cf189-6fb8-4a99-b369-477fa6927924 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:47.384447 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cf189-6fb8-4a99-b369-477fa6927924 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:47.385010 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39cf189-6fb8-4a99-b369-477fa6927924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:47.404816 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-e39cf189-6fb8-4a99-b369-477fa6927924 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:29:47.406026 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-e39cf189-6fb8-4a99-b369-477fa6927924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:29:47.463912 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1251/2497] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:29:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:29:47.472088 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a76d0-3165-499a-86b5-e230168419e2 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:47.472375 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a76d0-3165-499a-86b5-e230168419e2 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:47.472649 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a76d0-3165-499a-86b5-e230168419e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:47.492443 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-920a76d0-3165-499a-86b5-e230168419e2 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:29:47.493641 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-920a76d0-3165-499a-86b5-e230168419e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:29:47.502366 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1247/2498] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:29:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:29:47.506763 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39cf189-6fb8-4a99-b369-477fa6927924 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:47.517484 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39cf189-6fb8-4a99-b369-477fa6927924 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:47.523947 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b09903-532b-49ca-b6db-035838598093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:47.524611 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b09903-532b-49ca-b6db-035838598093 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:47.524893 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b09903-532b-49ca-b6db-035838598093 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:47.525166 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b09903-532b-49ca-b6db-035838598093 admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:47.525884 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b09903-532b-49ca-b6db-035838598093 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:29:47.526217 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b09903-532b-49ca-b6db-035838598093 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:47.527831 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b09903-532b-49ca-b6db-035838598093 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:47.539818 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1252/2499] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:29:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:29:47.544156 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a76d0-3165-499a-86b5-e230168419e2 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:47.553350 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a76d0-3165-499a-86b5-e230168419e2 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:47.558480 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b31ca-aa46-4629-a67e-5eeb6d61bc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:47.559151 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b31ca-aa46-4629-a67e-5eeb6d61bc77 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:47.559445 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b31ca-aa46-4629-a67e-5eeb6d61bc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:47.559702 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b31ca-aa46-4629-a67e-5eeb6d61bc77 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:47.560407 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987b31ca-aa46-4629-a67e-5eeb6d61bc77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:47.562398 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987b31ca-aa46-4629-a67e-5eeb6d61bc77 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:47.591134 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1248/2500] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:29:47 2021] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:29:47.595457 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b09903-532b-49ca-b6db-035838598093 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:47.605445 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b09903-532b-49ca-b6db-035838598093 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:47.667538 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b372b0-185d-4cbc-955b-1fb3756458aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:47.668220 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b372b0-185d-4cbc-955b-1fb3756458aa admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:47.668619 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b372b0-185d-4cbc-955b-1fb3756458aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:47.668892 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b372b0-185d-4cbc-955b-1fb3756458aa admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:47.669595 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b372b0-185d-4cbc-955b-1fb3756458aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:47.671662 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b372b0-185d-4cbc-955b-1fb3756458aa admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:47.692592 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1253/2501] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:29:47 2021] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:29:47.696770 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b31ca-aa46-4629-a67e-5eeb6d61bc77 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:47.707160 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b31ca-aa46-4629-a67e-5eeb6d61bc77 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:47.712261 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79a65c-a09b-4cc2-8eac-a7647cc1b3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:47.712908 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79a65c-a09b-4cc2-8eac-a7647cc1b3a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:47.713183 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79a65c-a09b-4cc2-8eac-a7647cc1b3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:47.713449 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79a65c-a09b-4cc2-8eac-a7647cc1b3a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:47.714238 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c79a65c-a09b-4cc2-8eac-a7647cc1b3a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:47.715813 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c79a65c-a09b-4cc2-8eac-a7647cc1b3a0 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:47.726587 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1249/2502] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:29:47 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:29:47.730882 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b372b0-185d-4cbc-955b-1fb3756458aa admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:47.741636 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b372b0-185d-4cbc-955b-1fb3756458aa admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:47.747294 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae29f7-914a-4f6a-9032-c94d7276db73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:47.747932 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae29f7-914a-4f6a-9032-c94d7276db73 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:47.748223 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae29f7-914a-4f6a-9032-c94d7276db73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:47.748475 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae29f7-914a-4f6a-9032-c94d7276db73 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:47.749212 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae29f7-914a-4f6a-9032-c94d7276db73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:47.750792 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae29f7-914a-4f6a-9032-c94d7276db73 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:47.761261 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1254/2503] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:29:47 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:29:47.765573 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79a65c-a09b-4cc2-8eac-a7647cc1b3a0 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:47.776305 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79a65c-a09b-4cc2-8eac-a7647cc1b3a0 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:47.781651 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec5728-0be9-45ae-8488-93726cda9707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:47.782537 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec5728-0be9-45ae-8488-93726cda9707 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:47.782812 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec5728-0be9-45ae-8488-93726cda9707 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:47.783112 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ec5728-0be9-45ae-8488-93726cda9707 admin admin] PATH_INFO: `/v3/projects/e1776a8b3026400da2b6628fa77a0595/users/40beca9b45c84c73bbb9ed67717e58d1/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:47.797429 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec5728-0be9-45ae-8488-93726cda9707 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1776a8b3026400da2b6628fa77a0595, user_id=40beca9b45c84c73bbb9ed67717e58d1, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:47.800109 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ec5728-0be9-45ae-8488-93726cda9707 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:47.814720 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1250/2504] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:29:47 2021] PUT /identity/v3/projects/e1776a8b3026400da2b6628fa77a0595/users/40beca9b45c84c73bbb9ed67717e58d1/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:29:47.826130 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df625eab-eabd-4f1d-84a1-63c34e8d3049 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:47.826417 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df625eab-eabd-4f1d-84a1-63c34e8d3049 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:47.826685 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df625eab-eabd-4f1d-84a1-63c34e8d3049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:47.858773 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-df625eab-eabd-4f1d-84a1-63c34e8d3049 None None] MFA Rules not processed for user `40beca9b45c84c73bbb9ed67717e58d1`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:29:47.860071 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-df625eab-eabd-4f1d-84a1-63c34e8d3049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:29:47.927365 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1255/2505] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:29:47 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:29:47.939115 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec5728-0be9-45ae-8488-93726cda9707 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:29:47.941191 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-75ec5728-0be9-45ae-8488-93726cda9707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:29:48.020794 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ec5728-0be9-45ae-8488-93726cda9707 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:29:48.024780 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328d73d-1262-4064-9bc4-453638a0e903 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcc415af1f5a42febbdbd187e066cf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:29:48.025615 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328d73d-1262-4064-9bc4-453638a0e903 service glance] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:29:48.025756 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328d73d-1262-4064-9bc4-453638a0e903 service glance] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:29:48.025986 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328d73d-1262-4064-9bc4-453638a0e903 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:29:48.035467 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5328d73d-1262-4064-9bc4-453638a0e903 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:29:48.036893 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5328d73d-1262-4064-9bc4-453638a0e903 service glance] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:29:48.049250 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1251/2506] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:29:47 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:30:06.677643 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df625eab-eabd-4f1d-84a1-63c34e8d3049 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:30:06.740680 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df625eab-eabd-4f1d-84a1-63c34e8d3049 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:30:06.745485 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cb2967-1f65-4bc7-9260-8ad122925650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:30:06.746372 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb2967-1f65-4bc7-9260-8ad122925650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:06.746662 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb2967-1f65-4bc7-9260-8ad122925650 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:06.746956 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cb2967-1f65-4bc7-9260-8ad122925650 admin admin] PATH_INFO: `/v3/users/40beca9b45c84c73bbb9ed67717e58d1` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:06.748279 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb2967-1f65-4bc7-9260-8ad122925650 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40beca9b45c84c73bbb9ed67717e58d1)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:30:06.750250 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cb2967-1f65-4bc7-9260-8ad122925650 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:30:06.805025 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-62cb2967-1f65-4bc7-9260-8ad122925650 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40beca9b45c84c73bbb9ed67717e58d1'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:06.812200 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-62cb2967-1f65-4bc7-9260-8ad122925650 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40beca9b45c84c73bbb9ed67717e58d1'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:06.821577 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-62cb2967-1f65-4bc7-9260-8ad122925650 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40beca9b45c84c73bbb9ed67717e58d1'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:06.835376 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-62cb2967-1f65-4bc7-9260-8ad122925650 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40beca9b45c84c73bbb9ed67717e58d1'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:06.836091 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-62cb2967-1f65-4bc7-9260-8ad122925650 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40beca9b45c84c73bbb9ed67717e58d1'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:06.841894 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1256/2507] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:30:06 2021] DELETE /identity/v3/users/40beca9b45c84c73bbb9ed67717e58d1 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:30:06.846509 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f770c-79fd-4235-a6cb-8325e92e9ad6 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:06.847038 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f770c-79fd-4235-a6cb-8325e92e9ad6 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:06.847254 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f770c-79fd-4235-a6cb-8325e92e9ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:06.867392 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-537f770c-79fd-4235-a6cb-8325e92e9ad6 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:30:06.869179 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-537f770c-79fd-4235-a6cb-8325e92e9ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:30:06.877976 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8eeb3c-8a13-4def-9b86-2de54ed1a0cd None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:06.879342 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8eeb3c-8a13-4def-9b86-2de54ed1a0cd None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:06.879873 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8eeb3c-8a13-4def-9b86-2de54ed1a0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:06.899345 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-0c8eeb3c-8a13-4def-9b86-2de54ed1a0cd None None] MFA Rules not processed for user `19d72c913c2b4442836a991120eec243`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:30:06.900670 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-0c8eeb3c-8a13-4def-9b86-2de54ed1a0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:30:06.939445 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1252/2508] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:30:06 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:30:06.949360 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f770c-79fd-4235-a6cb-8325e92e9ad6 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:30:06.950913 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-537f770c-79fd-4235-a6cb-8325e92e9ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:30:06.959188 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1257/2509] 10.222.0.15 () {58 vars in 967 bytes} [Mon Nov 29 20:30:06 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:30:07.011585 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f770c-79fd-4235-a6cb-8325e92e9ad6 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:30:07.015097 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8eeb3c-8a13-4def-9b86-2de54ed1a0cd None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:30:07.015971 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148923a-7944-4fb6-9d99-5fbeb013fdda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:30:07.016792 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148923a-7944-4fb6-9d99-5fbeb013fdda service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:07.017073 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148923a-7944-4fb6-9d99-5fbeb013fdda service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:07.017346 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148923a-7944-4fb6-9d99-5fbeb013fdda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:07.017689 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-0c8eeb3c-8a13-4def-9b86-2de54ed1a0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:30:07.027346 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2148923a-7944-4fb6-9d99-5fbeb013fdda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:30:07.028795 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2148923a-7944-4fb6-9d99-5fbeb013fdda service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:30:07.038624 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1253/2510] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:30:06 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 29 20:30:07.099332 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8eeb3c-8a13-4def-9b86-2de54ed1a0cd None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:30:07.105023 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96610120-ee6e-4c6e-b542-fefb453971be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51fc6fd9b37447bba1759a702b86ce6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:30:07.105678 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96610120-ee6e-4c6e-b542-fefb453971be service swift] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:07.105958 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96610120-ee6e-4c6e-b542-fefb453971be service swift] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:07.106230 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96610120-ee6e-4c6e-b542-fefb453971be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:07.115142 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96610120-ee6e-4c6e-b542-fefb453971be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:30:07.116806 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96610120-ee6e-4c6e-b542-fefb453971be service swift] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:30:07.125414 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1258/2511] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Nov 29 20:30:07 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 29 20:30:07.308717 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148923a-7944-4fb6-9d99-5fbeb013fdda service neutron] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:30:07.310186 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-2148923a-7944-4fb6-9d99-5fbeb013fdda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:30:07.323705 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148923a-7944-4fb6-9d99-5fbeb013fdda service neutron] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:30:07.335531 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a6bc2-b56d-4cc3-a1f3-837cb1580411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:30:07.336806 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a6bc2-b56d-4cc3-a1f3-837cb1580411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:07.336961 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a6bc2-b56d-4cc3-a1f3-837cb1580411 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:07.337759 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a6bc2-b56d-4cc3-a1f3-837cb1580411 admin admin] PATH_INFO: `/v3/projects/e1776a8b3026400da2b6628fa77a0595` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:07.339016 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a6bc2-b56d-4cc3-a1f3-837cb1580411 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1776a8b3026400da2b6628fa77a0595)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:30:07.341187 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a6bc2-b56d-4cc3-a1f3-837cb1580411 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:30:07.396077 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-9a7a6bc2-b56d-4cc3-a1f3-837cb1580411 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1776a8b3026400da2b6628fa77a0595', 'request_id': 'req-9a7a6bc2-b56d-4cc3-a1f3-837cb1580411'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:07.403205 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-9a7a6bc2-b56d-4cc3-a1f3-837cb1580411 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1776a8b3026400da2b6628fa77a0595', 'request_id': 'req-9a7a6bc2-b56d-4cc3-a1f3-837cb1580411'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:07.408848 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-9a7a6bc2-b56d-4cc3-a1f3-837cb1580411 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1776a8b3026400da2b6628fa77a0595', 'request_id': 'req-9a7a6bc2-b56d-4cc3-a1f3-837cb1580411'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:07.424083 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-9a7a6bc2-b56d-4cc3-a1f3-837cb1580411 admin admin] The token cache is being invalidate because project e1776a8b3026400da2b6628fa77a0595 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:30:07.424441 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-9a7a6bc2-b56d-4cc3-a1f3-837cb1580411 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:07.424842 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-9a7a6bc2-b56d-4cc3-a1f3-837cb1580411 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:07.426695 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1254/2512] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:30:07 2021] DELETE /identity/v3/projects/e1776a8b3026400da2b6628fa77a0595 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:30:07.432664 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24d633-3b16-4d3b-912b-922161fdadef None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:07.432970 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24d633-3b16-4d3b-912b-922161fdadef None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:07.433267 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24d633-3b16-4d3b-912b-922161fdadef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:07.451972 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-5b24d633-3b16-4d3b-912b-922161fdadef None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:30:07.453192 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-5b24d633-3b16-4d3b-912b-922161fdadef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:30:07.510548 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1259/2513] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:30:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:30:07.518297 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdc84a-f66c-4f8d-ab2c-7679f8f4f457 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:07.518584 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdc84a-f66c-4f8d-ab2c-7679f8f4f457 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:07.518827 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcdc84a-f66c-4f8d-ab2c-7679f8f4f457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:07.537484 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-3dcdc84a-f66c-4f8d-ab2c-7679f8f4f457 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:30:07.538695 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-3dcdc84a-f66c-4f8d-ab2c-7679f8f4f457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:30:07.549289 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1255/2514] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:30:07 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:30:07.554021 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24d633-3b16-4d3b-912b-922161fdadef None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:30:07.564053 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24d633-3b16-4d3b-912b-922161fdadef None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:30:07.569679 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2df2a2-975c-4e42-a624-486b3ade43ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:30:07.570420 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2df2a2-975c-4e42-a624-486b3ade43ec admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:07.570756 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2df2a2-975c-4e42-a624-486b3ade43ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:07.571138 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2df2a2-975c-4e42-a624-486b3ade43ec admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:07.571864 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2df2a2-975c-4e42-a624-486b3ade43ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:30:07.572173 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2df2a2-975c-4e42-a624-486b3ade43ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:30:07.573822 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2df2a2-975c-4e42-a624-486b3ade43ec admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:30:07.585547 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1260/2515] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:30:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:30:07.590158 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcdc84a-f66c-4f8d-ab2c-7679f8f4f457 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:30:07.599806 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcdc84a-f66c-4f8d-ab2c-7679f8f4f457 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:30:07.604732 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f23b5-7e37-4949-b5df-e5d74274a9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:30:07.605387 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f23b5-7e37-4949-b5df-e5d74274a9fa admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:07.605667 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f23b5-7e37-4949-b5df-e5d74274a9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:07.605940 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f23b5-7e37-4949-b5df-e5d74274a9fa admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:07.606687 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f23b5-7e37-4949-b5df-e5d74274a9fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:30:07.608634 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f23b5-7e37-4949-b5df-e5d74274a9fa admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:30:07.636742 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1256/2516] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:30:07 2021] POST /identity/v3/projects => generated 359 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:30:07.641033 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2df2a2-975c-4e42-a624-486b3ade43ec admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:30:07.651148 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2df2a2-975c-4e42-a624-486b3ade43ec admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:30:07.707929 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2ef68-9d7c-454d-8893-dc1646abe4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:30:07.708775 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2ef68-9d7c-454d-8893-dc1646abe4b2 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:07.709031 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2ef68-9d7c-454d-8893-dc1646abe4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:07.709311 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d2ef68-9d7c-454d-8893-dc1646abe4b2 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:07.710155 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d2ef68-9d7c-454d-8893-dc1646abe4b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:30:07.712145 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d2ef68-9d7c-454d-8893-dc1646abe4b2 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:30:07.735409 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1261/2517] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:30:07 2021] POST /identity/v3/users => generated 280 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:30:07.739729 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f23b5-7e37-4949-b5df-e5d74274a9fa admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:30:07.750344 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f23b5-7e37-4949-b5df-e5d74274a9fa admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:30:07.755587 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2ca92-947b-41e5-9c5d-7459a0cd2441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:30:07.756287 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2ca92-947b-41e5-9c5d-7459a0cd2441 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:07.756604 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2ca92-947b-41e5-9c5d-7459a0cd2441 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:07.756876 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2ca92-947b-41e5-9c5d-7459a0cd2441 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:07.757621 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2ca92-947b-41e5-9c5d-7459a0cd2441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:30:07.759274 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2ca92-947b-41e5-9c5d-7459a0cd2441 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:30:07.771101 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1257/2518] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:30:07 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:30:07.774735 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2ef68-9d7c-454d-8893-dc1646abe4b2 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:30:07.796848 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d2ef68-9d7c-454d-8893-dc1646abe4b2 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:30:07.801924 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599cae1-bb77-4c05-8151-b01b2d8601eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:30:07.802600 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599cae1-bb77-4c05-8151-b01b2d8601eb admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:07.802904 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599cae1-bb77-4c05-8151-b01b2d8601eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:07.803182 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599cae1-bb77-4c05-8151-b01b2d8601eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:07.803923 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599cae1-bb77-4c05-8151-b01b2d8601eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:30:07.805559 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599cae1-bb77-4c05-8151-b01b2d8601eb admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:30:07.817051 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1262/2519] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:30:07 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 29 20:30:07.821347 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2ca92-947b-41e5-9c5d-7459a0cd2441 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:30:07.832637 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2ca92-947b-41e5-9c5d-7459a0cd2441 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:30:07.837559 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1b11a-6827-4e79-8507-1acf49027e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:30:07.838452 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1b11a-6827-4e79-8507-1acf49027e22 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:07.838732 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1b11a-6827-4e79-8507-1acf49027e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:07.839051 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1b11a-6827-4e79-8507-1acf49027e22 admin admin] PATH_INFO: `/v3/projects/4d7f04531f8c426599f5a414271c320c/users/68f0823820a44a1e8686e93e56fa41bf/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:07.854661 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1b11a-6827-4e79-8507-1acf49027e22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d7f04531f8c426599f5a414271c320c, user_id=68f0823820a44a1e8686e93e56fa41bf, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:30:07.857355 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1b11a-6827-4e79-8507-1acf49027e22 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:30:07.872357 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1258/2520] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:30:07 2021] PUT /identity/v3/projects/4d7f04531f8c426599f5a414271c320c/users/68f0823820a44a1e8686e93e56fa41bf/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:30:07.882657 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae117b-5a1a-4218-953d-f252153eacea None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:07.883062 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae117b-5a1a-4218-953d-f252153eacea None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:07.883415 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae117b-5a1a-4218-953d-f252153eacea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:07.916409 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-a1ae117b-5a1a-4218-953d-f252153eacea None None] MFA Rules not processed for user `68f0823820a44a1e8686e93e56fa41bf`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:30:07.917642 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-a1ae117b-5a1a-4218-953d-f252153eacea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:30:07.981817 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1263/2521] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:30:07 2021] POST /identity/v3/auth/tokens => generated 3226 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:30:08.011518 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1b11a-6827-4e79-8507-1acf49027e22 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:30:08.013229 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-49a1b11a-6827-4e79-8507-1acf49027e22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:30:08.072992 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1b11a-6827-4e79-8507-1acf49027e22 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:30:08.076931 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b296bc35-70b3-4dec-815d-9c44fd9c085f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:30:08.077597 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296bc35-70b3-4dec-815d-9c44fd9c085f service cinder] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:08.077877 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296bc35-70b3-4dec-815d-9c44fd9c085f service cinder] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:08.078151 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296bc35-70b3-4dec-815d-9c44fd9c085f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:08.087668 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b296bc35-70b3-4dec-815d-9c44fd9c085f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:30:08.089133 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b296bc35-70b3-4dec-815d-9c44fd9c085f service cinder] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:30:08.100194 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1259/2522] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:30:08 2021] GET /identity/v3/auth/tokens => generated 3226 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:30:08.114291 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae117b-5a1a-4218-953d-f252153eacea None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:30:08.181743 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae117b-5a1a-4218-953d-f252153eacea None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:30:08.187052 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe732b3-e86c-4de3-bc98-b1cd7b7270b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:30:08.187948 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe732b3-e86c-4de3-bc98-b1cd7b7270b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:08.188225 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe732b3-e86c-4de3-bc98-b1cd7b7270b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:08.188498 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe732b3-e86c-4de3-bc98-b1cd7b7270b3 admin admin] PATH_INFO: `/v3/users/68f0823820a44a1e8686e93e56fa41bf` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:08.189820 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe732b3-e86c-4de3-bc98-b1cd7b7270b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68f0823820a44a1e8686e93e56fa41bf)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:30:08.191810 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe732b3-e86c-4de3-bc98-b1cd7b7270b3 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:30:08.241156 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-7fe732b3-e86c-4de3-bc98-b1cd7b7270b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68f0823820a44a1e8686e93e56fa41bf'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:08.247743 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-7fe732b3-e86c-4de3-bc98-b1cd7b7270b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68f0823820a44a1e8686e93e56fa41bf'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:08.256734 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-7fe732b3-e86c-4de3-bc98-b1cd7b7270b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68f0823820a44a1e8686e93e56fa41bf'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:08.268083 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-7fe732b3-e86c-4de3-bc98-b1cd7b7270b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68f0823820a44a1e8686e93e56fa41bf'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:08.268766 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-7fe732b3-e86c-4de3-bc98-b1cd7b7270b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68f0823820a44a1e8686e93e56fa41bf'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:08.274909 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1264/2523] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:30:08 2021] DELETE /identity/v3/users/68f0823820a44a1e8686e93e56fa41bf => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:30:08.279690 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42b0ce-e27e-4ed8-941a-0dd69eefab26 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:08.280013 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42b0ce-e27e-4ed8-941a-0dd69eefab26 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:08.280253 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42b0ce-e27e-4ed8-941a-0dd69eefab26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:08.299666 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-5b42b0ce-e27e-4ed8-941a-0dd69eefab26 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:30:08.300967 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-5b42b0ce-e27e-4ed8-941a-0dd69eefab26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:30:08.357839 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1260/2524] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:30:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:30:08.368155 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe732b3-e86c-4de3-bc98-b1cd7b7270b3 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:30:08.369714 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-7fe732b3-e86c-4de3-bc98-b1cd7b7270b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:30:08.430226 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe732b3-e86c-4de3-bc98-b1cd7b7270b3 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:30:08.434803 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6cb95e-b74d-4f0c-b69f-0ab6c8c6dee2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:30:08.435500 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6cb95e-b74d-4f0c-b69f-0ab6c8c6dee2 service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:08.435780 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6cb95e-b74d-4f0c-b69f-0ab6c8c6dee2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:08.436054 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6cb95e-b74d-4f0c-b69f-0ab6c8c6dee2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:08.446026 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6cb95e-b74d-4f0c-b69f-0ab6c8c6dee2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:30:08.447521 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6cb95e-b74d-4f0c-b69f-0ab6c8c6dee2 service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:30:08.457868 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1265/2525] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:30:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:30:08.758263 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4453d2f3-f9b3-4f29-affb-a0fb987a3826 None None] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:08.758602 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4453d2f3-f9b3-4f29-affb-a0fb987a3826 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:08.758899 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4453d2f3-f9b3-4f29-affb-a0fb987a3826 None None] PATH_INFO: `/` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:08.760697 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1261/2526] 10.222.0.15 () {54 vars in 912 bytes} [Mon Nov 29 20:30:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Nov 29 20:30:08.769007 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58d331-b950-4a4d-a916-144fe5240440 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:08.769548 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58d331-b950-4a4d-a916-144fe5240440 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:08.770084 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c58d331-b950-4a4d-a916-144fe5240440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:08.792537 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-3c58d331-b950-4a4d-a916-144fe5240440 None None] MFA Rules not processed for user `b954c18d7e9349e899f4c1cd42b89166`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:30:08.794547 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-3c58d331-b950-4a4d-a916-144fe5240440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:30:08.818036 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4453d2f3-f9b3-4f29-affb-a0fb987a3826 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:30:08.820578 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-4453d2f3-f9b3-4f29-affb-a0fb987a3826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:30:08.842024 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4453d2f3-f9b3-4f29-affb-a0fb987a3826 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:30:08.846752 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1682fb4-e4eb-448e-b979-1aae60d50620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:30:08.847714 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1682fb4-e4eb-448e-b979-1aae60d50620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:08.847991 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1682fb4-e4eb-448e-b979-1aae60d50620 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:08.848259 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1682fb4-e4eb-448e-b979-1aae60d50620 admin admin] PATH_INFO: `/v3/projects/4d7f04531f8c426599f5a414271c320c` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:08.849479 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1682fb4-e4eb-448e-b979-1aae60d50620 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d7f04531f8c426599f5a414271c320c)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:30:08.851520 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1682fb4-e4eb-448e-b979-1aae60d50620 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:30:08.864082 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1266/2527] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Nov 29 20:30:08 2021] POST /identity/v3/auth/tokens => generated 3298 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:30:08.890445 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c58d331-b950-4a4d-a916-144fe5240440 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:30:08.892421 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-3c58d331-b950-4a4d-a916-144fe5240440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:30:08.903797 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-b1682fb4-e4eb-448e-b979-1aae60d50620 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d7f04531f8c426599f5a414271c320c', 'request_id': 'req-b1682fb4-e4eb-448e-b979-1aae60d50620'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:08.905792 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c58d331-b950-4a4d-a916-144fe5240440 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:30:08.911010 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-b1682fb4-e4eb-448e-b979-1aae60d50620 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d7f04531f8c426599f5a414271c320c', 'request_id': 'req-b1682fb4-e4eb-448e-b979-1aae60d50620'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:08.916625 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-b1682fb4-e4eb-448e-b979-1aae60d50620 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d7f04531f8c426599f5a414271c320c', 'request_id': 'req-b1682fb4-e4eb-448e-b979-1aae60d50620'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:08.930917 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-b1682fb4-e4eb-448e-b979-1aae60d50620 admin admin] The token cache is being invalidate because project 4d7f04531f8c426599f5a414271c320c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:30:08.931446 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-b1682fb4-e4eb-448e-b979-1aae60d50620 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:08.932234 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-b1682fb4-e4eb-448e-b979-1aae60d50620 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:08.934212 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1262/2528] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:30:08 2021] DELETE /identity/v3/projects/4d7f04531f8c426599f5a414271c320c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:30:08.941519 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb60ba-379d-4c75-8185-6f80f9a611ce None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:08.941935 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb60ba-379d-4c75-8185-6f80f9a611ce None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:08.942213 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb60ba-379d-4c75-8185-6f80f9a611ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:08.960733 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-47fb60ba-379d-4c75-8185-6f80f9a611ce None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:30:08.961934 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-47fb60ba-379d-4c75-8185-6f80f9a611ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:30:08.973115 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22655d67-944f-4160-a4ef-9e0856035a5f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b954c18d7e9349e899f4c1cd42b89166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:30:08.973779 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22655d67-944f-4160-a4ef-9e0856035a5f service placement] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:08.974055 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22655d67-944f-4160-a4ef-9e0856035a5f service placement] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:08.974322 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22655d67-944f-4160-a4ef-9e0856035a5f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:08.976089 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-22655d67-944f-4160-a4ef-9e0856035a5f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:30:08.991608 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22655d67-944f-4160-a4ef-9e0856035a5f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:30:08.993267 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22655d67-944f-4160-a4ef-9e0856035a5f service placement] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:30:09.007226 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1267/2529] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:30:08 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 29 20:30:09.024619 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1263/2530] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:30:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:30:09.033132 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90364cc8-015b-4ca0-acc9-f9f0f2f96493 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:09.033427 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90364cc8-015b-4ca0-acc9-f9f0f2f96493 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:09.033743 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90364cc8-015b-4ca0-acc9-f9f0f2f96493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:09.053316 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-90364cc8-015b-4ca0-acc9-f9f0f2f96493 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:30:09.054587 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-90364cc8-015b-4ca0-acc9-f9f0f2f96493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:30:09.062963 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1268/2531] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:30:09 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:30:09.067292 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb60ba-379d-4c75-8185-6f80f9a611ce None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:30:09.076641 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb60ba-379d-4c75-8185-6f80f9a611ce None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:30:09.081224 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f508b-8658-435e-9359-c94ba3cd7b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:30:09.081946 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f508b-8658-435e-9359-c94ba3cd7b31 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:09.082223 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f508b-8658-435e-9359-c94ba3cd7b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:09.082494 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f508b-8658-435e-9359-c94ba3cd7b31 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:09.083478 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f508b-8658-435e-9359-c94ba3cd7b31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:30:09.083615 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f508b-8658-435e-9359-c94ba3cd7b31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:30:09.085141 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f508b-8658-435e-9359-c94ba3cd7b31 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:30:09.097446 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1264/2532] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:30:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:30:09.101820 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90364cc8-015b-4ca0-acc9-f9f0f2f96493 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:30:09.110831 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90364cc8-015b-4ca0-acc9-f9f0f2f96493 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:30:09.116136 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7f9ca-ba7d-43f8-98f8-f29da1b2bb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:30:09.116855 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7f9ca-ba7d-43f8-98f8-f29da1b2bb08 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:09.117120 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7f9ca-ba7d-43f8-98f8-f29da1b2bb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:09.117392 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e7f9ca-ba7d-43f8-98f8-f29da1b2bb08 admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:09.118199 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7f9ca-ba7d-43f8-98f8-f29da1b2bb08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:30:09.120154 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e7f9ca-ba7d-43f8-98f8-f29da1b2bb08 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:30:09.150425 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1269/2533] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:30:09 2021] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:30:09.154971 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f508b-8658-435e-9359-c94ba3cd7b31 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:30:09.165959 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f508b-8658-435e-9359-c94ba3cd7b31 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:30:09.223383 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed176f73-d85a-436c-9313-b606680e82b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:30:09.224059 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed176f73-d85a-436c-9313-b606680e82b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:09.224535 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed176f73-d85a-436c-9313-b606680e82b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:09.224950 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed176f73-d85a-436c-9313-b606680e82b9 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:09.225675 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed176f73-d85a-436c-9313-b606680e82b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:30:09.229069 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed176f73-d85a-436c-9313-b606680e82b9 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:30:09.250493 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1265/2534] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:30:09 2021] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:30:09.254826 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7f9ca-ba7d-43f8-98f8-f29da1b2bb08 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:30:09.271639 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e7f9ca-ba7d-43f8-98f8-f29da1b2bb08 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:30:09.276956 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52588dd5-1656-4417-ac3e-876c0f05bdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:30:09.277851 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52588dd5-1656-4417-ac3e-876c0f05bdf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:09.278140 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52588dd5-1656-4417-ac3e-876c0f05bdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:09.278413 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52588dd5-1656-4417-ac3e-876c0f05bdf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:09.279231 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52588dd5-1656-4417-ac3e-876c0f05bdf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:30:09.280829 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52588dd5-1656-4417-ac3e-876c0f05bdf1 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:30:09.294660 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1270/2535] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:30:09 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 29 20:30:09.295917 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed176f73-d85a-436c-9313-b606680e82b9 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:30:09.306585 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed176f73-d85a-436c-9313-b606680e82b9 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:30:09.312150 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468d945-f97e-4e45-8aac-85955f0667cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:30:09.313255 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468d945-f97e-4e45-8aac-85955f0667cb admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:09.313964 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468d945-f97e-4e45-8aac-85955f0667cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:09.313964 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468d945-f97e-4e45-8aac-85955f0667cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:09.314803 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f468d945-f97e-4e45-8aac-85955f0667cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:30:09.316734 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f468d945-f97e-4e45-8aac-85955f0667cb admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:30:09.330735 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1266/2536] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:30:09 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:30:09.332229 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52588dd5-1656-4417-ac3e-876c0f05bdf1 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:30:09.342385 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52588dd5-1656-4417-ac3e-876c0f05bdf1 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:30:09.347184 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bad177-b1b5-471d-a092-d3c161e69397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:30:09.348185 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bad177-b1b5-471d-a092-d3c161e69397 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:09.348536 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bad177-b1b5-471d-a092-d3c161e69397 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:09.348884 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bad177-b1b5-471d-a092-d3c161e69397 admin admin] PATH_INFO: `/v3/projects/9237a1fe2b1e4ad482723e8699aa258a/users/ee85cc0d732248fca804a985d0b1ec60/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:09.364787 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bad177-b1b5-471d-a092-d3c161e69397 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9237a1fe2b1e4ad482723e8699aa258a, user_id=ee85cc0d732248fca804a985d0b1ec60, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:30:09.367622 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bad177-b1b5-471d-a092-d3c161e69397 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:30:09.392475 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1271/2537] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:30:09 2021] PUT /identity/v3/projects/9237a1fe2b1e4ad482723e8699aa258a/users/ee85cc0d732248fca804a985d0b1ec60/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:30:09.394306 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02c2fc-0c74-4c5e-b754-e33c4f2a4a92 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:09.394592 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02c2fc-0c74-4c5e-b754-e33c4f2a4a92 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:09.394903 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b02c2fc-0c74-4c5e-b754-e33c4f2a4a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:09.433033 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-6b02c2fc-0c74-4c5e-b754-e33c4f2a4a92 None None] MFA Rules not processed for user `ee85cc0d732248fca804a985d0b1ec60`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:30:09.434610 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-6b02c2fc-0c74-4c5e-b754-e33c4f2a4a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:30:09.515197 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1267/2538] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:30:09 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:30:09.525984 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bad177-b1b5-471d-a092-d3c161e69397 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:30:09.527866 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-63bad177-b1b5-471d-a092-d3c161e69397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:30:09.591924 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bad177-b1b5-471d-a092-d3c161e69397 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:30:09.595730 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e30603-f066-40cb-8e32-271d77fdc09e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:30:09.596389 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e30603-f066-40cb-8e32-271d77fdc09e service cinder] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:09.596674 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e30603-f066-40cb-8e32-271d77fdc09e service cinder] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:09.596954 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e30603-f066-40cb-8e32-271d77fdc09e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:09.606108 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e30603-f066-40cb-8e32-271d77fdc09e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:30:09.607936 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e30603-f066-40cb-8e32-271d77fdc09e service cinder] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:30:09.617727 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1272/2539] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:30:09 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:30:11.564952 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4273a49-98d6-4fcb-9696-d51e4348da46 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:11.565517 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4273a49-98d6-4fcb-9696-d51e4348da46 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:11.565517 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4273a49-98d6-4fcb-9696-d51e4348da46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:11.584422 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-b4273a49-98d6-4fcb-9696-d51e4348da46 None None] MFA Rules not processed for user `0746d603781d4b3796959e8217112cc5`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:30:11.585630 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-b4273a49-98d6-4fcb-9696-d51e4348da46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:30:11.642735 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1268/2540] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:30:11 2021] POST /identity/v3/auth/tokens => generated 3256 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:30:12.188953 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e30603-f066-40cb-8e32-271d77fdc09e service cinder] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:30:12.260874 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e30603-f066-40cb-8e32-271d77fdc09e service cinder] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:30:12.266840 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ef7a7-9c32-411e-85ce-d35987f53ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:30:12.267758 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ef7a7-9c32-411e-85ce-d35987f53ad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:12.268041 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ef7a7-9c32-411e-85ce-d35987f53ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:12.268314 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ef7a7-9c32-411e-85ce-d35987f53ad5 admin admin] PATH_INFO: `/v3/users/ee85cc0d732248fca804a985d0b1ec60` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:12.269646 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9ef7a7-9c32-411e-85ce-d35987f53ad5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee85cc0d732248fca804a985d0b1ec60)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:30:12.272647 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9ef7a7-9c32-411e-85ce-d35987f53ad5 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:30:12.330146 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-2d9ef7a7-9c32-411e-85ce-d35987f53ad5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee85cc0d732248fca804a985d0b1ec60'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:12.337050 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-2d9ef7a7-9c32-411e-85ce-d35987f53ad5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee85cc0d732248fca804a985d0b1ec60'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:12.349439 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-2d9ef7a7-9c32-411e-85ce-d35987f53ad5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee85cc0d732248fca804a985d0b1ec60'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:12.362254 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-2d9ef7a7-9c32-411e-85ce-d35987f53ad5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee85cc0d732248fca804a985d0b1ec60'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:12.363020 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-2d9ef7a7-9c32-411e-85ce-d35987f53ad5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee85cc0d732248fca804a985d0b1ec60'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:12.371968 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1273/2541] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:30:12 2021] DELETE /identity/v3/users/ee85cc0d732248fca804a985d0b1ec60 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:30:12.373746 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdb46b-2376-4def-89a2-23ac6df462d9 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:12.374047 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdb46b-2376-4def-89a2-23ac6df462d9 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:12.374372 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fdb46b-2376-4def-89a2-23ac6df462d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:12.393330 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-c5fdb46b-2376-4def-89a2-23ac6df462d9 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:30:12.394557 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-c5fdb46b-2376-4def-89a2-23ac6df462d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:30:12.453058 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1269/2542] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:30:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:30:12.463112 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ef7a7-9c32-411e-85ce-d35987f53ad5 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:30:12.464651 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-2d9ef7a7-9c32-411e-85ce-d35987f53ad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:30:12.522382 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ef7a7-9c32-411e-85ce-d35987f53ad5 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:30:12.526063 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c27f1ae-add2-4a80-aa7a-723b1756d65e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:30:12.526709 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27f1ae-add2-4a80-aa7a-723b1756d65e service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:12.527062 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27f1ae-add2-4a80-aa7a-723b1756d65e service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:12.527350 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27f1ae-add2-4a80-aa7a-723b1756d65e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:12.537636 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c27f1ae-add2-4a80-aa7a-723b1756d65e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:30:12.539108 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c27f1ae-add2-4a80-aa7a-723b1756d65e service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:30:12.549620 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1274/2543] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:30:12 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:30:12.821671 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fdb46b-2376-4def-89a2-23ac6df462d9 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:30:12.823307 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-c5fdb46b-2376-4def-89a2-23ac6df462d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:30:12.836937 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fdb46b-2376-4def-89a2-23ac6df462d9 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:30:12.842633 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bed8b9-b4f7-400f-b379-2a622f9e3ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:30:12.843555 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bed8b9-b4f7-400f-b379-2a622f9e3ebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:12.843834 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bed8b9-b4f7-400f-b379-2a622f9e3ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:12.844251 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bed8b9-b4f7-400f-b379-2a622f9e3ebc admin admin] PATH_INFO: `/v3/projects/9237a1fe2b1e4ad482723e8699aa258a` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:12.845578 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bed8b9-b4f7-400f-b379-2a622f9e3ebc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9237a1fe2b1e4ad482723e8699aa258a)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:30:12.847561 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bed8b9-b4f7-400f-b379-2a622f9e3ebc admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:30:12.895225 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-46bed8b9-b4f7-400f-b379-2a622f9e3ebc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9237a1fe2b1e4ad482723e8699aa258a', 'request_id': 'req-46bed8b9-b4f7-400f-b379-2a622f9e3ebc'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:12.902185 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-46bed8b9-b4f7-400f-b379-2a622f9e3ebc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9237a1fe2b1e4ad482723e8699aa258a', 'request_id': 'req-46bed8b9-b4f7-400f-b379-2a622f9e3ebc'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:12.908349 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-46bed8b9-b4f7-400f-b379-2a622f9e3ebc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9237a1fe2b1e4ad482723e8699aa258a', 'request_id': 'req-46bed8b9-b4f7-400f-b379-2a622f9e3ebc'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:12.922969 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-46bed8b9-b4f7-400f-b379-2a622f9e3ebc admin admin] The token cache is being invalidate because project 9237a1fe2b1e4ad482723e8699aa258a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:30:12.923269 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-46bed8b9-b4f7-400f-b379-2a622f9e3ebc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:12.924161 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-46bed8b9-b4f7-400f-b379-2a622f9e3ebc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:12.926393 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1270/2544] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:30:12 2021] DELETE /identity/v3/projects/9237a1fe2b1e4ad482723e8699aa258a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:30:12.932227 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41180615-e341-4896-b73f-f748220e6ed5 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:12.932517 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41180615-e341-4896-b73f-f748220e6ed5 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:12.932798 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41180615-e341-4896-b73f-f748220e6ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:12.950405 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-41180615-e341-4896-b73f-f748220e6ed5 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:30:12.951651 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-41180615-e341-4896-b73f-f748220e6ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:30:13.011640 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1275/2545] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:30:12 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:30:13.019766 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add887d-d572-4fef-9925-008e4b20ac32 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:13.020052 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add887d-d572-4fef-9925-008e4b20ac32 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:13.020329 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add887d-d572-4fef-9925-008e4b20ac32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:13.039172 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-9add887d-d572-4fef-9925-008e4b20ac32 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:30:13.040385 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-9add887d-d572-4fef-9925-008e4b20ac32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:30:13.048803 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1271/2546] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:30:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:30:13.053562 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41180615-e341-4896-b73f-f748220e6ed5 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:30:13.066265 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41180615-e341-4896-b73f-f748220e6ed5 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:30:13.071302 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791000c-1769-4f47-b06c-4295ef5cd333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:30:13.071969 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791000c-1769-4f47-b06c-4295ef5cd333 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:13.072251 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791000c-1769-4f47-b06c-4295ef5cd333 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:13.072525 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791000c-1769-4f47-b06c-4295ef5cd333 admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:13.073275 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791000c-1769-4f47-b06c-4295ef5cd333 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:30:13.073582 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791000c-1769-4f47-b06c-4295ef5cd333 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:30:13.075234 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791000c-1769-4f47-b06c-4295ef5cd333 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:30:13.086581 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1276/2547] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:30:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:30:13.091042 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add887d-d572-4fef-9925-008e4b20ac32 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:30:13.100270 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add887d-d572-4fef-9925-008e4b20ac32 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:30:13.105343 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760edf5-2f5f-48a4-8b40-90b6361a8e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:30:13.105994 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760edf5-2f5f-48a4-8b40-90b6361a8e58 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:13.106277 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760edf5-2f5f-48a4-8b40-90b6361a8e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:13.106555 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760edf5-2f5f-48a4-8b40-90b6361a8e58 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:13.107308 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2760edf5-2f5f-48a4-8b40-90b6361a8e58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:30:13.109210 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2760edf5-2f5f-48a4-8b40-90b6361a8e58 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:30:13.137125 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1272/2548] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:30:13 2021] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:30:13.141880 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791000c-1769-4f47-b06c-4295ef5cd333 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:30:13.155368 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791000c-1769-4f47-b06c-4295ef5cd333 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:30:13.225083 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236ec33-6480-4887-874e-65a981564618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:30:13.225789 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236ec33-6480-4887-874e-65a981564618 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:13.226026 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236ec33-6480-4887-874e-65a981564618 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:13.226297 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236ec33-6480-4887-874e-65a981564618 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:13.227050 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5236ec33-6480-4887-874e-65a981564618 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:30:13.228960 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5236ec33-6480-4887-874e-65a981564618 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:30:13.252345 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1277/2549] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:30:13 2021] POST /identity/v3/users => generated 291 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:30:13.256737 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760edf5-2f5f-48a4-8b40-90b6361a8e58 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:30:13.268616 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2760edf5-2f5f-48a4-8b40-90b6361a8e58 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:30:13.274696 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac2db3-7960-4eb9-b088-4fc74437e37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:30:13.276284 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac2db3-7960-4eb9-b088-4fc74437e37a admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:13.276570 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac2db3-7960-4eb9-b088-4fc74437e37a admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:13.276845 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac2db3-7960-4eb9-b088-4fc74437e37a admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:13.277601 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac2db3-7960-4eb9-b088-4fc74437e37a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:30:13.279361 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac2db3-7960-4eb9-b088-4fc74437e37a admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:30:13.290803 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1273/2550] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:30:13 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:30:13.294931 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236ec33-6480-4887-874e-65a981564618 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:30:13.305015 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236ec33-6480-4887-874e-65a981564618 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:30:13.309883 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fc14d-45b8-4937-a812-b8bd0e73ffd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:30:13.310546 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fc14d-45b8-4937-a812-b8bd0e73ffd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:13.310833 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fc14d-45b8-4937-a812-b8bd0e73ffd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:13.311138 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fc14d-45b8-4937-a812-b8bd0e73ffd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:13.311917 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668fc14d-45b8-4937-a812-b8bd0e73ffd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:30:13.313520 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668fc14d-45b8-4937-a812-b8bd0e73ffd9 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:30:13.323758 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1278/2551] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:30:13 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 29 20:30:13.327799 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac2db3-7960-4eb9-b088-4fc74437e37a admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:30:13.338583 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac2db3-7960-4eb9-b088-4fc74437e37a admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:30:13.343572 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559c5c7-62b7-4325-ac83-bd847d03b0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:30:13.344486 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559c5c7-62b7-4325-ac83-bd847d03b0be admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:13.344765 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559c5c7-62b7-4325-ac83-bd847d03b0be admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:13.345042 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559c5c7-62b7-4325-ac83-bd847d03b0be admin admin] PATH_INFO: `/v3/projects/da97463c6b6a424b9e12695a9e6eb94f/users/b0cab81601004a4b87852dd3ed53ef70/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:13.360007 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1559c5c7-62b7-4325-ac83-bd847d03b0be admin admin] RBAC: Authorizing `identity:create_grant(project_id=da97463c6b6a424b9e12695a9e6eb94f, user_id=b0cab81601004a4b87852dd3ed53ef70, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:30:13.362664 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1559c5c7-62b7-4325-ac83-bd847d03b0be admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:30:13.378502 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1274/2552] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:30:13 2021] PUT /identity/v3/projects/da97463c6b6a424b9e12695a9e6eb94f/users/b0cab81601004a4b87852dd3ed53ef70/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:30:13.383731 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9ee78-a1ba-4298-8d3e-b8763b31bd2d None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:13.384288 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9ee78-a1ba-4298-8d3e-b8763b31bd2d None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:13.384792 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9ee78-a1ba-4298-8d3e-b8763b31bd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:13.403386 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-65e9ee78-a1ba-4298-8d3e-b8763b31bd2d None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:30:13.404607 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-65e9ee78-a1ba-4298-8d3e-b8763b31bd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:30:13.460660 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1279/2553] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:30:13 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:30:13.471742 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559c5c7-62b7-4325-ac83-bd847d03b0be admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:30:13.474893 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-1559c5c7-62b7-4325-ac83-bd847d03b0be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:30:13.538562 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559c5c7-62b7-4325-ac83-bd847d03b0be admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:30:13.543183 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba8b6b-deb1-44ba-a478-4eb8f321edec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:30:13.543826 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba8b6b-deb1-44ba-a478-4eb8f321edec service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:13.544102 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba8b6b-deb1-44ba-a478-4eb8f321edec service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:13.544370 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba8b6b-deb1-44ba-a478-4eb8f321edec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:13.553861 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba8b6b-deb1-44ba-a478-4eb8f321edec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:30:13.555333 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba8b6b-deb1-44ba-a478-4eb8f321edec service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:30:13.564705 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1275/2554] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:30:13 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:30:14.188505 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd63d4-495d-42a9-b826-ed51d3dba1bc None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:14.189324 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd63d4-495d-42a9-b826-ed51d3dba1bc None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:14.189324 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd63d4-495d-42a9-b826-ed51d3dba1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:14.223766 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-27fd63d4-495d-42a9-b826-ed51d3dba1bc None None] MFA Rules not processed for user `b0cab81601004a4b87852dd3ed53ef70`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:30:14.225114 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-27fd63d4-495d-42a9-b826-ed51d3dba1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:30:14.298415 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1280/2555] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:30:14 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:30:14.305612 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba8b6b-deb1-44ba-a478-4eb8f321edec service neutron] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:30:14.307180 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-08ba8b6b-deb1-44ba-a478-4eb8f321edec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:30:14.365820 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba8b6b-deb1-44ba-a478-4eb8f321edec service neutron] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:30:14.369863 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328085c7-0f21-4a84-b80a-a04ebfb87e32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:30:14.370699 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328085c7-0f21-4a84-b80a-a04ebfb87e32 service cinder] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:14.371011 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328085c7-0f21-4a84-b80a-a04ebfb87e32 service cinder] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:14.371280 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328085c7-0f21-4a84-b80a-a04ebfb87e32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:14.380251 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328085c7-0f21-4a84-b80a-a04ebfb87e32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:30:14.381683 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328085c7-0f21-4a84-b80a-a04ebfb87e32 service cinder] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:30:14.391624 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1276/2556] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:30:14 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:30:15.732306 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c24de-1904-4de3-88c4-418fa20f13c9 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:15.732816 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c24de-1904-4de3-88c4-418fa20f13c9 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:15.732924 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c24de-1904-4de3-88c4-418fa20f13c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:15.750647 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-656c24de-1904-4de3-88c4-418fa20f13c9 None None] MFA Rules not processed for user `b0cab81601004a4b87852dd3ed53ef70`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:30:15.751876 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-656c24de-1904-4de3-88c4-418fa20f13c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:30:15.760154 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1281/2557] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:30:15 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:30:26.514362 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328085c7-0f21-4a84-b80a-a04ebfb87e32 service cinder] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:30:26.524787 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328085c7-0f21-4a84-b80a-a04ebfb87e32 service cinder] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:30:26.529209 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93b204-2874-4dfb-af39-f0ef64fddbdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:30:26.529844 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93b204-2874-4dfb-af39-f0ef64fddbdc service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:26.530094 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93b204-2874-4dfb-af39-f0ef64fddbdc service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:26.530391 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93b204-2874-4dfb-af39-f0ef64fddbdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:26.532341 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-1f93b204-2874-4dfb-af39-f0ef64fddbdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:30:26.607316 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93b204-2874-4dfb-af39-f0ef64fddbdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:30:26.608895 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93b204-2874-4dfb-af39-f0ef64fddbdc service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:30:26.623042 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1277/2558] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:30:26 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:30:29.002796 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c24de-1904-4de3-88c4-418fa20f13c9 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:30:29.004857 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-656c24de-1904-4de3-88c4-418fa20f13c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:30:29.020148 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c24de-1904-4de3-88c4-418fa20f13c9 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:30:29.024283 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbba90c-d030-4eb4-ba39-dc20293a43af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:30:29.025059 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbba90c-d030-4eb4-ba39-dc20293a43af service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:29.025427 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbba90c-d030-4eb4-ba39-dc20293a43af service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:29.025697 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbba90c-d030-4eb4-ba39-dc20293a43af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:29.027470 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-dcbba90c-d030-4eb4-ba39-dc20293a43af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:30:29.040745 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbba90c-d030-4eb4-ba39-dc20293a43af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:30:29.042183 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbba90c-d030-4eb4-ba39-dc20293a43af service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:30:29.053067 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1282/2559] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:30:29 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:30:31.632256 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aaa1f1-236a-4191-bb0d-37f9c35a34c7 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:31.633226 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aaa1f1-236a-4191-bb0d-37f9c35a34c7 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:31.633525 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aaa1f1-236a-4191-bb0d-37f9c35a34c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:31.660258 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-22aaa1f1-236a-4191-bb0d-37f9c35a34c7 None None] MFA Rules not processed for user `19d72c913c2b4442836a991120eec243`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:30:31.661680 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-22aaa1f1-236a-4191-bb0d-37f9c35a34c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:30:31.757981 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1278/2560] 10.222.0.15 () {58 vars in 967 bytes} [Mon Nov 29 20:30:31 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:30:31.778324 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbba90c-d030-4eb4-ba39-dc20293a43af service neutron] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:30:31.780864 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-dcbba90c-d030-4eb4-ba39-dc20293a43af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:30:31.923481 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbba90c-d030-4eb4-ba39-dc20293a43af service neutron] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:30:31.929617 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312c9f3-4a45-487f-8077-18a31d14a803 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51fc6fd9b37447bba1759a702b86ce6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:30:31.930316 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312c9f3-4a45-487f-8077-18a31d14a803 service swift] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:31.930597 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312c9f3-4a45-487f-8077-18a31d14a803 service swift] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:31.930893 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312c9f3-4a45-487f-8077-18a31d14a803 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:31.944509 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d312c9f3-4a45-487f-8077-18a31d14a803 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:30:31.946180 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d312c9f3-4a45-487f-8077-18a31d14a803 service swift] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:30:31.968498 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1283/2561] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Nov 29 20:30:31 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:30:32.429807 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aaa1f1-236a-4191-bb0d-37f9c35a34c7 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:30:32.439670 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aaa1f1-236a-4191-bb0d-37f9c35a34c7 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:30:32.443296 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d60004-1f6e-4a92-bc93-37cb7ac7b253 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:30:32.443944 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d60004-1f6e-4a92-bc93-37cb7ac7b253 service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:32.444221 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d60004-1f6e-4a92-bc93-37cb7ac7b253 service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:32.444493 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d60004-1f6e-4a92-bc93-37cb7ac7b253 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:32.446385 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-08d60004-1f6e-4a92-bc93-37cb7ac7b253 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:30:32.458778 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d60004-1f6e-4a92-bc93-37cb7ac7b253 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:30:32.460316 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d60004-1f6e-4a92-bc93-37cb7ac7b253 service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:30:32.471270 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1279/2562] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:30:32 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:30:38.222780 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312c9f3-4a45-487f-8077-18a31d14a803 service swift] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:30:38.224430 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-d312c9f3-4a45-487f-8077-18a31d14a803 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:30:38.238334 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312c9f3-4a45-487f-8077-18a31d14a803 service swift] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:30:38.242326 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b758476f-e042-4040-81a5-eef8e9d4ae25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:30:38.243049 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758476f-e042-4040-81a5-eef8e9d4ae25 service cinder] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:38.243682 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758476f-e042-4040-81a5-eef8e9d4ae25 service cinder] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:38.243962 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758476f-e042-4040-81a5-eef8e9d4ae25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:38.245767 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-b758476f-e042-4040-81a5-eef8e9d4ae25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:30:38.360073 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b758476f-e042-4040-81a5-eef8e9d4ae25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:30:38.361686 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b758476f-e042-4040-81a5-eef8e9d4ae25 service cinder] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:30:38.385431 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1284/2563] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:30:38 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:30:39.474442 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d60004-1f6e-4a92-bc93-37cb7ac7b253 service neutron] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:30:39.479698 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-08d60004-1f6e-4a92-bc93-37cb7ac7b253 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:30:39.496091 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d60004-1f6e-4a92-bc93-37cb7ac7b253 service neutron] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:30:39.515188 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186979f-08e7-46a9-9d86-69af824d7e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:30:39.519611 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186979f-08e7-46a9-9d86-69af824d7e2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:39.519945 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186979f-08e7-46a9-9d86-69af824d7e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:39.520333 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186979f-08e7-46a9-9d86-69af824d7e2c admin admin] PATH_INFO: `/v3/users/82869068bf684f1d8e6248fca88a49bb` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:39.522063 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d186979f-08e7-46a9-9d86-69af824d7e2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=82869068bf684f1d8e6248fca88a49bb)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:30:39.524210 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d186979f-08e7-46a9-9d86-69af824d7e2c admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:30:39.572714 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-d186979f-08e7-46a9-9d86-69af824d7e2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82869068bf684f1d8e6248fca88a49bb'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:39.579334 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-d186979f-08e7-46a9-9d86-69af824d7e2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82869068bf684f1d8e6248fca88a49bb'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:39.590892 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-d186979f-08e7-46a9-9d86-69af824d7e2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82869068bf684f1d8e6248fca88a49bb'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:39.591757 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-d186979f-08e7-46a9-9d86-69af824d7e2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82869068bf684f1d8e6248fca88a49bb'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:39.592520 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-d186979f-08e7-46a9-9d86-69af824d7e2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82869068bf684f1d8e6248fca88a49bb'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:39.605409 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1280/2564] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:30:39 2021] DELETE /identity/v3/users/82869068bf684f1d8e6248fca88a49bb => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:30:39.785823 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b758476f-e042-4040-81a5-eef8e9d4ae25 service cinder] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:30:39.799455 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b758476f-e042-4040-81a5-eef8e9d4ae25 service cinder] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:30:39.869302 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076d4e8-b79f-49ed-bb4f-b2c60f7607f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:30:39.870285 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076d4e8-b79f-49ed-bb4f-b2c60f7607f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:39.870567 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076d4e8-b79f-49ed-bb4f-b2c60f7607f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:39.870841 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076d4e8-b79f-49ed-bb4f-b2c60f7607f7 admin admin] PATH_INFO: `/v3/projects/0c9b2b4aee1a4bacaec32bafef2e9965` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:39.872063 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6076d4e8-b79f-49ed-bb4f-b2c60f7607f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c9b2b4aee1a4bacaec32bafef2e9965)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:30:39.873957 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6076d4e8-b79f-49ed-bb4f-b2c60f7607f7 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:30:39.920882 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-6076d4e8-b79f-49ed-bb4f-b2c60f7607f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c9b2b4aee1a4bacaec32bafef2e9965', 'request_id': 'req-6076d4e8-b79f-49ed-bb4f-b2c60f7607f7'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:39.926955 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-6076d4e8-b79f-49ed-bb4f-b2c60f7607f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c9b2b4aee1a4bacaec32bafef2e9965', 'request_id': 'req-6076d4e8-b79f-49ed-bb4f-b2c60f7607f7'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:39.935171 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-6076d4e8-b79f-49ed-bb4f-b2c60f7607f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c9b2b4aee1a4bacaec32bafef2e9965', 'request_id': 'req-6076d4e8-b79f-49ed-bb4f-b2c60f7607f7'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:39.945324 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-6076d4e8-b79f-49ed-bb4f-b2c60f7607f7 admin admin] The token cache is being invalidate because project 0c9b2b4aee1a4bacaec32bafef2e9965 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:30:39.945620 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-6076d4e8-b79f-49ed-bb4f-b2c60f7607f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:39.946235 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-6076d4e8-b79f-49ed-bb4f-b2c60f7607f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:39.947851 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1285/2565] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:30:39 2021] DELETE /identity/v3/projects/0c9b2b4aee1a4bacaec32bafef2e9965 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:30:39.951889 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186979f-08e7-46a9-9d86-69af824d7e2c admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:30:39.953295 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-d186979f-08e7-46a9-9d86-69af824d7e2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:30:39.966797 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d186979f-08e7-46a9-9d86-69af824d7e2c admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:30:40.019991 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ccf04-91e5-4a2d-8b8b-4dd505d4b9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:30:40.021316 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ccf04-91e5-4a2d-8b8b-4dd505d4b9c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:40.021588 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ccf04-91e5-4a2d-8b8b-4dd505d4b9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:40.021862 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ccf04-91e5-4a2d-8b8b-4dd505d4b9c5 admin admin] PATH_INFO: `/v3/users/beccca8676944bc4b3e6c9828998da55` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:40.023091 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ccf04-91e5-4a2d-8b8b-4dd505d4b9c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=beccca8676944bc4b3e6c9828998da55)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:30:40.025047 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ccf04-91e5-4a2d-8b8b-4dd505d4b9c5 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:30:40.069822 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-756ccf04-91e5-4a2d-8b8b-4dd505d4b9c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beccca8676944bc4b3e6c9828998da55'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:40.076775 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-756ccf04-91e5-4a2d-8b8b-4dd505d4b9c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beccca8676944bc4b3e6c9828998da55'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:40.088423 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-756ccf04-91e5-4a2d-8b8b-4dd505d4b9c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beccca8676944bc4b3e6c9828998da55'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:40.089084 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-756ccf04-91e5-4a2d-8b8b-4dd505d4b9c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beccca8676944bc4b3e6c9828998da55'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:40.089683 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-756ccf04-91e5-4a2d-8b8b-4dd505d4b9c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beccca8676944bc4b3e6c9828998da55'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:40.102719 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1281/2566] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:30:39 2021] DELETE /identity/v3/users/beccca8676944bc4b3e6c9828998da55 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:30:40.277653 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076d4e8-b79f-49ed-bb4f-b2c60f7607f7 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:30:40.279297 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-6076d4e8-b79f-49ed-bb4f-b2c60f7607f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:30:40.299748 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076d4e8-b79f-49ed-bb4f-b2c60f7607f7 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:30:40.364893 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ee0530-0727-4bf7-a8ee-c664dd372a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:30:40.365801 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee0530-0727-4bf7-a8ee-c664dd372a73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:40.366219 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee0530-0727-4bf7-a8ee-c664dd372a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:40.366590 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ee0530-0727-4bf7-a8ee-c664dd372a73 admin admin] PATH_INFO: `/v3/projects/b3b11af4073e4f1e94b980b887df8717` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:40.368021 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ee0530-0727-4bf7-a8ee-c664dd372a73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3b11af4073e4f1e94b980b887df8717)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:30:40.369975 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ee0530-0727-4bf7-a8ee-c664dd372a73 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:30:40.416058 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-c9ee0530-0727-4bf7-a8ee-c664dd372a73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3b11af4073e4f1e94b980b887df8717', 'request_id': 'req-c9ee0530-0727-4bf7-a8ee-c664dd372a73'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:40.422140 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-c9ee0530-0727-4bf7-a8ee-c664dd372a73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3b11af4073e4f1e94b980b887df8717', 'request_id': 'req-c9ee0530-0727-4bf7-a8ee-c664dd372a73'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:40.430620 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-c9ee0530-0727-4bf7-a8ee-c664dd372a73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3b11af4073e4f1e94b980b887df8717', 'request_id': 'req-c9ee0530-0727-4bf7-a8ee-c664dd372a73'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:40.441663 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-c9ee0530-0727-4bf7-a8ee-c664dd372a73 admin admin] The token cache is being invalidate because project b3b11af4073e4f1e94b980b887df8717 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:30:40.441957 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-c9ee0530-0727-4bf7-a8ee-c664dd372a73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:40.442590 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-c9ee0530-0727-4bf7-a8ee-c664dd372a73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:30:40.444158 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1286/2567] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:30:40 2021] DELETE /identity/v3/projects/b3b11af4073e4f1e94b980b887df8717 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:30:49.558318 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ccf04-91e5-4a2d-8b8b-4dd505d4b9c5 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:30:49.560036 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-756ccf04-91e5-4a2d-8b8b-4dd505d4b9c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:30:49.642510 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ccf04-91e5-4a2d-8b8b-4dd505d4b9c5 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:30:49.721200 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0dfdec-9459-42da-ba88-8fdb210b71d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:30:49.721856 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0dfdec-9459-42da-ba88-8fdb210b71d8 service nova] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:30:49.722141 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0dfdec-9459-42da-ba88-8fdb210b71d8 service nova] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:30:49.722413 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0dfdec-9459-42da-ba88-8fdb210b71d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:30:49.726044 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-4b0dfdec-9459-42da-ba88-8fdb210b71d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:30:49.808116 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0dfdec-9459-42da-ba88-8fdb210b71d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:30:49.809739 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0dfdec-9459-42da-ba88-8fdb210b71d8 service nova] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:30:49.829114 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1282/2568] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:30:49 2021] GET /identity/v3/auth/tokens => generated 3256 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:31:27.688919 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a2792-6c97-43c7-96b4-9e518c13b0f3 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:31:27.689493 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a2792-6c97-43c7-96b4-9e518c13b0f3 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:31:27.689596 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a2792-6c97-43c7-96b4-9e518c13b0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:31:27.708465 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-cc5a2792-6c97-43c7-96b4-9e518c13b0f3 None None] MFA Rules not processed for user `19d72c913c2b4442836a991120eec243`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:31:27.709677 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-cc5a2792-6c97-43c7-96b4-9e518c13b0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:31:27.766922 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1287/2569] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Nov 29 20:31:27 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:31:27.789366 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0dfdec-9459-42da-ba88-8fdb210b71d8 service nova] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:31:27.790978 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-4b0dfdec-9459-42da-ba88-8fdb210b71d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:31:27.860374 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0dfdec-9459-42da-ba88-8fdb210b71d8 service nova] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:31:27.865620 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542410fe-be8d-4518-995c-ffe56357d4f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51fc6fd9b37447bba1759a702b86ce6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:31:27.866275 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542410fe-be8d-4518-995c-ffe56357d4f1 service swift] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:31:27.866554 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542410fe-be8d-4518-995c-ffe56357d4f1 service swift] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:31:27.866830 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542410fe-be8d-4518-995c-ffe56357d4f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:31:27.875114 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542410fe-be8d-4518-995c-ffe56357d4f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:31:27.876740 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542410fe-be8d-4518-995c-ffe56357d4f1 service swift] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:31:27.884761 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1283/2570] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Nov 29 20:31:27 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:31:41.829935 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a2792-6c97-43c7-96b4-9e518c13b0f3 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:31:41.832924 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-cc5a2792-6c97-43c7-96b4-9e518c13b0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:31:41.892695 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a2792-6c97-43c7-96b4-9e518c13b0f3 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:31:41.897667 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adc14f-eda8-4130-902f-b5b53d6d53c5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcc415af1f5a42febbdbd187e066cf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:31:41.898333 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adc14f-eda8-4130-902f-b5b53d6d53c5 service glance] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:31:41.898614 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adc14f-eda8-4130-902f-b5b53d6d53c5 service glance] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:31:41.898925 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adc14f-eda8-4130-902f-b5b53d6d53c5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:31:41.900823 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-29adc14f-eda8-4130-902f-b5b53d6d53c5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:31:41.915519 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29adc14f-eda8-4130-902f-b5b53d6d53c5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:31:41.916978 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29adc14f-eda8-4130-902f-b5b53d6d53c5 service glance] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:31:41.928273 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1288/2571] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:31:41 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:31:41.997926 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542410fe-be8d-4518-995c-ffe56357d4f1 service swift] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:31:42.003385 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-542410fe-be8d-4518-995c-ffe56357d4f1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:31:42.057854 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542410fe-be8d-4518-995c-ffe56357d4f1 service swift] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:31:42.061528 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2f2a2-5b60-4651-b758-ac9abfd1cf21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:31:42.062167 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2f2a2-5b60-4651-b758-ac9abfd1cf21 service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:31:42.062440 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2f2a2-5b60-4651-b758-ac9abfd1cf21 service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:31:42.062711 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2f2a2-5b60-4651-b758-ac9abfd1cf21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:31:42.064612 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-c9a2f2a2-5b60-4651-b758-ac9abfd1cf21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:31:42.074808 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2f2a2-5b60-4651-b758-ac9abfd1cf21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:31:42.076419 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2f2a2-5b60-4651-b758-ac9abfd1cf21 service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:31:42.085280 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1284/2572] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:31:41 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:31:42.897227 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adc14f-eda8-4130-902f-b5b53d6d53c5 service glance] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:31:42.907146 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adc14f-eda8-4130-902f-b5b53d6d53c5 service glance] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:31:42.911715 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a4523-835c-4e11-b485-dc2e8c77a7ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:31:42.912373 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a4523-835c-4e11-b485-dc2e8c77a7ca service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:31:42.912655 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a4523-835c-4e11-b485-dc2e8c77a7ca service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:31:42.912925 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a4523-835c-4e11-b485-dc2e8c77a7ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:31:42.915117 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-b17a4523-835c-4e11-b485-dc2e8c77a7ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:31:42.925106 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17a4523-835c-4e11-b485-dc2e8c77a7ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:31:42.926499 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17a4523-835c-4e11-b485-dc2e8c77a7ca service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:31:42.934466 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1289/2573] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:31:42 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:31:43.744342 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f9dd8-5609-404a-a8d4-1d83b86aeb0f None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:31:43.744763 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f9dd8-5609-404a-a8d4-1d83b86aeb0f None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:31:43.744871 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f9dd8-5609-404a-a8d4-1d83b86aeb0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:31:43.762876 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-1f1f9dd8-5609-404a-a8d4-1d83b86aeb0f None None] MFA Rules not processed for user `19d72c913c2b4442836a991120eec243`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:31:43.764068 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-1f1f9dd8-5609-404a-a8d4-1d83b86aeb0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:31:43.771803 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1285/2574] 10.222.0.15 () {58 vars in 1009 bytes} [Mon Nov 29 20:31:43 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:31:43.784529 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a4523-835c-4e11-b485-dc2e8c77a7ca service neutron] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:31:43.797378 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a4523-835c-4e11-b485-dc2e8c77a7ca service neutron] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:31:43.803745 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b962366-56f6-4cd4-9897-dacb68041e6b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51fc6fd9b37447bba1759a702b86ce6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:31:43.804652 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b962366-56f6-4cd4-9897-dacb68041e6b service swift] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:31:43.804933 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b962366-56f6-4cd4-9897-dacb68041e6b service swift] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:31:43.805222 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b962366-56f6-4cd4-9897-dacb68041e6b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:31:43.814635 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b962366-56f6-4cd4-9897-dacb68041e6b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:31:43.816313 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b962366-56f6-4cd4-9897-dacb68041e6b service swift] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:31:43.824744 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1290/2575] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Nov 29 20:31:43 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Nov 29 20:32:00.495419 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3284eff-fe58-461c-b322-98516bcf5ddb None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:00.495955 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3284eff-fe58-461c-b322-98516bcf5ddb None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:00.496106 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3284eff-fe58-461c-b322-98516bcf5ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:00.515394 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-f3284eff-fe58-461c-b322-98516bcf5ddb None None] MFA Rules not processed for user `19d72c913c2b4442836a991120eec243`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:32:00.516789 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-f3284eff-fe58-461c-b322-98516bcf5ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:32:00.524486 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1286/2576] 10.222.0.15 () {58 vars in 967 bytes} [Mon Nov 29 20:32:00 2021] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:32:00.537532 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b962366-56f6-4cd4-9897-dacb68041e6b service swift] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:00.548200 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b962366-56f6-4cd4-9897-dacb68041e6b service swift] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:00.553463 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98441ea-23a4-48cf-9bba-ed6cc9854f0a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51fc6fd9b37447bba1759a702b86ce6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:00.554091 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98441ea-23a4-48cf-9bba-ed6cc9854f0a service swift] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:00.554369 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98441ea-23a4-48cf-9bba-ed6cc9854f0a service swift] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:00.554640 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98441ea-23a4-48cf-9bba-ed6cc9854f0a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:00.563933 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98441ea-23a4-48cf-9bba-ed6cc9854f0a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:00.565525 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98441ea-23a4-48cf-9bba-ed6cc9854f0a service swift] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:00.574273 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1291/2577] 10.222.0.15 () {60 vars in 1384 bytes} [Mon Nov 29 20:32:00 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Nov 29 20:32:33.264027 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3284eff-fe58-461c-b322-98516bcf5ddb None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:33.265622 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-f3284eff-fe58-461c-b322-98516bcf5ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:32:33.282880 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3284eff-fe58-461c-b322-98516bcf5ddb None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:33.290833 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1858b9-16ee-4b9c-a0e4-ddfe92da37ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:33.291284 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1858b9-16ee-4b9c-a0e4-ddfe92da37ed service nova] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:33.291602 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1858b9-16ee-4b9c-a0e4-ddfe92da37ed service nova] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:33.291956 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1858b9-16ee-4b9c-a0e4-ddfe92da37ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:33.295341 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-1b1858b9-16ee-4b9c-a0e4-ddfe92da37ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:32:33.310716 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1858b9-16ee-4b9c-a0e4-ddfe92da37ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:33.312485 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1858b9-16ee-4b9c-a0e4-ddfe92da37ed service nova] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:33.331670 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1287/2578] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:32:33 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:32:37.527334 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98441ea-23a4-48cf-9bba-ed6cc9854f0a service swift] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:37.540449 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98441ea-23a4-48cf-9bba-ed6cc9854f0a service swift] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:37.545809 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2997a05-ac67-4ab3-b3dd-42083403fdc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:37.546805 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2997a05-ac67-4ab3-b3dd-42083403fdc0 service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:37.547113 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2997a05-ac67-4ab3-b3dd-42083403fdc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:37.547384 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2997a05-ac67-4ab3-b3dd-42083403fdc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:37.549365 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-a2997a05-ac67-4ab3-b3dd-42083403fdc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:32:37.620499 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2997a05-ac67-4ab3-b3dd-42083403fdc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:37.621946 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2997a05-ac67-4ab3-b3dd-42083403fdc0 service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:37.631858 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1292/2579] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:32:37 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:32:40.891548 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1858b9-16ee-4b9c-a0e4-ddfe92da37ed service nova] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:40.892862 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-1b1858b9-16ee-4b9c-a0e4-ddfe92da37ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:32:40.907309 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1858b9-16ee-4b9c-a0e4-ddfe92da37ed service nova] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:40.912074 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b239e74d-010f-4f5e-8f84-48d2ad6634d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:40.912959 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239e74d-010f-4f5e-8f84-48d2ad6634d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:40.913240 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239e74d-010f-4f5e-8f84-48d2ad6634d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:40.913515 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b239e74d-010f-4f5e-8f84-48d2ad6634d8 admin admin] PATH_INFO: `/v3/users/0746d603781d4b3796959e8217112cc5` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:40.914700 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239e74d-010f-4f5e-8f84-48d2ad6634d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0746d603781d4b3796959e8217112cc5)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:40.916671 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b239e74d-010f-4f5e-8f84-48d2ad6634d8 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:40.962178 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-b239e74d-010f-4f5e-8f84-48d2ad6634d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0746d603781d4b3796959e8217112cc5'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:40.968818 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-b239e74d-010f-4f5e-8f84-48d2ad6634d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0746d603781d4b3796959e8217112cc5'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:40.980568 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-b239e74d-010f-4f5e-8f84-48d2ad6634d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0746d603781d4b3796959e8217112cc5'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:40.981238 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-b239e74d-010f-4f5e-8f84-48d2ad6634d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0746d603781d4b3796959e8217112cc5'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:40.981835 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-b239e74d-010f-4f5e-8f84-48d2ad6634d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0746d603781d4b3796959e8217112cc5'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:40.995272 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1288/2580] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:32:40 2021] DELETE /identity/v3/users/0746d603781d4b3796959e8217112cc5 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:32:41.172581 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2997a05-ac67-4ab3-b3dd-42083403fdc0 service neutron] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:41.184358 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2997a05-ac67-4ab3-b3dd-42083403fdc0 service neutron] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:41.241524 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c685013f-c781-4b06-b808-c73cbb0f321b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:41.242391 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685013f-c781-4b06-b808-c73cbb0f321b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:41.242670 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685013f-c781-4b06-b808-c73cbb0f321b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:41.242980 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685013f-c781-4b06-b808-c73cbb0f321b admin admin] PATH_INFO: `/v3/projects/bec7a65a88e44bdf93195a0f3ebce687` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:41.244196 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c685013f-c781-4b06-b808-c73cbb0f321b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bec7a65a88e44bdf93195a0f3ebce687)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:41.246104 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c685013f-c781-4b06-b808-c73cbb0f321b admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:41.292965 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-c685013f-c781-4b06-b808-c73cbb0f321b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bec7a65a88e44bdf93195a0f3ebce687', 'request_id': 'req-c685013f-c781-4b06-b808-c73cbb0f321b'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:41.299364 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-c685013f-c781-4b06-b808-c73cbb0f321b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bec7a65a88e44bdf93195a0f3ebce687', 'request_id': 'req-c685013f-c781-4b06-b808-c73cbb0f321b'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:41.308698 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-c685013f-c781-4b06-b808-c73cbb0f321b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bec7a65a88e44bdf93195a0f3ebce687', 'request_id': 'req-c685013f-c781-4b06-b808-c73cbb0f321b'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:41.319267 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-c685013f-c781-4b06-b808-c73cbb0f321b admin admin] The token cache is being invalidate because project bec7a65a88e44bdf93195a0f3ebce687 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:32:41.319551 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-c685013f-c781-4b06-b808-c73cbb0f321b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:41.320200 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-c685013f-c781-4b06-b808-c73cbb0f321b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:41.321777 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1293/2581] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:32:41 2021] DELETE /identity/v3/projects/bec7a65a88e44bdf93195a0f3ebce687 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:32:41.327713 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5290f3e-c4d6-4dc6-b76d-b776c05898cc None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:41.328041 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5290f3e-c4d6-4dc6-b76d-b776c05898cc None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:41.328319 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5290f3e-c4d6-4dc6-b76d-b776c05898cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:41.347001 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-b5290f3e-c4d6-4dc6-b76d-b776c05898cc None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:32:41.348145 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-b5290f3e-c4d6-4dc6-b76d-b776c05898cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:32:41.410728 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1289/2582] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:32:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:32:41.418940 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa39a56-a3c1-453b-9c04-2d4b79a94585 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:41.419241 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa39a56-a3c1-453b-9c04-2d4b79a94585 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:41.419504 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa39a56-a3c1-453b-9c04-2d4b79a94585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:41.439169 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-3aa39a56-a3c1-453b-9c04-2d4b79a94585 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:32:41.440401 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-3aa39a56-a3c1-453b-9c04-2d4b79a94585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:32:41.449967 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1294/2583] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:32:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:32:41.455168 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5290f3e-c4d6-4dc6-b76d-b776c05898cc None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:41.470781 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5290f3e-c4d6-4dc6-b76d-b776c05898cc None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:41.479934 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa6d690-5e0c-43d9-bb68-e33392a5eec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:41.480884 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6d690-5e0c-43d9-bb68-e33392a5eec8 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:41.481136 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6d690-5e0c-43d9-bb68-e33392a5eec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:41.481539 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6d690-5e0c-43d9-bb68-e33392a5eec8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:41.482645 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa6d690-5e0c-43d9-bb68-e33392a5eec8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:32:41.483135 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa6d690-5e0c-43d9-bb68-e33392a5eec8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:41.485137 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa6d690-5e0c-43d9-bb68-e33392a5eec8 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:41.497122 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1290/2584] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:32:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:32:41.501446 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa39a56-a3c1-453b-9c04-2d4b79a94585 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:41.510809 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa39a56-a3c1-453b-9c04-2d4b79a94585 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:41.516589 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53ed25-43bd-4f5f-a2dd-95575b5a97f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:41.517237 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53ed25-43bd-4f5f-a2dd-95575b5a97f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:41.517511 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53ed25-43bd-4f5f-a2dd-95575b5a97f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:41.517775 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53ed25-43bd-4f5f-a2dd-95575b5a97f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:41.518507 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53ed25-43bd-4f5f-a2dd-95575b5a97f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:41.520417 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53ed25-43bd-4f5f-a2dd-95575b5a97f2 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:41.551127 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1295/2585] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:32:41 2021] POST /identity/v3/projects => generated 405 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:32:41.555288 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa6d690-5e0c-43d9-bb68-e33392a5eec8 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:41.565495 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa6d690-5e0c-43d9-bb68-e33392a5eec8 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:41.624069 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00636aea-a9f2-4d3b-bf04-39b0041c2952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:41.624800 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00636aea-a9f2-4d3b-bf04-39b0041c2952 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:41.625065 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00636aea-a9f2-4d3b-bf04-39b0041c2952 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:41.625337 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00636aea-a9f2-4d3b-bf04-39b0041c2952 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:41.626038 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00636aea-a9f2-4d3b-bf04-39b0041c2952 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:41.627975 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00636aea-a9f2-4d3b-bf04-39b0041c2952 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:41.653684 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1291/2586] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:32:41 2021] POST /identity/v3/users => generated 303 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:32:41.657956 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53ed25-43bd-4f5f-a2dd-95575b5a97f2 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:41.668188 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53ed25-43bd-4f5f-a2dd-95575b5a97f2 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:41.672979 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e2442-aa57-40ba-a85c-1d3af75b8c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:41.673632 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e2442-aa57-40ba-a85c-1d3af75b8c7b admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:41.673918 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e2442-aa57-40ba-a85c-1d3af75b8c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:41.674190 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e2442-aa57-40ba-a85c-1d3af75b8c7b admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:41.674958 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e2442-aa57-40ba-a85c-1d3af75b8c7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:41.676548 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e2442-aa57-40ba-a85c-1d3af75b8c7b admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:41.686734 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1296/2587] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:32:41 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:32:41.690742 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00636aea-a9f2-4d3b-bf04-39b0041c2952 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:41.700978 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00636aea-a9f2-4d3b-bf04-39b0041c2952 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:41.706998 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86adda26-cae1-44ad-902c-993d846fecc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:41.707661 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adda26-cae1-44ad-902c-993d846fecc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:41.707935 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adda26-cae1-44ad-902c-993d846fecc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:41.708197 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adda26-cae1-44ad-902c-993d846fecc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:41.708924 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86adda26-cae1-44ad-902c-993d846fecc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:41.710494 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86adda26-cae1-44ad-902c-993d846fecc3 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:41.720640 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1292/2588] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:32:41 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:32:41.724734 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e2442-aa57-40ba-a85c-1d3af75b8c7b admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:41.735101 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e2442-aa57-40ba-a85c-1d3af75b8c7b admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:41.741064 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75b693-c65f-4f97-8b9b-633b3ae9c1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:41.741943 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75b693-c65f-4f97-8b9b-633b3ae9c1da admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:41.742223 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75b693-c65f-4f97-8b9b-633b3ae9c1da admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:41.742492 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75b693-c65f-4f97-8b9b-633b3ae9c1da admin admin] PATH_INFO: `/v3/projects/662156507e7d4e6babddfa0a58e3de28/users/12710135b05a42bdb690dba38fa718ac/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:41.758206 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e75b693-c65f-4f97-8b9b-633b3ae9c1da admin admin] RBAC: Authorizing `identity:create_grant(project_id=662156507e7d4e6babddfa0a58e3de28, user_id=12710135b05a42bdb690dba38fa718ac, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:41.760890 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e75b693-c65f-4f97-8b9b-633b3ae9c1da admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:41.777634 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1297/2589] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:32:41 2021] PUT /identity/v3/projects/662156507e7d4e6babddfa0a58e3de28/users/12710135b05a42bdb690dba38fa718ac/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:32:41.782820 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddb31b-e0e1-48ec-8db5-93229bfc5595 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:41.783132 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddb31b-e0e1-48ec-8db5-93229bfc5595 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:41.783402 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddb31b-e0e1-48ec-8db5-93229bfc5595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:41.801978 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-f3ddb31b-e0e1-48ec-8db5-93229bfc5595 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:32:41.803233 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-f3ddb31b-e0e1-48ec-8db5-93229bfc5595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:32:41.868206 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1293/2590] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:32:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:32:41.879641 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75b693-c65f-4f97-8b9b-633b3ae9c1da admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:41.881481 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-6e75b693-c65f-4f97-8b9b-633b3ae9c1da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:32:41.941697 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75b693-c65f-4f97-8b9b-633b3ae9c1da admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:41.946043 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd69cd-a284-4cad-8e80-019c96000aae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:41.946680 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd69cd-a284-4cad-8e80-019c96000aae service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:41.947014 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd69cd-a284-4cad-8e80-019c96000aae service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:41.947294 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd69cd-a284-4cad-8e80-019c96000aae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:41.956882 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dd69cd-a284-4cad-8e80-019c96000aae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:41.958309 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dd69cd-a284-4cad-8e80-019c96000aae service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:41.967897 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1298/2591] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:32:41 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:32:42.562422 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03044c-55ec-4714-ac82-335436099b8e None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:42.562999 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03044c-55ec-4714-ac82-335436099b8e None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:42.563151 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e03044c-55ec-4714-ac82-335436099b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:42.589947 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-6e03044c-55ec-4714-ac82-335436099b8e None None] MFA Rules not processed for user `12710135b05a42bdb690dba38fa718ac`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:32:42.591245 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-6e03044c-55ec-4714-ac82-335436099b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:32:42.654509 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1294/2592] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:32:42 2021] POST /identity/v3/auth/tokens => generated 3272 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:32:42.659416 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd69cd-a284-4cad-8e80-019c96000aae service neutron] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:42.671751 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd69cd-a284-4cad-8e80-019c96000aae service neutron] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:42.677026 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e8aaf-537e-46d9-b549-d564cbc4242f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:42.677892 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e8aaf-537e-46d9-b549-d564cbc4242f admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:42.678273 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e8aaf-537e-46d9-b549-d564cbc4242f admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:42.678652 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e8aaf-537e-46d9-b549-d564cbc4242f admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:42.679502 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e8aaf-537e-46d9-b549-d564cbc4242f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:42.681708 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e8aaf-537e-46d9-b549-d564cbc4242f admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:42.712740 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1299/2593] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:32:42 2021] POST /identity/v3/projects => generated 403 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:32:42.713913 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03044c-55ec-4714-ac82-335436099b8e None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:42.724841 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e03044c-55ec-4714-ac82-335436099b8e None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:42.781692 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012d0a6-e4d6-467b-81f6-ec39e11c0e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:42.782390 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012d0a6-e4d6-467b-81f6-ec39e11c0e3c admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:42.782655 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012d0a6-e4d6-467b-81f6-ec39e11c0e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:42.783105 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012d0a6-e4d6-467b-81f6-ec39e11c0e3c admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:42.783867 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2012d0a6-e4d6-467b-81f6-ec39e11c0e3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:42.786019 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2012d0a6-e4d6-467b-81f6-ec39e11c0e3c admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:42.809282 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1295/2594] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:32:42 2021] POST /identity/v3/users => generated 308 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:32:42.814833 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e8aaf-537e-46d9-b549-d564cbc4242f admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:42.825666 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e8aaf-537e-46d9-b549-d564cbc4242f admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:42.834574 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb05ee-da30-412e-aac4-4d4ab0afd7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:42.835367 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb05ee-da30-412e-aac4-4d4ab0afd7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:42.835671 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb05ee-da30-412e-aac4-4d4ab0afd7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:42.835950 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb05ee-da30-412e-aac4-4d4ab0afd7f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:42.836737 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb05ee-da30-412e-aac4-4d4ab0afd7f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:42.838386 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb05ee-da30-412e-aac4-4d4ab0afd7f4 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:42.853070 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1300/2595] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:32:42 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:32:42.854290 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012d0a6-e4d6-467b-81f6-ec39e11c0e3c admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:42.864425 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012d0a6-e4d6-467b-81f6-ec39e11c0e3c admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:42.869840 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e61c7-78e6-4589-a9fc-0792a44b5e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:42.870718 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e61c7-78e6-4589-a9fc-0792a44b5e5a admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:42.871027 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e61c7-78e6-4589-a9fc-0792a44b5e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:42.871319 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e61c7-78e6-4589-a9fc-0792a44b5e5a admin admin] PATH_INFO: `/v3/projects/d509bca8a86e4ae49004964ec9cc681b/users/381e6de84e5147d085f57691391b0df3/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:42.887444 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e61c7-78e6-4589-a9fc-0792a44b5e5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d509bca8a86e4ae49004964ec9cc681b, user_id=381e6de84e5147d085f57691391b0df3, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:42.890273 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7e61c7-78e6-4589-a9fc-0792a44b5e5a admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:42.904442 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1296/2596] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:32:42 2021] PUT /identity/v3/projects/d509bca8a86e4ae49004964ec9cc681b/users/381e6de84e5147d085f57691391b0df3/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:32:42.908582 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb05ee-da30-412e-aac4-4d4ab0afd7f4 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:42.918323 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb05ee-da30-412e-aac4-4d4ab0afd7f4 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:42.970381 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796657f-db3e-4322-8883-29e038ccab3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:42.971082 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796657f-db3e-4322-8883-29e038ccab3d admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:42.971364 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796657f-db3e-4322-8883-29e038ccab3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:42.971644 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796657f-db3e-4322-8883-29e038ccab3d admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:42.972376 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796657f-db3e-4322-8883-29e038ccab3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:42.973963 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796657f-db3e-4322-8883-29e038ccab3d admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:42.983434 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1301/2597] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:32:42 2021] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:32:42.988562 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e61c7-78e6-4589-a9fc-0792a44b5e5a admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:43.005651 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7e61c7-78e6-4589-a9fc-0792a44b5e5a admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:43.014270 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47daf224-65d4-4799-be16-38f1ab19cedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:43.015563 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47daf224-65d4-4799-be16-38f1ab19cedd admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:43.015844 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47daf224-65d4-4799-be16-38f1ab19cedd admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:43.016124 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47daf224-65d4-4799-be16-38f1ab19cedd admin admin] PATH_INFO: `/v3/projects/d509bca8a86e4ae49004964ec9cc681b/users/381e6de84e5147d085f57691391b0df3/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:43.018290 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47daf224-65d4-4799-be16-38f1ab19cedd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d509bca8a86e4ae49004964ec9cc681b, user_id=381e6de84e5147d085f57691391b0df3, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:43.020990 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47daf224-65d4-4799-be16-38f1ab19cedd admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:43.031983 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1297/2598] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:32:42 2021] PUT /identity/v3/projects/d509bca8a86e4ae49004964ec9cc681b/users/381e6de84e5147d085f57691391b0df3/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:32:43.635909 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837185b-bdbd-44c2-9efe-1cd001b3bb45 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:43.636242 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837185b-bdbd-44c2-9efe-1cd001b3bb45 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:43.636467 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837185b-bdbd-44c2-9efe-1cd001b3bb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:43.665897 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-8837185b-bdbd-44c2-9efe-1cd001b3bb45 None None] MFA Rules not processed for user `381e6de84e5147d085f57691391b0df3`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:32:43.667052 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-8837185b-bdbd-44c2-9efe-1cd001b3bb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:32:43.748103 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1302/2599] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:32:43 2021] POST /identity/v3/auth/tokens => generated 3337 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:32:44.761266 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47daf224-65d4-4799-be16-38f1ab19cedd admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:44.827697 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47daf224-65d4-4799-be16-38f1ab19cedd admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:44.830079 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520da053-def6-499e-acee-aa43d076d310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:44.830992 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520da053-def6-499e-acee-aa43d076d310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:44.831271 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520da053-def6-499e-acee-aa43d076d310 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:44.831549 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520da053-def6-499e-acee-aa43d076d310 admin admin] PATH_INFO: `/v3/users/12710135b05a42bdb690dba38fa718ac` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:44.832745 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520da053-def6-499e-acee-aa43d076d310 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12710135b05a42bdb690dba38fa718ac)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:44.834713 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520da053-def6-499e-acee-aa43d076d310 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:44.882579 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-520da053-def6-499e-acee-aa43d076d310 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12710135b05a42bdb690dba38fa718ac'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:44.889159 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-520da053-def6-499e-acee-aa43d076d310 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12710135b05a42bdb690dba38fa718ac'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:44.900588 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-520da053-def6-499e-acee-aa43d076d310 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12710135b05a42bdb690dba38fa718ac'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:44.901252 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-520da053-def6-499e-acee-aa43d076d310 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12710135b05a42bdb690dba38fa718ac'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:44.901843 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-520da053-def6-499e-acee-aa43d076d310 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12710135b05a42bdb690dba38fa718ac'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:44.916741 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1298/2600] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:32:44 2021] DELETE /identity/v3/users/12710135b05a42bdb690dba38fa718ac => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:32:45.098779 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8837185b-bdbd-44c2-9efe-1cd001b3bb45 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:45.109759 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8837185b-bdbd-44c2-9efe-1cd001b3bb45 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:45.166382 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649cf2f3-6cf2-44c3-9c7c-04fdf84a3a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:45.167286 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649cf2f3-6cf2-44c3-9c7c-04fdf84a3a66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:45.167593 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649cf2f3-6cf2-44c3-9c7c-04fdf84a3a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:45.167885 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649cf2f3-6cf2-44c3-9c7c-04fdf84a3a66 admin admin] PATH_INFO: `/v3/projects/662156507e7d4e6babddfa0a58e3de28` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:45.169165 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649cf2f3-6cf2-44c3-9c7c-04fdf84a3a66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=662156507e7d4e6babddfa0a58e3de28)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:45.171218 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649cf2f3-6cf2-44c3-9c7c-04fdf84a3a66 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:45.217863 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-649cf2f3-6cf2-44c3-9c7c-04fdf84a3a66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '662156507e7d4e6babddfa0a58e3de28', 'request_id': 'req-649cf2f3-6cf2-44c3-9c7c-04fdf84a3a66'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:45.224047 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-649cf2f3-6cf2-44c3-9c7c-04fdf84a3a66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '662156507e7d4e6babddfa0a58e3de28', 'request_id': 'req-649cf2f3-6cf2-44c3-9c7c-04fdf84a3a66'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:45.235217 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-649cf2f3-6cf2-44c3-9c7c-04fdf84a3a66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '662156507e7d4e6babddfa0a58e3de28', 'request_id': 'req-649cf2f3-6cf2-44c3-9c7c-04fdf84a3a66'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:45.245842 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-649cf2f3-6cf2-44c3-9c7c-04fdf84a3a66 admin admin] The token cache is being invalidate because project 662156507e7d4e6babddfa0a58e3de28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:32:45.246129 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-649cf2f3-6cf2-44c3-9c7c-04fdf84a3a66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:45.246746 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-649cf2f3-6cf2-44c3-9c7c-04fdf84a3a66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:45.248357 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1303/2601] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:32:45 2021] DELETE /identity/v3/projects/662156507e7d4e6babddfa0a58e3de28 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:32:45.252580 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520da053-def6-499e-acee-aa43d076d310 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:45.254154 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-520da053-def6-499e-acee-aa43d076d310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:32:45.267379 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520da053-def6-499e-acee-aa43d076d310 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:45.325143 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32df1a64-cdde-4a3e-b8a1-0224b0e49461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:45.325934 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df1a64-cdde-4a3e-b8a1-0224b0e49461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:45.326210 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df1a64-cdde-4a3e-b8a1-0224b0e49461 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:45.326483 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32df1a64-cdde-4a3e-b8a1-0224b0e49461 admin admin] PATH_INFO: `/v3/users/381e6de84e5147d085f57691391b0df3` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:45.327849 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df1a64-cdde-4a3e-b8a1-0224b0e49461 admin admin] RBAC: Authorizing `identity:delete_user(user_id=381e6de84e5147d085f57691391b0df3)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:45.329772 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32df1a64-cdde-4a3e-b8a1-0224b0e49461 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:45.378145 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-32df1a64-cdde-4a3e-b8a1-0224b0e49461 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '381e6de84e5147d085f57691391b0df3'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:45.384778 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-32df1a64-cdde-4a3e-b8a1-0224b0e49461 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '381e6de84e5147d085f57691391b0df3'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:45.396433 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-32df1a64-cdde-4a3e-b8a1-0224b0e49461 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '381e6de84e5147d085f57691391b0df3'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:45.397473 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-32df1a64-cdde-4a3e-b8a1-0224b0e49461 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '381e6de84e5147d085f57691391b0df3'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:45.398113 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-32df1a64-cdde-4a3e-b8a1-0224b0e49461 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '381e6de84e5147d085f57691391b0df3'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:45.412720 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1299/2602] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:32:45 2021] DELETE /identity/v3/users/381e6de84e5147d085f57691391b0df3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:32:45.596993 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649cf2f3-6cf2-44c3-9c7c-04fdf84a3a66 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:45.598575 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-649cf2f3-6cf2-44c3-9c7c-04fdf84a3a66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:32:45.612028 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649cf2f3-6cf2-44c3-9c7c-04fdf84a3a66 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:45.675466 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1afe6f-f050-4652-ab80-00225132513b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:45.676590 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1afe6f-f050-4652-ab80-00225132513b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:45.676879 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1afe6f-f050-4652-ab80-00225132513b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:45.677152 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1afe6f-f050-4652-ab80-00225132513b admin admin] PATH_INFO: `/v3/projects/d509bca8a86e4ae49004964ec9cc681b` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:45.678458 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1afe6f-f050-4652-ab80-00225132513b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d509bca8a86e4ae49004964ec9cc681b)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:45.680404 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1afe6f-f050-4652-ab80-00225132513b admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:45.727373 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ad1afe6f-f050-4652-ab80-00225132513b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd509bca8a86e4ae49004964ec9cc681b', 'request_id': 'req-ad1afe6f-f050-4652-ab80-00225132513b'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:45.733250 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ad1afe6f-f050-4652-ab80-00225132513b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd509bca8a86e4ae49004964ec9cc681b', 'request_id': 'req-ad1afe6f-f050-4652-ab80-00225132513b'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:45.742415 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ad1afe6f-f050-4652-ab80-00225132513b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd509bca8a86e4ae49004964ec9cc681b', 'request_id': 'req-ad1afe6f-f050-4652-ab80-00225132513b'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:45.752364 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ad1afe6f-f050-4652-ab80-00225132513b admin admin] The token cache is being invalidate because project d509bca8a86e4ae49004964ec9cc681b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:32:45.752629 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ad1afe6f-f050-4652-ab80-00225132513b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:45.753232 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ad1afe6f-f050-4652-ab80-00225132513b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:45.754747 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1304/2603] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:32:45 2021] DELETE /identity/v3/projects/d509bca8a86e4ae49004964ec9cc681b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:32:45.761954 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97de4c0-1cc7-444c-9843-5829843205c7 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:45.762473 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97de4c0-1cc7-444c-9843-5829843205c7 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:45.762579 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97de4c0-1cc7-444c-9843-5829843205c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:45.781442 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-f97de4c0-1cc7-444c-9843-5829843205c7 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:32:45.782752 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-f97de4c0-1cc7-444c-9843-5829843205c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:32:45.842740 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1300/2604] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:32:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:32:45.850679 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9cd28d-947d-46a6-9f51-d8ea0cb91319 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:45.851000 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9cd28d-947d-46a6-9f51-d8ea0cb91319 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:45.851276 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9cd28d-947d-46a6-9f51-d8ea0cb91319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:45.869910 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-0d9cd28d-947d-46a6-9f51-d8ea0cb91319 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:32:45.871139 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-0d9cd28d-947d-46a6-9f51-d8ea0cb91319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:32:45.880186 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1305/2605] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:32:45 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:32:45.884507 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97de4c0-1cc7-444c-9843-5829843205c7 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:45.894784 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97de4c0-1cc7-444c-9843-5829843205c7 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:45.901054 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e0ff4-5ed8-47d1-a5e4-a041ba71cbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:45.901709 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e0ff4-5ed8-47d1-a5e4-a041ba71cbf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:45.901993 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e0ff4-5ed8-47d1-a5e4-a041ba71cbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:45.902266 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e0ff4-5ed8-47d1-a5e4-a041ba71cbf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:45.903038 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e0ff4-5ed8-47d1-a5e4-a041ba71cbf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:32:45.903347 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e0ff4-5ed8-47d1-a5e4-a041ba71cbf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:45.905130 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e0ff4-5ed8-47d1-a5e4-a041ba71cbf5 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:45.916817 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1301/2606] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:32:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:32:45.921343 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9cd28d-947d-46a6-9f51-d8ea0cb91319 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:45.930901 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9cd28d-947d-46a6-9f51-d8ea0cb91319 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:45.937296 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89dab5-db56-4080-8c47-4bd054540ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:45.937977 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89dab5-db56-4080-8c47-4bd054540ae4 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:45.938258 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89dab5-db56-4080-8c47-4bd054540ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:45.938533 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89dab5-db56-4080-8c47-4bd054540ae4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:45.939278 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89dab5-db56-4080-8c47-4bd054540ae4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:45.941183 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89dab5-db56-4080-8c47-4bd054540ae4 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:45.972008 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1306/2607] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:32:45 2021] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:32:45.976363 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e0ff4-5ed8-47d1-a5e4-a041ba71cbf5 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:45.986766 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e0ff4-5ed8-47d1-a5e4-a041ba71cbf5 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:46.046374 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869570e-00a6-4580-8262-4b3fad79ca03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:46.047266 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869570e-00a6-4580-8262-4b3fad79ca03 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:46.047549 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869570e-00a6-4580-8262-4b3fad79ca03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:46.047824 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5869570e-00a6-4580-8262-4b3fad79ca03 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:46.048532 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5869570e-00a6-4580-8262-4b3fad79ca03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:46.050479 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5869570e-00a6-4580-8262-4b3fad79ca03 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:46.074438 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1302/2608] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:32:45 2021] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:32:46.080716 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89dab5-db56-4080-8c47-4bd054540ae4 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:46.096094 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89dab5-db56-4080-8c47-4bd054540ae4 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:46.101541 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39a473-ff72-40c4-9ab0-e0a45f2e530c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:46.102205 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39a473-ff72-40c4-9ab0-e0a45f2e530c admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:46.102486 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39a473-ff72-40c4-9ab0-e0a45f2e530c admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:46.102775 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39a473-ff72-40c4-9ab0-e0a45f2e530c admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:46.103557 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a39a473-ff72-40c4-9ab0-e0a45f2e530c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:46.105157 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a39a473-ff72-40c4-9ab0-e0a45f2e530c admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:46.115811 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1307/2609] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:32:46 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:32:46.119954 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869570e-00a6-4580-8262-4b3fad79ca03 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:46.130258 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5869570e-00a6-4580-8262-4b3fad79ca03 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:46.135746 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76790dd2-5635-43e6-9356-19599b748b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:46.136411 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76790dd2-5635-43e6-9356-19599b748b4f admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:46.136694 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76790dd2-5635-43e6-9356-19599b748b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:46.136971 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76790dd2-5635-43e6-9356-19599b748b4f admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:46.137708 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76790dd2-5635-43e6-9356-19599b748b4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:46.139387 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76790dd2-5635-43e6-9356-19599b748b4f admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:46.150094 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1303/2610] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:32:46 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 29 20:32:46.154122 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39a473-ff72-40c4-9ab0-e0a45f2e530c admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:46.164185 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39a473-ff72-40c4-9ab0-e0a45f2e530c admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:46.169129 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f00be8-ab62-425c-aaea-cb82ac335e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:46.170004 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f00be8-ab62-425c-aaea-cb82ac335e9b admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:46.170282 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f00be8-ab62-425c-aaea-cb82ac335e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:46.170561 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f00be8-ab62-425c-aaea-cb82ac335e9b admin admin] PATH_INFO: `/v3/projects/f68d4cc71e214f5dbe7a5126e7aa8441/users/58839c767faf473bbd5c8f709c6f4b9d/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:46.185281 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f00be8-ab62-425c-aaea-cb82ac335e9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f68d4cc71e214f5dbe7a5126e7aa8441, user_id=58839c767faf473bbd5c8f709c6f4b9d, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:46.188034 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f00be8-ab62-425c-aaea-cb82ac335e9b admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:46.203903 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1308/2611] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:32:46 2021] PUT /identity/v3/projects/f68d4cc71e214f5dbe7a5126e7aa8441/users/58839c767faf473bbd5c8f709c6f4b9d/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:32:46.214356 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0026e0-084c-4ad6-bbe6-6f268ad39590 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:46.214631 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0026e0-084c-4ad6-bbe6-6f268ad39590 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:46.214938 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0026e0-084c-4ad6-bbe6-6f268ad39590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:46.243101 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-5c0026e0-084c-4ad6-bbe6-6f268ad39590 None None] MFA Rules not processed for user `58839c767faf473bbd5c8f709c6f4b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:32:46.244324 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-5c0026e0-084c-4ad6-bbe6-6f268ad39590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:32:46.309137 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1304/2612] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:32:46 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:32:46.313926 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f00be8-ab62-425c-aaea-cb82ac335e9b admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:46.381288 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f00be8-ab62-425c-aaea-cb82ac335e9b admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:46.387219 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece2dc0-8b48-4f12-8aa7-212047ecd83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:46.387883 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece2dc0-8b48-4f12-8aa7-212047ecd83c admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:46.388164 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece2dc0-8b48-4f12-8aa7-212047ecd83c admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:46.388432 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ece2dc0-8b48-4f12-8aa7-212047ecd83c admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:46.389129 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece2dc0-8b48-4f12-8aa7-212047ecd83c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:46.391083 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ece2dc0-8b48-4f12-8aa7-212047ecd83c admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:46.420060 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1309/2613] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:32:46 2021] POST /identity/v3/projects => generated 387 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:32:46.424924 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0026e0-084c-4ad6-bbe6-6f268ad39590 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:46.436450 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0026e0-084c-4ad6-bbe6-6f268ad39590 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:46.492040 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ed3a5-cbba-4c3d-b95c-23cac179b704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:46.492704 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ed3a5-cbba-4c3d-b95c-23cac179b704 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:46.492978 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ed3a5-cbba-4c3d-b95c-23cac179b704 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:46.493252 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ed3a5-cbba-4c3d-b95c-23cac179b704 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:46.493952 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ed3a5-cbba-4c3d-b95c-23cac179b704 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:46.495897 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ed3a5-cbba-4c3d-b95c-23cac179b704 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:46.520184 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1305/2614] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:32:46 2021] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:32:46.524645 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece2dc0-8b48-4f12-8aa7-212047ecd83c admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:46.535035 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ece2dc0-8b48-4f12-8aa7-212047ecd83c admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:46.539895 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fda95a-3de5-42dc-ad4f-67bb3e346f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:46.540554 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fda95a-3de5-42dc-ad4f-67bb3e346f5e admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:46.540834 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fda95a-3de5-42dc-ad4f-67bb3e346f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:46.541112 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fda95a-3de5-42dc-ad4f-67bb3e346f5e admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:46.541853 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fda95a-3de5-42dc-ad4f-67bb3e346f5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:46.543483 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fda95a-3de5-42dc-ad4f-67bb3e346f5e admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:46.554939 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1310/2615] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:32:46 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:32:46.559157 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ed3a5-cbba-4c3d-b95c-23cac179b704 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:46.569259 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ed3a5-cbba-4c3d-b95c-23cac179b704 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:46.574678 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e99fa-38b5-48a9-965c-a5e123abfb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:46.575602 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e99fa-38b5-48a9-965c-a5e123abfb6b admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:46.575881 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e99fa-38b5-48a9-965c-a5e123abfb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:46.576162 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e99fa-38b5-48a9-965c-a5e123abfb6b admin admin] PATH_INFO: `/v3/projects/495c5e03cd964e878ff0c35c13f7d6b5/users/db0c3448c3cb43b3a2c639089da26018/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:46.594356 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e99fa-38b5-48a9-965c-a5e123abfb6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=495c5e03cd964e878ff0c35c13f7d6b5, user_id=db0c3448c3cb43b3a2c639089da26018, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:46.598477 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e99fa-38b5-48a9-965c-a5e123abfb6b admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:46.616660 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1306/2616] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:32:46 2021] PUT /identity/v3/projects/495c5e03cd964e878ff0c35c13f7d6b5/users/db0c3448c3cb43b3a2c639089da26018/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:32:46.622520 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fda95a-3de5-42dc-ad4f-67bb3e346f5e admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:46.637879 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fda95a-3de5-42dc-ad4f-67bb3e346f5e admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:46.699240 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9153f4e6-448f-4258-aac7-98d92fe2fd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:46.699915 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153f4e6-448f-4258-aac7-98d92fe2fd8d admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:46.700216 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153f4e6-448f-4258-aac7-98d92fe2fd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:46.700488 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153f4e6-448f-4258-aac7-98d92fe2fd8d admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:46.701209 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9153f4e6-448f-4258-aac7-98d92fe2fd8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:46.702912 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9153f4e6-448f-4258-aac7-98d92fe2fd8d admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:46.713215 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1311/2617] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:32:46 2021] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:32:46.717693 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e99fa-38b5-48a9-965c-a5e123abfb6b admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:46.728555 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e99fa-38b5-48a9-965c-a5e123abfb6b admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:46.733802 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ea3ec-4ea6-4f74-8756-c0d3d001458b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:46.734736 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ea3ec-4ea6-4f74-8756-c0d3d001458b admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:46.735055 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ea3ec-4ea6-4f74-8756-c0d3d001458b admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:46.735331 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ea3ec-4ea6-4f74-8756-c0d3d001458b admin admin] PATH_INFO: `/v3/projects/495c5e03cd964e878ff0c35c13f7d6b5/users/db0c3448c3cb43b3a2c639089da26018/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:46.737300 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ea3ec-4ea6-4f74-8756-c0d3d001458b admin admin] RBAC: Authorizing `identity:create_grant(project_id=495c5e03cd964e878ff0c35c13f7d6b5, user_id=db0c3448c3cb43b3a2c639089da26018, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:46.740033 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ea3ec-4ea6-4f74-8756-c0d3d001458b admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:46.750783 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1307/2618] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:32:46 2021] PUT /identity/v3/projects/495c5e03cd964e878ff0c35c13f7d6b5/users/db0c3448c3cb43b3a2c639089da26018/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:32:46.762149 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d99e79-bc8a-4488-8c88-727a69320a84 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:46.762436 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d99e79-bc8a-4488-8c88-727a69320a84 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:46.762716 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d99e79-bc8a-4488-8c88-727a69320a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:46.792677 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-49d99e79-bc8a-4488-8c88-727a69320a84 None None] MFA Rules not processed for user `db0c3448c3cb43b3a2c639089da26018`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:32:46.793910 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-49d99e79-bc8a-4488-8c88-727a69320a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:32:46.866079 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1312/2619] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:32:46 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:32:46.884165 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ea3ec-4ea6-4f74-8756-c0d3d001458b admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:46.886218 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-701ea3ec-4ea6-4f74-8756-c0d3d001458b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:32:46.948220 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ea3ec-4ea6-4f74-8756-c0d3d001458b admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:46.952787 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97062a-b3fa-4773-988d-92e1773834c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:46.953443 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97062a-b3fa-4773-988d-92e1773834c5 service cinder] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:46.953727 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97062a-b3fa-4773-988d-92e1773834c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:46.954003 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97062a-b3fa-4773-988d-92e1773834c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:46.964809 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac97062a-b3fa-4773-988d-92e1773834c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:46.966263 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac97062a-b3fa-4773-988d-92e1773834c5 service cinder] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:46.976176 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1308/2620] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:32:46 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:32:47.038770 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d99e79-bc8a-4488-8c88-727a69320a84 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:47.104261 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d99e79-bc8a-4488-8c88-727a69320a84 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:47.109945 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2811b69-6b48-454f-bef4-d570242e7c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:47.110891 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2811b69-6b48-454f-bef4-d570242e7c58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:47.111174 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2811b69-6b48-454f-bef4-d570242e7c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:47.111454 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2811b69-6b48-454f-bef4-d570242e7c58 admin admin] PATH_INFO: `/v3/users/58839c767faf473bbd5c8f709c6f4b9d` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:47.112823 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2811b69-6b48-454f-bef4-d570242e7c58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58839c767faf473bbd5c8f709c6f4b9d)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:47.114792 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2811b69-6b48-454f-bef4-d570242e7c58 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:47.170811 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-d2811b69-6b48-454f-bef4-d570242e7c58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58839c767faf473bbd5c8f709c6f4b9d'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:47.178194 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-d2811b69-6b48-454f-bef4-d570242e7c58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58839c767faf473bbd5c8f709c6f4b9d'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:47.188531 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-d2811b69-6b48-454f-bef4-d570242e7c58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58839c767faf473bbd5c8f709c6f4b9d'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:47.200623 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-d2811b69-6b48-454f-bef4-d570242e7c58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58839c767faf473bbd5c8f709c6f4b9d'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:47.201215 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-d2811b69-6b48-454f-bef4-d570242e7c58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58839c767faf473bbd5c8f709c6f4b9d'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:47.207201 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1313/2621] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:32:47 2021] DELETE /identity/v3/users/58839c767faf473bbd5c8f709c6f4b9d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:32:47.212152 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cb710-d4c1-4f00-90c8-c8783c83805b None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:47.212440 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cb710-d4c1-4f00-90c8-c8783c83805b None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:47.212720 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cb710-d4c1-4f00-90c8-c8783c83805b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:47.231774 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-248cb710-d4c1-4f00-90c8-c8783c83805b None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:32:47.233052 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-248cb710-d4c1-4f00-90c8-c8783c83805b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:32:47.300353 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1309/2622] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:32:47 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:32:47.310315 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2811b69-6b48-454f-bef4-d570242e7c58 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:47.311884 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-d2811b69-6b48-454f-bef4-d570242e7c58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:32:47.369080 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2811b69-6b48-454f-bef4-d570242e7c58 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:47.373426 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabf73b-49aa-4f5e-a59e-d6e09d724484 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:47.374077 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabf73b-49aa-4f5e-a59e-d6e09d724484 service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:47.374355 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabf73b-49aa-4f5e-a59e-d6e09d724484 service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:47.374626 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabf73b-49aa-4f5e-a59e-d6e09d724484 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:47.385016 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eabf73b-49aa-4f5e-a59e-d6e09d724484 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:47.386484 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eabf73b-49aa-4f5e-a59e-d6e09d724484 service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:47.396356 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1314/2623] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:32:47 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:32:47.675774 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248cb710-d4c1-4f00-90c8-c8783c83805b None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:47.677279 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-248cb710-d4c1-4f00-90c8-c8783c83805b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:32:47.700452 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248cb710-d4c1-4f00-90c8-c8783c83805b None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:47.708576 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47573716-0e1c-4859-ac88-b268e5525899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:47.709457 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47573716-0e1c-4859-ac88-b268e5525899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:47.709730 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47573716-0e1c-4859-ac88-b268e5525899 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:47.710004 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47573716-0e1c-4859-ac88-b268e5525899 admin admin] PATH_INFO: `/v3/projects/f68d4cc71e214f5dbe7a5126e7aa8441` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:47.711346 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47573716-0e1c-4859-ac88-b268e5525899 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f68d4cc71e214f5dbe7a5126e7aa8441)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:47.713280 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47573716-0e1c-4859-ac88-b268e5525899 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:47.770162 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-47573716-0e1c-4859-ac88-b268e5525899 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f68d4cc71e214f5dbe7a5126e7aa8441', 'request_id': 'req-47573716-0e1c-4859-ac88-b268e5525899'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:47.776550 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-47573716-0e1c-4859-ac88-b268e5525899 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f68d4cc71e214f5dbe7a5126e7aa8441', 'request_id': 'req-47573716-0e1c-4859-ac88-b268e5525899'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:47.782095 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-47573716-0e1c-4859-ac88-b268e5525899 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f68d4cc71e214f5dbe7a5126e7aa8441', 'request_id': 'req-47573716-0e1c-4859-ac88-b268e5525899'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:47.794521 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-47573716-0e1c-4859-ac88-b268e5525899 admin admin] The token cache is being invalidate because project f68d4cc71e214f5dbe7a5126e7aa8441 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:32:47.794811 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-47573716-0e1c-4859-ac88-b268e5525899 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:47.795468 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-47573716-0e1c-4859-ac88-b268e5525899 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:47.797013 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1310/2624] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:32:47 2021] DELETE /identity/v3/projects/f68d4cc71e214f5dbe7a5126e7aa8441 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:32:47.801152 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabf73b-49aa-4f5e-a59e-d6e09d724484 service neutron] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:47.810948 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabf73b-49aa-4f5e-a59e-d6e09d724484 service neutron] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:47.870660 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd05667-f07c-4efe-a15d-def9c5db68f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:47.872064 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd05667-f07c-4efe-a15d-def9c5db68f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:47.872476 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd05667-f07c-4efe-a15d-def9c5db68f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:47.872836 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd05667-f07c-4efe-a15d-def9c5db68f0 admin admin] PATH_INFO: `/v3/users/db0c3448c3cb43b3a2c639089da26018` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:47.874689 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd05667-f07c-4efe-a15d-def9c5db68f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db0c3448c3cb43b3a2c639089da26018)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:47.876774 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd05667-f07c-4efe-a15d-def9c5db68f0 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:47.926295 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ffd05667-f07c-4efe-a15d-def9c5db68f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db0c3448c3cb43b3a2c639089da26018'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:47.932696 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ffd05667-f07c-4efe-a15d-def9c5db68f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db0c3448c3cb43b3a2c639089da26018'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:47.942263 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ffd05667-f07c-4efe-a15d-def9c5db68f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db0c3448c3cb43b3a2c639089da26018'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:47.954445 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ffd05667-f07c-4efe-a15d-def9c5db68f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db0c3448c3cb43b3a2c639089da26018'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:47.955143 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ffd05667-f07c-4efe-a15d-def9c5db68f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db0c3448c3cb43b3a2c639089da26018'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:47.961065 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1315/2625] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:32:47 2021] DELETE /identity/v3/users/db0c3448c3cb43b3a2c639089da26018 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:32:48.226953 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47573716-0e1c-4859-ac88-b268e5525899 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:48.228573 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-47573716-0e1c-4859-ac88-b268e5525899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:32:48.241691 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47573716-0e1c-4859-ac88-b268e5525899 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:48.298620 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9918a-b2dc-4078-8708-14224e7841d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:48.299504 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9918a-b2dc-4078-8708-14224e7841d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:48.299780 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9918a-b2dc-4078-8708-14224e7841d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:48.300045 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9918a-b2dc-4078-8708-14224e7841d9 admin admin] PATH_INFO: `/v3/projects/495c5e03cd964e878ff0c35c13f7d6b5` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:48.301310 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9918a-b2dc-4078-8708-14224e7841d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=495c5e03cd964e878ff0c35c13f7d6b5)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:48.303243 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9918a-b2dc-4078-8708-14224e7841d9 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:48.353128 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-44f9918a-b2dc-4078-8708-14224e7841d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '495c5e03cd964e878ff0c35c13f7d6b5', 'request_id': 'req-44f9918a-b2dc-4078-8708-14224e7841d9'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:48.359694 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-44f9918a-b2dc-4078-8708-14224e7841d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '495c5e03cd964e878ff0c35c13f7d6b5', 'request_id': 'req-44f9918a-b2dc-4078-8708-14224e7841d9'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:48.365308 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-44f9918a-b2dc-4078-8708-14224e7841d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '495c5e03cd964e878ff0c35c13f7d6b5', 'request_id': 'req-44f9918a-b2dc-4078-8708-14224e7841d9'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:48.380980 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-44f9918a-b2dc-4078-8708-14224e7841d9 admin admin] The token cache is being invalidate because project 495c5e03cd964e878ff0c35c13f7d6b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:32:48.381282 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-44f9918a-b2dc-4078-8708-14224e7841d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:48.381944 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-44f9918a-b2dc-4078-8708-14224e7841d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:48.384105 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1311/2626] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:32:48 2021] DELETE /identity/v3/projects/495c5e03cd964e878ff0c35c13f7d6b5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:32:48.389774 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198c3fa-84c9-4573-896e-e4230c82b863 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:48.390285 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198c3fa-84c9-4573-896e-e4230c82b863 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:48.390285 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198c3fa-84c9-4573-896e-e4230c82b863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:48.409107 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-1198c3fa-84c9-4573-896e-e4230c82b863 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:32:48.410292 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-1198c3fa-84c9-4573-896e-e4230c82b863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:32:48.466672 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1316/2627] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:32:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:32:48.475680 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a55fa3-7f5b-4216-8c79-1b4ffe52b2b6 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:48.476095 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a55fa3-7f5b-4216-8c79-1b4ffe52b2b6 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:48.476571 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a55fa3-7f5b-4216-8c79-1b4ffe52b2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:48.504331 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-87a55fa3-7f5b-4216-8c79-1b4ffe52b2b6 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:32:48.505555 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-87a55fa3-7f5b-4216-8c79-1b4ffe52b2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:32:48.515100 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1312/2628] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:32:48 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:32:48.519349 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198c3fa-84c9-4573-896e-e4230c82b863 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:48.529462 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198c3fa-84c9-4573-896e-e4230c82b863 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:48.534495 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52af42-cb86-45bf-9be8-9eb32795a9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:48.535163 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52af42-cb86-45bf-9be8-9eb32795a9cd admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:48.535440 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52af42-cb86-45bf-9be8-9eb32795a9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:48.535712 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52af42-cb86-45bf-9be8-9eb32795a9cd admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:48.536451 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc52af42-cb86-45bf-9be8-9eb32795a9cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:32:48.536758 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc52af42-cb86-45bf-9be8-9eb32795a9cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:48.538371 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc52af42-cb86-45bf-9be8-9eb32795a9cd admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:48.549856 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1317/2629] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:32:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:32:48.554047 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a55fa3-7f5b-4216-8c79-1b4ffe52b2b6 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:48.563453 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a55fa3-7f5b-4216-8c79-1b4ffe52b2b6 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:48.568594 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a3623-bdc9-4e00-9e9f-e59801d9fca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:48.569242 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a3623-bdc9-4e00-9e9f-e59801d9fca9 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:48.569525 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a3623-bdc9-4e00-9e9f-e59801d9fca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:48.569801 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a3623-bdc9-4e00-9e9f-e59801d9fca9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:48.570507 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a3623-bdc9-4e00-9e9f-e59801d9fca9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:48.572454 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a3623-bdc9-4e00-9e9f-e59801d9fca9 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:48.600301 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1313/2630] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:32:48 2021] POST /identity/v3/projects => generated 393 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 29 20:32:48.604587 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52af42-cb86-45bf-9be8-9eb32795a9cd admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:48.615589 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52af42-cb86-45bf-9be8-9eb32795a9cd admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:48.687158 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8acc3-0ca8-4c38-9b3f-b192055cd529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:48.687829 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8acc3-0ca8-4c38-9b3f-b192055cd529 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:48.688116 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8acc3-0ca8-4c38-9b3f-b192055cd529 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:48.688385 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8acc3-0ca8-4c38-9b3f-b192055cd529 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:48.689120 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8acc3-0ca8-4c38-9b3f-b192055cd529 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:48.691126 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8acc3-0ca8-4c38-9b3f-b192055cd529 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:48.721098 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1318/2631] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:32:48 2021] POST /identity/v3/users => generated 297 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:32:48.725710 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a3623-bdc9-4e00-9e9f-e59801d9fca9 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:48.739945 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a3623-bdc9-4e00-9e9f-e59801d9fca9 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:48.745464 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b399f-1f72-4567-b345-503cdff233ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:48.746133 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b399f-1f72-4567-b345-503cdff233ca admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:48.746417 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b399f-1f72-4567-b345-503cdff233ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:48.746697 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b399f-1f72-4567-b345-503cdff233ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:48.747470 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b399f-1f72-4567-b345-503cdff233ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:48.749072 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b399f-1f72-4567-b345-503cdff233ca admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:48.760544 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1314/2632] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:32:48 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:32:48.764661 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8acc3-0ca8-4c38-9b3f-b192055cd529 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:48.775579 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8acc3-0ca8-4c38-9b3f-b192055cd529 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:48.781090 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5efcb5b-2b95-4e29-8731-ea6a886b9992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:48.781727 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efcb5b-2b95-4e29-8731-ea6a886b9992 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:48.782009 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efcb5b-2b95-4e29-8731-ea6a886b9992 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:48.782283 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efcb5b-2b95-4e29-8731-ea6a886b9992 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:48.783065 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5efcb5b-2b95-4e29-8731-ea6a886b9992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:48.784698 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5efcb5b-2b95-4e29-8731-ea6a886b9992 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:48.797595 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1319/2633] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:32:48 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:32:48.802523 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b399f-1f72-4567-b345-503cdff233ca admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:48.814888 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b399f-1f72-4567-b345-503cdff233ca admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:48.823580 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c78e1-4c93-494d-8395-44f0d7d35f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:48.824696 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c78e1-4c93-494d-8395-44f0d7d35f36 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:48.824957 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c78e1-4c93-494d-8395-44f0d7d35f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:48.825235 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c78e1-4c93-494d-8395-44f0d7d35f36 admin admin] PATH_INFO: `/v3/projects/909eba5299c1446abe54e50f5622dac6/users/38af71e3d9024738b677609f772c4ca4/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:48.841144 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c78e1-4c93-494d-8395-44f0d7d35f36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=909eba5299c1446abe54e50f5622dac6, user_id=38af71e3d9024738b677609f772c4ca4, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:48.843891 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c78e1-4c93-494d-8395-44f0d7d35f36 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:48.860955 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1315/2634] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:32:48 2021] PUT /identity/v3/projects/909eba5299c1446abe54e50f5622dac6/users/38af71e3d9024738b677609f772c4ca4/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:32:48.871413 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89e964-33c4-4f1b-978c-3b251f9074b0 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:48.871703 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89e964-33c4-4f1b-978c-3b251f9074b0 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:48.872005 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89e964-33c4-4f1b-978c-3b251f9074b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:48.899949 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-dd89e964-33c4-4f1b-978c-3b251f9074b0 None None] MFA Rules not processed for user `38af71e3d9024738b677609f772c4ca4`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:32:48.901175 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-dd89e964-33c4-4f1b-978c-3b251f9074b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:32:48.969155 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1320/2635] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:32:48 2021] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:32:48.973687 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c78e1-4c93-494d-8395-44f0d7d35f36 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:49.033436 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c78e1-4c93-494d-8395-44f0d7d35f36 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:49.038570 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f55fea-5eac-4cd1-8a96-1a36b9edb014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:49.039371 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f55fea-5eac-4cd1-8a96-1a36b9edb014 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:49.039650 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f55fea-5eac-4cd1-8a96-1a36b9edb014 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:49.039921 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f55fea-5eac-4cd1-8a96-1a36b9edb014 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:49.040606 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f55fea-5eac-4cd1-8a96-1a36b9edb014 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:49.042492 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f55fea-5eac-4cd1-8a96-1a36b9edb014 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:49.071070 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1316/2636] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:32:48 2021] POST /identity/v3/projects => generated 393 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:32:49.075374 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd89e964-33c4-4f1b-978c-3b251f9074b0 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:49.086173 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd89e964-33c4-4f1b-978c-3b251f9074b0 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:49.143051 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763419c8-d4a4-4629-b8f6-df3586ca02f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:49.143640 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763419c8-d4a4-4629-b8f6-df3586ca02f7 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:49.143924 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763419c8-d4a4-4629-b8f6-df3586ca02f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:49.144200 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763419c8-d4a4-4629-b8f6-df3586ca02f7 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:49.144879 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763419c8-d4a4-4629-b8f6-df3586ca02f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:49.146784 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763419c8-d4a4-4629-b8f6-df3586ca02f7 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:49.169450 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1321/2637] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:32:49 2021] POST /identity/v3/users => generated 303 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:32:49.173630 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f55fea-5eac-4cd1-8a96-1a36b9edb014 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:49.184771 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f55fea-5eac-4cd1-8a96-1a36b9edb014 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:49.190587 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e6c60-ffb0-4a0a-a29d-f704dc91a9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:49.191283 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e6c60-ffb0-4a0a-a29d-f704dc91a9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:49.191559 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e6c60-ffb0-4a0a-a29d-f704dc91a9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:49.191828 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e6c60-ffb0-4a0a-a29d-f704dc91a9f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:49.192582 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961e6c60-ffb0-4a0a-a29d-f704dc91a9f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:49.194163 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961e6c60-ffb0-4a0a-a29d-f704dc91a9f9 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:49.204621 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1317/2638] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:32:49 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:32:49.208829 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763419c8-d4a4-4629-b8f6-df3586ca02f7 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:49.219433 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763419c8-d4a4-4629-b8f6-df3586ca02f7 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:49.225432 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2d98f-e7e1-43fb-b9f7-f2e26914a5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:49.226312 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2d98f-e7e1-43fb-b9f7-f2e26914a5ea admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:49.226590 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2d98f-e7e1-43fb-b9f7-f2e26914a5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:49.226901 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2d98f-e7e1-43fb-b9f7-f2e26914a5ea admin admin] PATH_INFO: `/v3/projects/20e884a1fe994662befda0d920a7c355/users/60bca5f6a6ea490eadaef7f334e54e4e/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:49.242651 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2d98f-e7e1-43fb-b9f7-f2e26914a5ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=20e884a1fe994662befda0d920a7c355, user_id=60bca5f6a6ea490eadaef7f334e54e4e, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:49.245394 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2d98f-e7e1-43fb-b9f7-f2e26914a5ea admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:49.261930 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1322/2639] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:32:49 2021] PUT /identity/v3/projects/20e884a1fe994662befda0d920a7c355/users/60bca5f6a6ea490eadaef7f334e54e4e/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:32:49.265986 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e6c60-ffb0-4a0a-a29d-f704dc91a9f9 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:49.276534 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e6c60-ffb0-4a0a-a29d-f704dc91a9f9 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:49.334963 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4cae7f-8d94-47aa-9b54-84205695e1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:49.335619 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4cae7f-8d94-47aa-9b54-84205695e1ab admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:49.335898 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4cae7f-8d94-47aa-9b54-84205695e1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:49.336171 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4cae7f-8d94-47aa-9b54-84205695e1ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:49.336902 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4cae7f-8d94-47aa-9b54-84205695e1ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:49.338486 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4cae7f-8d94-47aa-9b54-84205695e1ab admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:49.348458 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1318/2640] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:32:49 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:32:49.352794 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2d98f-e7e1-43fb-b9f7-f2e26914a5ea admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:49.363581 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2d98f-e7e1-43fb-b9f7-f2e26914a5ea admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:49.369188 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183abe40-50b1-4cf9-8aa8-44992eecffcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:49.370080 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183abe40-50b1-4cf9-8aa8-44992eecffcd admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:49.370361 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183abe40-50b1-4cf9-8aa8-44992eecffcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:49.370641 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183abe40-50b1-4cf9-8aa8-44992eecffcd admin admin] PATH_INFO: `/v3/projects/20e884a1fe994662befda0d920a7c355/users/60bca5f6a6ea490eadaef7f334e54e4e/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:49.372947 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183abe40-50b1-4cf9-8aa8-44992eecffcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=20e884a1fe994662befda0d920a7c355, user_id=60bca5f6a6ea490eadaef7f334e54e4e, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:49.375637 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183abe40-50b1-4cf9-8aa8-44992eecffcd admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:49.386368 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1323/2641] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:32:49 2021] PUT /identity/v3/projects/20e884a1fe994662befda0d920a7c355/users/60bca5f6a6ea490eadaef7f334e54e4e/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:32:49.398595 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aad6e4-34cc-4ab9-a02b-cb5a34ba2c42 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:49.398829 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aad6e4-34cc-4ab9-a02b-cb5a34ba2c42 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:49.399131 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aad6e4-34cc-4ab9-a02b-cb5a34ba2c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:49.425268 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-79aad6e4-34cc-4ab9-a02b-cb5a34ba2c42 None None] MFA Rules not processed for user `60bca5f6a6ea490eadaef7f334e54e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:32:49.426480 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-79aad6e4-34cc-4ab9-a02b-cb5a34ba2c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:32:49.492897 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1319/2642] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:32:49 2021] POST /identity/v3/auth/tokens => generated 3327 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:32:49.503149 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183abe40-50b1-4cf9-8aa8-44992eecffcd admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:49.505104 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-183abe40-50b1-4cf9-8aa8-44992eecffcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:32:49.561849 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183abe40-50b1-4cf9-8aa8-44992eecffcd admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:49.566171 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab5288b-f980-4bc7-b01b-1b34a33c4b50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:49.566799 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5288b-f980-4bc7-b01b-1b34a33c4b50 service cinder] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:49.567131 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5288b-f980-4bc7-b01b-1b34a33c4b50 service cinder] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:49.567406 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5288b-f980-4bc7-b01b-1b34a33c4b50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:49.576939 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab5288b-f980-4bc7-b01b-1b34a33c4b50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:49.578365 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab5288b-f980-4bc7-b01b-1b34a33c4b50 service cinder] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:49.587765 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1324/2643] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:32:49 2021] GET /identity/v3/auth/tokens => generated 3327 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:32:49.630577 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aad6e4-34cc-4ab9-a02b-cb5a34ba2c42 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:49.632105 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-79aad6e4-34cc-4ab9-a02b-cb5a34ba2c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:32:49.644356 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aad6e4-34cc-4ab9-a02b-cb5a34ba2c42 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:49.648740 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e5b28-1000-4e7c-84d2-5fc2dbff4903 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:49.649307 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e5b28-1000-4e7c-84d2-5fc2dbff4903 service cinder] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:49.649585 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e5b28-1000-4e7c-84d2-5fc2dbff4903 service cinder] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:49.649870 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e5b28-1000-4e7c-84d2-5fc2dbff4903 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:49.707231 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e5b28-1000-4e7c-84d2-5fc2dbff4903 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:49.708654 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e5b28-1000-4e7c-84d2-5fc2dbff4903 service cinder] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:49.717260 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1320/2644] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:32:49 2021] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:32:52.987568 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab5288b-f980-4bc7-b01b-1b34a33c4b50 service cinder] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:53.052283 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab5288b-f980-4bc7-b01b-1b34a33c4b50 service cinder] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:53.057258 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc12b3-d778-481d-8013-d19d9a0efa1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:53.058116 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc12b3-d778-481d-8013-d19d9a0efa1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:53.058390 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc12b3-d778-481d-8013-d19d9a0efa1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:53.058671 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc12b3-d778-481d-8013-d19d9a0efa1b admin admin] PATH_INFO: `/v3/users/38af71e3d9024738b677609f772c4ca4` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:53.059911 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffc12b3-d778-481d-8013-d19d9a0efa1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=38af71e3d9024738b677609f772c4ca4)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:53.061809 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffc12b3-d778-481d-8013-d19d9a0efa1b admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:53.112285 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-7ffc12b3-d778-481d-8013-d19d9a0efa1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38af71e3d9024738b677609f772c4ca4'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:53.118927 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-7ffc12b3-d778-481d-8013-d19d9a0efa1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38af71e3d9024738b677609f772c4ca4'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:53.128246 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-7ffc12b3-d778-481d-8013-d19d9a0efa1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38af71e3d9024738b677609f772c4ca4'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:53.140865 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-7ffc12b3-d778-481d-8013-d19d9a0efa1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38af71e3d9024738b677609f772c4ca4'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:53.141550 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-7ffc12b3-d778-481d-8013-d19d9a0efa1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38af71e3d9024738b677609f772c4ca4'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:53.147813 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1325/2645] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:32:52 2021] DELETE /identity/v3/users/38af71e3d9024738b677609f772c4ca4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:32:53.152466 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c308372-552f-485b-baa6-ea2e20dbae68 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:53.152963 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c308372-552f-485b-baa6-ea2e20dbae68 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:53.152963 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c308372-552f-485b-baa6-ea2e20dbae68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:53.171283 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-8c308372-552f-485b-baa6-ea2e20dbae68 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:32:53.172496 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-8c308372-552f-485b-baa6-ea2e20dbae68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:32:53.232658 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1321/2646] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:32:53 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:32:53.243071 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc12b3-d778-481d-8013-d19d9a0efa1b admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:53.244638 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-7ffc12b3-d778-481d-8013-d19d9a0efa1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:32:53.308890 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc12b3-d778-481d-8013-d19d9a0efa1b admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:53.316084 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26239c9e-e91a-406f-a663-145a552f5dc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:53.317030 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26239c9e-e91a-406f-a663-145a552f5dc3 service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:53.317418 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26239c9e-e91a-406f-a663-145a552f5dc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:53.317750 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26239c9e-e91a-406f-a663-145a552f5dc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:53.331727 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26239c9e-e91a-406f-a663-145a552f5dc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:53.333152 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26239c9e-e91a-406f-a663-145a552f5dc3 service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:53.342583 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1326/2647] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:32:53 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:32:53.845727 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c308372-552f-485b-baa6-ea2e20dbae68 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:53.847285 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-8c308372-552f-485b-baa6-ea2e20dbae68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:32:53.860164 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c308372-552f-485b-baa6-ea2e20dbae68 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:53.865277 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32668ee-15cb-48f7-8f79-956397e0a65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:53.866158 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32668ee-15cb-48f7-8f79-956397e0a65e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:53.866431 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32668ee-15cb-48f7-8f79-956397e0a65e admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:53.866702 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32668ee-15cb-48f7-8f79-956397e0a65e admin admin] PATH_INFO: `/v3/projects/909eba5299c1446abe54e50f5622dac6` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:53.868021 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32668ee-15cb-48f7-8f79-956397e0a65e admin admin] RBAC: Authorizing `identity:delete_project(project_id=909eba5299c1446abe54e50f5622dac6)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:53.869923 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32668ee-15cb-48f7-8f79-956397e0a65e admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:53.923395 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-f32668ee-15cb-48f7-8f79-956397e0a65e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '909eba5299c1446abe54e50f5622dac6', 'request_id': 'req-f32668ee-15cb-48f7-8f79-956397e0a65e'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:53.930402 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-f32668ee-15cb-48f7-8f79-956397e0a65e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '909eba5299c1446abe54e50f5622dac6', 'request_id': 'req-f32668ee-15cb-48f7-8f79-956397e0a65e'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:53.936914 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-f32668ee-15cb-48f7-8f79-956397e0a65e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '909eba5299c1446abe54e50f5622dac6', 'request_id': 'req-f32668ee-15cb-48f7-8f79-956397e0a65e'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:53.952454 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-f32668ee-15cb-48f7-8f79-956397e0a65e admin admin] The token cache is being invalidate because project 909eba5299c1446abe54e50f5622dac6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:32:53.952740 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-f32668ee-15cb-48f7-8f79-956397e0a65e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:53.953405 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-f32668ee-15cb-48f7-8f79-956397e0a65e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:53.955044 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1322/2648] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:32:53 2021] DELETE /identity/v3/projects/909eba5299c1446abe54e50f5622dac6 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:32:53.959332 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26239c9e-e91a-406f-a663-145a552f5dc3 service neutron] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:53.969632 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26239c9e-e91a-406f-a663-145a552f5dc3 service neutron] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:54.035427 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312d1db-c223-4475-950e-30bd2ea748f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:54.036341 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312d1db-c223-4475-950e-30bd2ea748f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:54.036629 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312d1db-c223-4475-950e-30bd2ea748f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:54.036907 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312d1db-c223-4475-950e-30bd2ea748f2 admin admin] PATH_INFO: `/v3/users/60bca5f6a6ea490eadaef7f334e54e4e` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:54.038148 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e312d1db-c223-4475-950e-30bd2ea748f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60bca5f6a6ea490eadaef7f334e54e4e)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:54.040116 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e312d1db-c223-4475-950e-30bd2ea748f2 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:54.092359 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-e312d1db-c223-4475-950e-30bd2ea748f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60bca5f6a6ea490eadaef7f334e54e4e'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:54.098970 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-e312d1db-c223-4475-950e-30bd2ea748f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60bca5f6a6ea490eadaef7f334e54e4e'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:54.113275 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-e312d1db-c223-4475-950e-30bd2ea748f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60bca5f6a6ea490eadaef7f334e54e4e'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:54.129278 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-e312d1db-c223-4475-950e-30bd2ea748f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60bca5f6a6ea490eadaef7f334e54e4e'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:54.130020 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-e312d1db-c223-4475-950e-30bd2ea748f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60bca5f6a6ea490eadaef7f334e54e4e'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:54.136178 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1327/2649] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:32:53 2021] DELETE /identity/v3/users/60bca5f6a6ea490eadaef7f334e54e4e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:32:54.425137 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32668ee-15cb-48f7-8f79-956397e0a65e admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:54.426745 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-f32668ee-15cb-48f7-8f79-956397e0a65e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:32:54.441839 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32668ee-15cb-48f7-8f79-956397e0a65e admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:54.497966 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e54998-c860-4290-afa0-678a13b8cf17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:54.498877 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e54998-c860-4290-afa0-678a13b8cf17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:54.499169 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e54998-c860-4290-afa0-678a13b8cf17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:54.499448 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e54998-c860-4290-afa0-678a13b8cf17 admin admin] PATH_INFO: `/v3/projects/20e884a1fe994662befda0d920a7c355` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:54.500824 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e54998-c860-4290-afa0-678a13b8cf17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20e884a1fe994662befda0d920a7c355)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:54.502786 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e54998-c860-4290-afa0-678a13b8cf17 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:54.551774 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-13e54998-c860-4290-afa0-678a13b8cf17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20e884a1fe994662befda0d920a7c355', 'request_id': 'req-13e54998-c860-4290-afa0-678a13b8cf17'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:54.557709 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-13e54998-c860-4290-afa0-678a13b8cf17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20e884a1fe994662befda0d920a7c355', 'request_id': 'req-13e54998-c860-4290-afa0-678a13b8cf17'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:54.563128 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-13e54998-c860-4290-afa0-678a13b8cf17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20e884a1fe994662befda0d920a7c355', 'request_id': 'req-13e54998-c860-4290-afa0-678a13b8cf17'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:54.581958 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-13e54998-c860-4290-afa0-678a13b8cf17 admin admin] The token cache is being invalidate because project 20e884a1fe994662befda0d920a7c355 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:32:54.582309 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-13e54998-c860-4290-afa0-678a13b8cf17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:54.583413 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-13e54998-c860-4290-afa0-678a13b8cf17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:54.585724 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1323/2650] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:32:54 2021] DELETE /identity/v3/projects/20e884a1fe994662befda0d920a7c355 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:32:54.592324 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d872c36-7fa1-4555-80fc-ad65e1ee35f1 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:54.592595 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d872c36-7fa1-4555-80fc-ad65e1ee35f1 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:54.592872 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d872c36-7fa1-4555-80fc-ad65e1ee35f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:54.611613 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-1d872c36-7fa1-4555-80fc-ad65e1ee35f1 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:32:54.612873 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-1d872c36-7fa1-4555-80fc-ad65e1ee35f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:32:54.675977 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1328/2651] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:32:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:32:54.684117 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2ff73-8c01-4466-beaa-f4f0f869e26a None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:54.684402 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2ff73-8c01-4466-beaa-f4f0f869e26a None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:54.684674 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2ff73-8c01-4466-beaa-f4f0f869e26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:54.704049 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-64e2ff73-8c01-4466-beaa-f4f0f869e26a None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:32:54.705301 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-64e2ff73-8c01-4466-beaa-f4f0f869e26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:32:54.715825 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1324/2652] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:32:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:32:54.720382 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d872c36-7fa1-4555-80fc-ad65e1ee35f1 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:54.730194 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d872c36-7fa1-4555-80fc-ad65e1ee35f1 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:54.735910 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f417b-241c-45d2-91b9-1c93bea32833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:54.736569 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f417b-241c-45d2-91b9-1c93bea32833 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:54.736847 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f417b-241c-45d2-91b9-1c93bea32833 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:54.737119 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f417b-241c-45d2-91b9-1c93bea32833 admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:54.737901 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f417b-241c-45d2-91b9-1c93bea32833 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:32:54.738206 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f417b-241c-45d2-91b9-1c93bea32833 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:54.739840 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f417b-241c-45d2-91b9-1c93bea32833 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:54.751937 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1329/2653] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:32:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:32:54.756299 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2ff73-8c01-4466-beaa-f4f0f869e26a None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:54.765685 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2ff73-8c01-4466-beaa-f4f0f869e26a None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:54.771666 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad958e75-310e-402a-8833-ecd489669662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:54.772666 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad958e75-310e-402a-8833-ecd489669662 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:54.772948 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad958e75-310e-402a-8833-ecd489669662 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:54.773216 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad958e75-310e-402a-8833-ecd489669662 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:54.773912 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad958e75-310e-402a-8833-ecd489669662 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:54.775858 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad958e75-310e-402a-8833-ecd489669662 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:54.807413 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1325/2654] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:32:54 2021] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:32:54.811699 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f417b-241c-45d2-91b9-1c93bea32833 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:54.822298 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f417b-241c-45d2-91b9-1c93bea32833 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:54.882120 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9e494-70ba-4efd-b0a2-18d11ceb5bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:54.882812 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9e494-70ba-4efd-b0a2-18d11ceb5bb8 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:54.883105 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9e494-70ba-4efd-b0a2-18d11ceb5bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:54.883374 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d9e494-70ba-4efd-b0a2-18d11ceb5bb8 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:54.884081 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9e494-70ba-4efd-b0a2-18d11ceb5bb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:54.885998 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d9e494-70ba-4efd-b0a2-18d11ceb5bb8 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:54.906522 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1330/2655] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:32:54 2021] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:32:54.910615 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad958e75-310e-402a-8833-ecd489669662 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:54.920850 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad958e75-310e-402a-8833-ecd489669662 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:54.925972 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab5736-c2f8-403c-9297-6cc37cbdc002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:54.926621 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab5736-c2f8-403c-9297-6cc37cbdc002 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:54.926895 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab5736-c2f8-403c-9297-6cc37cbdc002 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:54.927202 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab5736-c2f8-403c-9297-6cc37cbdc002 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:54.927927 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ab5736-c2f8-403c-9297-6cc37cbdc002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:54.929519 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ab5736-c2f8-403c-9297-6cc37cbdc002 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:54.939907 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1326/2656] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:32:54 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:32:54.943929 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9e494-70ba-4efd-b0a2-18d11ceb5bb8 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:54.954267 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d9e494-70ba-4efd-b0a2-18d11ceb5bb8 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:54.959744 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b4184-b7f2-46c5-aa27-0de7f2aebd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:54.960395 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b4184-b7f2-46c5-aa27-0de7f2aebd64 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:54.960708 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b4184-b7f2-46c5-aa27-0de7f2aebd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:54.960980 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b4184-b7f2-46c5-aa27-0de7f2aebd64 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:54.961730 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b4184-b7f2-46c5-aa27-0de7f2aebd64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:54.963344 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b4184-b7f2-46c5-aa27-0de7f2aebd64 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:54.973477 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1331/2657] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:32:54 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:32:54.977673 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab5736-c2f8-403c-9297-6cc37cbdc002 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:54.988134 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab5736-c2f8-403c-9297-6cc37cbdc002 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:54.994402 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45ede3-088a-4877-a4da-5c7d814fa16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:54.995323 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45ede3-088a-4877-a4da-5c7d814fa16c admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:54.995606 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45ede3-088a-4877-a4da-5c7d814fa16c admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:54.995879 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45ede3-088a-4877-a4da-5c7d814fa16c admin admin] PATH_INFO: `/v3/projects/7645f47be51e4948ae96b038670bc45b/users/5f2368f1f49c4bf9be14d76ac9402de3/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:55.011244 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba45ede3-088a-4877-a4da-5c7d814fa16c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7645f47be51e4948ae96b038670bc45b, user_id=5f2368f1f49c4bf9be14d76ac9402de3, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:55.013910 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba45ede3-088a-4877-a4da-5c7d814fa16c admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:55.030382 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1327/2658] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:32:54 2021] PUT /identity/v3/projects/7645f47be51e4948ae96b038670bc45b/users/5f2368f1f49c4bf9be14d76ac9402de3/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:32:55.041927 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f0d53-829f-4315-bf2b-b9ffbe0616c1 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:55.042465 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f0d53-829f-4315-bf2b-b9ffbe0616c1 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:55.042465 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f0d53-829f-4315-bf2b-b9ffbe0616c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:55.069324 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-d21f0d53-829f-4315-bf2b-b9ffbe0616c1 None None] MFA Rules not processed for user `5f2368f1f49c4bf9be14d76ac9402de3`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:32:55.070545 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-d21f0d53-829f-4315-bf2b-b9ffbe0616c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:32:55.134466 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1332/2659] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:32:55 2021] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:32:55.140935 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45ede3-088a-4877-a4da-5c7d814fa16c admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:55.202282 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45ede3-088a-4877-a4da-5c7d814fa16c admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:55.208055 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ecdd29-6c24-4f32-b565-01b9eedb01a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:55.208706 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecdd29-6c24-4f32-b565-01b9eedb01a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:55.208991 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecdd29-6c24-4f32-b565-01b9eedb01a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:55.209270 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecdd29-6c24-4f32-b565-01b9eedb01a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:55.209962 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ecdd29-6c24-4f32-b565-01b9eedb01a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:55.211922 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ecdd29-6c24-4f32-b565-01b9eedb01a0 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:55.240647 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1328/2660] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:32:55 2021] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 29 20:32:55.245035 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f0d53-829f-4315-bf2b-b9ffbe0616c1 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:55.256292 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f0d53-829f-4315-bf2b-b9ffbe0616c1 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:55.315485 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1145b7-3499-4322-aedb-3df4d52faa5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:55.316177 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1145b7-3499-4322-aedb-3df4d52faa5e admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:55.316457 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1145b7-3499-4322-aedb-3df4d52faa5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:55.316725 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1145b7-3499-4322-aedb-3df4d52faa5e admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:55.317434 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1145b7-3499-4322-aedb-3df4d52faa5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:55.319410 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1145b7-3499-4322-aedb-3df4d52faa5e admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:55.340586 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1333/2661] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:32:55 2021] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:32:55.344871 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ecdd29-6c24-4f32-b565-01b9eedb01a0 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:55.355495 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ecdd29-6c24-4f32-b565-01b9eedb01a0 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:55.361128 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b4668-2f25-4d76-88dd-079f16db1fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:55.361793 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b4668-2f25-4d76-88dd-079f16db1fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:55.362069 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b4668-2f25-4d76-88dd-079f16db1fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:55.362378 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b4668-2f25-4d76-88dd-079f16db1fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:55.363144 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891b4668-2f25-4d76-88dd-079f16db1fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:55.364737 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891b4668-2f25-4d76-88dd-079f16db1fe1 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:55.378477 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1329/2662] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:32:55 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:32:55.384898 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1145b7-3499-4322-aedb-3df4d52faa5e admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:55.398699 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1145b7-3499-4322-aedb-3df4d52faa5e admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:55.404187 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1efae-2f37-4cc1-9a17-94ecc5018a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:55.405079 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1efae-2f37-4cc1-9a17-94ecc5018a80 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:55.405358 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1efae-2f37-4cc1-9a17-94ecc5018a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:55.405626 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1efae-2f37-4cc1-9a17-94ecc5018a80 admin admin] PATH_INFO: `/v3/projects/3ee93ae27e014b84a6acc160c6adccab/users/ce2c5eb358134cc09d4e49121e900af6/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:55.421003 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1efae-2f37-4cc1-9a17-94ecc5018a80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ee93ae27e014b84a6acc160c6adccab, user_id=ce2c5eb358134cc09d4e49121e900af6, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:55.423766 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1efae-2f37-4cc1-9a17-94ecc5018a80 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:55.439383 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1334/2663] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:32:55 2021] PUT /identity/v3/projects/3ee93ae27e014b84a6acc160c6adccab/users/ce2c5eb358134cc09d4e49121e900af6/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:32:55.443614 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b4668-2f25-4d76-88dd-079f16db1fe1 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:55.453960 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b4668-2f25-4d76-88dd-079f16db1fe1 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:55.509484 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17cc569-9010-48a3-8b14-3a46bef7e769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:55.510245 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17cc569-9010-48a3-8b14-3a46bef7e769 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:55.510560 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17cc569-9010-48a3-8b14-3a46bef7e769 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:55.510827 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17cc569-9010-48a3-8b14-3a46bef7e769 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:55.511711 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17cc569-9010-48a3-8b14-3a46bef7e769 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:55.513356 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17cc569-9010-48a3-8b14-3a46bef7e769 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:55.524347 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1330/2664] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:32:55 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:32:55.528774 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1efae-2f37-4cc1-9a17-94ecc5018a80 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:55.539102 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1efae-2f37-4cc1-9a17-94ecc5018a80 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:55.544072 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8b537-6d9f-4bf4-aae1-00e9fd289ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:55.544965 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8b537-6d9f-4bf4-aae1-00e9fd289ba6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:55.545248 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8b537-6d9f-4bf4-aae1-00e9fd289ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:55.545526 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8b537-6d9f-4bf4-aae1-00e9fd289ba6 admin admin] PATH_INFO: `/v3/projects/3ee93ae27e014b84a6acc160c6adccab/users/ce2c5eb358134cc09d4e49121e900af6/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:55.547576 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8b537-6d9f-4bf4-aae1-00e9fd289ba6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ee93ae27e014b84a6acc160c6adccab, user_id=ce2c5eb358134cc09d4e49121e900af6, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:55.550275 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8b537-6d9f-4bf4-aae1-00e9fd289ba6 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:55.560576 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1335/2665] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:32:55 2021] PUT /identity/v3/projects/3ee93ae27e014b84a6acc160c6adccab/users/ce2c5eb358134cc09d4e49121e900af6/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:32:55.570685 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40bf041-8f28-4633-9d41-cd0829e39f7e None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:55.571011 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40bf041-8f28-4633-9d41-cd0829e39f7e None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:55.571283 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40bf041-8f28-4633-9d41-cd0829e39f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:55.597685 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-c40bf041-8f28-4633-9d41-cd0829e39f7e None None] MFA Rules not processed for user `ce2c5eb358134cc09d4e49121e900af6`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:32:55.598886 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-c40bf041-8f28-4633-9d41-cd0829e39f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:32:55.674001 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1331/2666] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:32:55 2021] POST /identity/v3/auth/tokens => generated 3313 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:32:55.684516 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8b537-6d9f-4bf4-aae1-00e9fd289ba6 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:55.686199 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-15f8b537-6d9f-4bf4-aae1-00e9fd289ba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:32:55.744600 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8b537-6d9f-4bf4-aae1-00e9fd289ba6 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:55.748407 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e2ece-863c-434c-8a5b-8dc2e2bd4ff5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:55.749058 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e2ece-863c-434c-8a5b-8dc2e2bd4ff5 service cinder] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:55.749342 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e2ece-863c-434c-8a5b-8dc2e2bd4ff5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:55.749616 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e2ece-863c-434c-8a5b-8dc2e2bd4ff5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:55.758969 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e2ece-863c-434c-8a5b-8dc2e2bd4ff5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:55.760406 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e2ece-863c-434c-8a5b-8dc2e2bd4ff5 service cinder] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:55.775412 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1336/2667] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:32:55 2021] GET /identity/v3/auth/tokens => generated 3313 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:32:55.867753 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40bf041-8f28-4633-9d41-cd0829e39f7e None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:55.878431 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40bf041-8f28-4633-9d41-cd0829e39f7e None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:55.883179 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b29eacb-51b5-41b5-9464-71865bd835aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:55.883825 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29eacb-51b5-41b5-9464-71865bd835aa service cinder] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:55.884104 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29eacb-51b5-41b5-9464-71865bd835aa service cinder] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:55.884373 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b29eacb-51b5-41b5-9464-71865bd835aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:55.944417 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29eacb-51b5-41b5-9464-71865bd835aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:55.945875 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b29eacb-51b5-41b5-9464-71865bd835aa service cinder] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:55.955171 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1332/2668] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:32:55 2021] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:32:58.523920 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e2ece-863c-434c-8a5b-8dc2e2bd4ff5 service cinder] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:58.590807 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e2ece-863c-434c-8a5b-8dc2e2bd4ff5 service cinder] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:58.595592 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cab1a4-d8c6-4d0f-9c12-e64af6429b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:58.596458 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cab1a4-d8c6-4d0f-9c12-e64af6429b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:58.596737 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cab1a4-d8c6-4d0f-9c12-e64af6429b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:58.597008 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cab1a4-d8c6-4d0f-9c12-e64af6429b00 admin admin] PATH_INFO: `/v3/users/5f2368f1f49c4bf9be14d76ac9402de3` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:58.598233 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cab1a4-d8c6-4d0f-9c12-e64af6429b00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f2368f1f49c4bf9be14d76ac9402de3)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:58.600174 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cab1a4-d8c6-4d0f-9c12-e64af6429b00 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:58.656159 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-f9cab1a4-d8c6-4d0f-9c12-e64af6429b00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f2368f1f49c4bf9be14d76ac9402de3'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:58.663167 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-f9cab1a4-d8c6-4d0f-9c12-e64af6429b00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f2368f1f49c4bf9be14d76ac9402de3'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:58.673705 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-f9cab1a4-d8c6-4d0f-9c12-e64af6429b00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f2368f1f49c4bf9be14d76ac9402de3'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:58.685391 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-f9cab1a4-d8c6-4d0f-9c12-e64af6429b00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f2368f1f49c4bf9be14d76ac9402de3'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:58.686038 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-f9cab1a4-d8c6-4d0f-9c12-e64af6429b00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f2368f1f49c4bf9be14d76ac9402de3'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:58.691967 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1337/2669] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:32:58 2021] DELETE /identity/v3/users/5f2368f1f49c4bf9be14d76ac9402de3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:32:58.697334 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1671f-22ea-4d7b-8f16-428103efd390 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:58.697812 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1671f-22ea-4d7b-8f16-428103efd390 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:58.697923 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1671f-22ea-4d7b-8f16-428103efd390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:58.717376 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-96b1671f-22ea-4d7b-8f16-428103efd390 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:32:58.718594 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-96b1671f-22ea-4d7b-8f16-428103efd390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:32:58.780101 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1333/2670] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:32:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:32:58.790273 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cab1a4-d8c6-4d0f-9c12-e64af6429b00 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:58.791822 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-f9cab1a4-d8c6-4d0f-9c12-e64af6429b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:32:58.866823 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cab1a4-d8c6-4d0f-9c12-e64af6429b00 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:58.871331 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43070a12-96b4-4fd1-9f86-e3bb37e1b5ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:58.872011 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43070a12-96b4-4fd1-9f86-e3bb37e1b5ad service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:58.872293 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43070a12-96b4-4fd1-9f86-e3bb37e1b5ad service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:58.872598 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43070a12-96b4-4fd1-9f86-e3bb37e1b5ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:58.882641 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43070a12-96b4-4fd1-9f86-e3bb37e1b5ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:58.883824 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43070a12-96b4-4fd1-9f86-e3bb37e1b5ad service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:58.893506 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1338/2671] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:32:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Nov 29 20:32:59.160852 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1671f-22ea-4d7b-8f16-428103efd390 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:59.162470 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-96b1671f-22ea-4d7b-8f16-428103efd390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:32:59.175432 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1671f-22ea-4d7b-8f16-428103efd390 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:59.180831 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e1f1e-89c2-46f1-9e8e-1e2231bd427b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:59.181696 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e1f1e-89c2-46f1-9e8e-1e2231bd427b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:59.181979 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e1f1e-89c2-46f1-9e8e-1e2231bd427b admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:59.182253 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e1f1e-89c2-46f1-9e8e-1e2231bd427b admin admin] PATH_INFO: `/v3/projects/7645f47be51e4948ae96b038670bc45b` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:59.183571 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e1f1e-89c2-46f1-9e8e-1e2231bd427b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7645f47be51e4948ae96b038670bc45b)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:59.185617 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e1f1e-89c2-46f1-9e8e-1e2231bd427b admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:59.235164 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-4e3e1f1e-89c2-46f1-9e8e-1e2231bd427b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7645f47be51e4948ae96b038670bc45b', 'request_id': 'req-4e3e1f1e-89c2-46f1-9e8e-1e2231bd427b'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:59.241672 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-4e3e1f1e-89c2-46f1-9e8e-1e2231bd427b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7645f47be51e4948ae96b038670bc45b', 'request_id': 'req-4e3e1f1e-89c2-46f1-9e8e-1e2231bd427b'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:59.247865 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-4e3e1f1e-89c2-46f1-9e8e-1e2231bd427b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7645f47be51e4948ae96b038670bc45b', 'request_id': 'req-4e3e1f1e-89c2-46f1-9e8e-1e2231bd427b'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:59.262067 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-4e3e1f1e-89c2-46f1-9e8e-1e2231bd427b admin admin] The token cache is being invalidate because project 7645f47be51e4948ae96b038670bc45b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:32:59.262354 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-4e3e1f1e-89c2-46f1-9e8e-1e2231bd427b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:59.263019 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-4e3e1f1e-89c2-46f1-9e8e-1e2231bd427b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:59.264554 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1334/2672] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:32:59 2021] DELETE /identity/v3/projects/7645f47be51e4948ae96b038670bc45b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:32:59.268676 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43070a12-96b4-4fd1-9f86-e3bb37e1b5ad service neutron] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:59.278734 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43070a12-96b4-4fd1-9f86-e3bb37e1b5ad service neutron] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:59.343919 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e6700-8a8f-4caa-980c-4f2d15153d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:59.344789 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e6700-8a8f-4caa-980c-4f2d15153d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:59.345061 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e6700-8a8f-4caa-980c-4f2d15153d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:59.345339 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e6700-8a8f-4caa-980c-4f2d15153d22 admin admin] PATH_INFO: `/v3/users/ce2c5eb358134cc09d4e49121e900af6` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:59.346588 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e6700-8a8f-4caa-980c-4f2d15153d22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce2c5eb358134cc09d4e49121e900af6)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:59.348561 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e6700-8a8f-4caa-980c-4f2d15153d22 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:59.403925 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-8f9e6700-8a8f-4caa-980c-4f2d15153d22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce2c5eb358134cc09d4e49121e900af6'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:59.410732 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-8f9e6700-8a8f-4caa-980c-4f2d15153d22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce2c5eb358134cc09d4e49121e900af6'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:59.419225 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-8f9e6700-8a8f-4caa-980c-4f2d15153d22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce2c5eb358134cc09d4e49121e900af6'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:59.431328 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-8f9e6700-8a8f-4caa-980c-4f2d15153d22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce2c5eb358134cc09d4e49121e900af6'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:59.432024 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-8f9e6700-8a8f-4caa-980c-4f2d15153d22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce2c5eb358134cc09d4e49121e900af6'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:59.438143 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1339/2673] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:32:59 2021] DELETE /identity/v3/users/ce2c5eb358134cc09d4e49121e900af6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:32:59.720937 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e1f1e-89c2-46f1-9e8e-1e2231bd427b admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:32:59.722522 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-4e3e1f1e-89c2-46f1-9e8e-1e2231bd427b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:32:59.736534 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e1f1e-89c2-46f1-9e8e-1e2231bd427b admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:32:59.793216 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c0c5e8-1e82-46d6-bcfd-5eafc0dd88c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:32:59.794430 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0c5e8-1e82-46d6-bcfd-5eafc0dd88c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:59.794818 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0c5e8-1e82-46d6-bcfd-5eafc0dd88c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:59.795260 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c0c5e8-1e82-46d6-bcfd-5eafc0dd88c8 admin admin] PATH_INFO: `/v3/projects/3ee93ae27e014b84a6acc160c6adccab` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:59.797414 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c0c5e8-1e82-46d6-bcfd-5eafc0dd88c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ee93ae27e014b84a6acc160c6adccab)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:32:59.800298 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c0c5e8-1e82-46d6-bcfd-5eafc0dd88c8 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:32:59.857230 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-50c0c5e8-1e82-46d6-bcfd-5eafc0dd88c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ee93ae27e014b84a6acc160c6adccab', 'request_id': 'req-50c0c5e8-1e82-46d6-bcfd-5eafc0dd88c8'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:59.863570 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-50c0c5e8-1e82-46d6-bcfd-5eafc0dd88c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ee93ae27e014b84a6acc160c6adccab', 'request_id': 'req-50c0c5e8-1e82-46d6-bcfd-5eafc0dd88c8'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:59.869153 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-50c0c5e8-1e82-46d6-bcfd-5eafc0dd88c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ee93ae27e014b84a6acc160c6adccab', 'request_id': 'req-50c0c5e8-1e82-46d6-bcfd-5eafc0dd88c8'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:59.884031 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-50c0c5e8-1e82-46d6-bcfd-5eafc0dd88c8 admin admin] The token cache is being invalidate because project 3ee93ae27e014b84a6acc160c6adccab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:32:59.884317 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-50c0c5e8-1e82-46d6-bcfd-5eafc0dd88c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:59.885008 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-50c0c5e8-1e82-46d6-bcfd-5eafc0dd88c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:32:59.886699 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1335/2674] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:32:59 2021] DELETE /identity/v3/projects/3ee93ae27e014b84a6acc160c6adccab => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:32:59.895148 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0418e-c205-48b9-b449-3ba2a97c18da None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:59.895647 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0418e-c205-48b9-b449-3ba2a97c18da None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:59.895751 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0418e-c205-48b9-b449-3ba2a97c18da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:32:59.914074 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-89e0418e-c205-48b9-b449-3ba2a97c18da None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:32:59.915307 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-89e0418e-c205-48b9-b449-3ba2a97c18da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:32:59.973433 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1340/2675] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:32:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:32:59.981568 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35162b-11d3-476d-b510-aab9af956423 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:32:59.981854 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35162b-11d3-476d-b510-aab9af956423 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:32:59.982135 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35162b-11d3-476d-b510-aab9af956423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:33:00.002071 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-7e35162b-11d3-476d-b510-aab9af956423 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:33:00.003325 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-7e35162b-11d3-476d-b510-aab9af956423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:33:00.012360 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1336/2676] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:32:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:33:00.017167 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0418e-c205-48b9-b449-3ba2a97c18da None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:33:00.028583 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0418e-c205-48b9-b449-3ba2a97c18da None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:33:00.034495 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ebf72-6214-4b7d-8f4c-b80d133d119a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:33:00.035180 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ebf72-6214-4b7d-8f4c-b80d133d119a admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:33:00.035460 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ebf72-6214-4b7d-8f4c-b80d133d119a admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:33:00.035721 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ebf72-6214-4b7d-8f4c-b80d133d119a admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:33:00.036458 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ebf72-6214-4b7d-8f4c-b80d133d119a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:33:00.036785 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ebf72-6214-4b7d-8f4c-b80d133d119a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:33:00.038420 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ebf72-6214-4b7d-8f4c-b80d133d119a admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:33:00.050276 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1341/2677] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:33:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:33:00.054586 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35162b-11d3-476d-b510-aab9af956423 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:33:00.064120 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35162b-11d3-476d-b510-aab9af956423 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:33:00.070075 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe8920-013a-4e4c-8edb-76ff17f69212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:33:00.070719 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe8920-013a-4e4c-8edb-76ff17f69212 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:33:00.071034 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe8920-013a-4e4c-8edb-76ff17f69212 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:33:00.071296 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe8920-013a-4e4c-8edb-76ff17f69212 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:33:00.071984 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe8920-013a-4e4c-8edb-76ff17f69212 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:33:00.073861 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe8920-013a-4e4c-8edb-76ff17f69212 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:33:00.103325 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1337/2678] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:33:00 2021] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:33:00.107489 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ebf72-6214-4b7d-8f4c-b80d133d119a admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:33:00.118016 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ebf72-6214-4b7d-8f4c-b80d133d119a admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:33:00.185425 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c1a5c-d1a7-4602-8c2d-4b9700584e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:33:00.186058 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c1a5c-d1a7-4602-8c2d-4b9700584e76 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:33:00.186358 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c1a5c-d1a7-4602-8c2d-4b9700584e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:33:00.186629 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c1a5c-d1a7-4602-8c2d-4b9700584e76 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:33:00.187406 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c1a5c-d1a7-4602-8c2d-4b9700584e76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:33:00.189307 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c1a5c-d1a7-4602-8c2d-4b9700584e76 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:33:00.213390 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1342/2679] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:33:00 2021] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:33:00.217702 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe8920-013a-4e4c-8edb-76ff17f69212 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:33:00.228356 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe8920-013a-4e4c-8edb-76ff17f69212 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:33:00.234178 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c645f2-d5ee-4181-8950-1661fcea49ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:33:00.234875 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c645f2-d5ee-4181-8950-1661fcea49ff admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:33:00.235204 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c645f2-d5ee-4181-8950-1661fcea49ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:33:00.235451 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c645f2-d5ee-4181-8950-1661fcea49ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:33:00.236184 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c645f2-d5ee-4181-8950-1661fcea49ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:33:00.237746 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c645f2-d5ee-4181-8950-1661fcea49ff admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:33:00.248625 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1338/2680] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:33:00 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:33:00.252468 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c1a5c-d1a7-4602-8c2d-4b9700584e76 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:33:00.262486 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c1a5c-d1a7-4602-8c2d-4b9700584e76 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:33:00.267481 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa54b669-1223-4d26-87ee-85b9f651630c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:33:00.268123 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54b669-1223-4d26-87ee-85b9f651630c admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:33:00.268396 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54b669-1223-4d26-87ee-85b9f651630c admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:33:00.268662 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54b669-1223-4d26-87ee-85b9f651630c admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:33:00.269419 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa54b669-1223-4d26-87ee-85b9f651630c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:33:00.271008 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa54b669-1223-4d26-87ee-85b9f651630c admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:33:00.281342 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1343/2681] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:33:00 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 29 20:33:00.285562 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c645f2-d5ee-4181-8950-1661fcea49ff admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:33:00.301522 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c645f2-d5ee-4181-8950-1661fcea49ff admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:33:00.310590 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd7d3a-5dfc-4c53-b838-7195273c768a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:33:00.311823 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd7d3a-5dfc-4c53-b838-7195273c768a admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:33:00.312104 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd7d3a-5dfc-4c53-b838-7195273c768a admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:33:00.312402 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbd7d3a-5dfc-4c53-b838-7195273c768a admin admin] PATH_INFO: `/v3/projects/5799f393b0024a3382f40df665141d04/users/e82ff8b6266846a99e44b946e4beed29/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:33:00.329632 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbd7d3a-5dfc-4c53-b838-7195273c768a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5799f393b0024a3382f40df665141d04, user_id=e82ff8b6266846a99e44b946e4beed29, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:33:00.332356 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbd7d3a-5dfc-4c53-b838-7195273c768a admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:33:00.350170 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1339/2682] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:33:00 2021] PUT /identity/v3/projects/5799f393b0024a3382f40df665141d04/users/e82ff8b6266846a99e44b946e4beed29/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:33:00.355330 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00901004-9e06-4985-8a44-7b527885f6df None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:33:00.355617 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00901004-9e06-4985-8a44-7b527885f6df None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:33:00.355890 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00901004-9e06-4985-8a44-7b527885f6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:33:00.373555 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-00901004-9e06-4985-8a44-7b527885f6df None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:33:00.374745 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-00901004-9e06-4985-8a44-7b527885f6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:33:00.433735 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1344/2683] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:33:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:33:00.443834 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd7d3a-5dfc-4c53-b838-7195273c768a admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:33:00.445907 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-bfbd7d3a-5dfc-4c53-b838-7195273c768a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:33:00.504667 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbd7d3a-5dfc-4c53-b838-7195273c768a admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:33:00.508521 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b836bf-ef91-43aa-bdce-ffb78591d4e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:33:00.509157 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b836bf-ef91-43aa-bdce-ffb78591d4e6 service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:33:00.509433 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b836bf-ef91-43aa-bdce-ffb78591d4e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:33:00.509704 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b836bf-ef91-43aa-bdce-ffb78591d4e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:33:00.518589 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b836bf-ef91-43aa-bdce-ffb78591d4e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:33:00.520070 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b836bf-ef91-43aa-bdce-ffb78591d4e6 service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:33:00.529581 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1340/2684] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:33:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:33:04.658803 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0590fe-9e4f-456f-b77b-993a9a68f4bb None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:33:04.659405 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0590fe-9e4f-456f-b77b-993a9a68f4bb None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:33:04.659534 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0590fe-9e4f-456f-b77b-993a9a68f4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:33:04.695649 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-1b0590fe-9e4f-456f-b77b-993a9a68f4bb None None] MFA Rules not processed for user `e82ff8b6266846a99e44b946e4beed29`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:33:04.697183 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-1b0590fe-9e4f-456f-b77b-993a9a68f4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:33:04.769496 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1345/2685] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:33:04 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:33:04.774312 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b836bf-ef91-43aa-bdce-ffb78591d4e6 service neutron] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:33:04.784654 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b836bf-ef91-43aa-bdce-ffb78591d4e6 service neutron] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:33:04.789782 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee9d1c-3d6f-4daf-8931-eaa3a00df851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:33:04.790420 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee9d1c-3d6f-4daf-8931-eaa3a00df851 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:33:04.790704 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee9d1c-3d6f-4daf-8931-eaa3a00df851 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:33:04.793098 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee9d1c-3d6f-4daf-8931-eaa3a00df851 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:33:04.793863 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee9d1c-3d6f-4daf-8931-eaa3a00df851 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:33:04.795991 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee9d1c-3d6f-4daf-8931-eaa3a00df851 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:33:04.838280 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1341/2686] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:33:04 2021] POST /identity/v3/projects => generated 377 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:33:04.843423 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0590fe-9e4f-456f-b77b-993a9a68f4bb None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:33:04.854265 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0590fe-9e4f-456f-b77b-993a9a68f4bb None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:33:04.918241 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc232cea-2021-4509-b46b-1e65f7ffe212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:33:04.919409 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc232cea-2021-4509-b46b-1e65f7ffe212 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:33:04.919887 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc232cea-2021-4509-b46b-1e65f7ffe212 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:33:04.920302 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc232cea-2021-4509-b46b-1e65f7ffe212 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:33:04.921328 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc232cea-2021-4509-b46b-1e65f7ffe212 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:33:04.923858 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc232cea-2021-4509-b46b-1e65f7ffe212 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:33:04.951487 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1346/2687] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:33:04 2021] POST /identity/v3/users => generated 295 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 29 20:33:04.952846 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee9d1c-3d6f-4daf-8931-eaa3a00df851 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:33:04.963182 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee9d1c-3d6f-4daf-8931-eaa3a00df851 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:33:04.967845 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dfcc4d-d568-483b-990e-b58581e5804c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:33:04.968523 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfcc4d-d568-483b-990e-b58581e5804c admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:33:04.968804 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfcc4d-d568-483b-990e-b58581e5804c admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:33:04.969079 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfcc4d-d568-483b-990e-b58581e5804c admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:33:04.969818 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dfcc4d-d568-483b-990e-b58581e5804c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:33:04.971473 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dfcc4d-d568-483b-990e-b58581e5804c admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:33:04.984586 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1342/2688] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:33:04 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:33:04.988973 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc232cea-2021-4509-b46b-1e65f7ffe212 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:33:05.000019 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc232cea-2021-4509-b46b-1e65f7ffe212 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:33:05.005474 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5827b-3c3a-48df-998e-5bbd95560bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:33:05.006463 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5827b-3c3a-48df-998e-5bbd95560bfb admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:33:05.006813 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5827b-3c3a-48df-998e-5bbd95560bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:33:05.007297 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5827b-3c3a-48df-998e-5bbd95560bfb admin admin] PATH_INFO: `/v3/projects/4f26ba40577e4bc18e01c73df9293534/users/74d3950ba6d14c539c365c43c5d84cd0/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:33:05.024816 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb5827b-3c3a-48df-998e-5bbd95560bfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f26ba40577e4bc18e01c73df9293534, user_id=74d3950ba6d14c539c365c43c5d84cd0, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:33:05.027641 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb5827b-3c3a-48df-998e-5bbd95560bfb admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:33:05.043474 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1347/2689] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:33:04 2021] PUT /identity/v3/projects/4f26ba40577e4bc18e01c73df9293534/users/74d3950ba6d14c539c365c43c5d84cd0/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:33:05.047888 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dfcc4d-d568-483b-990e-b58581e5804c admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:33:05.058411 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dfcc4d-d568-483b-990e-b58581e5804c admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:33:05.113848 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f5b39-6f0e-433b-8cae-e4a9a772d0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:33:05.114450 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f5b39-6f0e-433b-8cae-e4a9a772d0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:33:05.114605 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f5b39-6f0e-433b-8cae-e4a9a772d0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:33:05.114953 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f5b39-6f0e-433b-8cae-e4a9a772d0a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:33:05.115683 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f5b39-6f0e-433b-8cae-e4a9a772d0a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:33:05.117274 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f5b39-6f0e-433b-8cae-e4a9a772d0a3 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:33:05.126993 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1343/2690] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:33:05 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:33:05.132332 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5827b-3c3a-48df-998e-5bbd95560bfb admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:33:05.145234 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5827b-3c3a-48df-998e-5bbd95560bfb admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:33:05.151356 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1c735-5273-418c-ad20-87d53caa79bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:33:05.152245 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1c735-5273-418c-ad20-87d53caa79bf admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:33:05.152522 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1c735-5273-418c-ad20-87d53caa79bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:33:05.152795 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1c735-5273-418c-ad20-87d53caa79bf admin admin] PATH_INFO: `/v3/projects/4f26ba40577e4bc18e01c73df9293534/users/74d3950ba6d14c539c365c43c5d84cd0/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:33:05.154893 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1c735-5273-418c-ad20-87d53caa79bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f26ba40577e4bc18e01c73df9293534, user_id=74d3950ba6d14c539c365c43c5d84cd0, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:33:05.157522 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1c735-5273-418c-ad20-87d53caa79bf admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:33:05.168739 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1348/2691] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:33:05 2021] PUT /identity/v3/projects/4f26ba40577e4bc18e01c73df9293534/users/74d3950ba6d14c539c365c43c5d84cd0/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:33:09.474560 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08857238-f8fb-4d87-89ef-8b9f23adbedc None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:33:09.475132 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08857238-f8fb-4d87-89ef-8b9f23adbedc None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:33:09.475220 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08857238-f8fb-4d87-89ef-8b9f23adbedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:33:09.516916 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-08857238-f8fb-4d87-89ef-8b9f23adbedc None None] MFA Rules not processed for user `74d3950ba6d14c539c365c43c5d84cd0`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:33:09.518293 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-08857238-f8fb-4d87-89ef-8b9f23adbedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:33:09.609647 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1344/2692] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:33:09 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:33:09.622109 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1c735-5273-418c-ad20-87d53caa79bf admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:33:09.624202 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-07d1c735-5273-418c-ad20-87d53caa79bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:33:09.710598 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1c735-5273-418c-ad20-87d53caa79bf admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:33:09.717040 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc959a0-0b73-4254-ac9b-d4d62d26454c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:33:09.717720 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc959a0-0b73-4254-ac9b-d4d62d26454c service nova] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:33:09.717999 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc959a0-0b73-4254-ac9b-d4d62d26454c service nova] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:33:09.718276 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc959a0-0b73-4254-ac9b-d4d62d26454c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:33:09.790471 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc959a0-0b73-4254-ac9b-d4d62d26454c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:33:09.792702 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc959a0-0b73-4254-ac9b-d4d62d26454c service nova] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:33:09.803107 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1349/2693] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:33:09 2021] GET /identity/v3/auth/tokens => generated 3244 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:33:27.389581 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541e40e-33ad-47ae-a694-81a80345df1b None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:33:27.390147 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541e40e-33ad-47ae-a694-81a80345df1b None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:33:27.390147 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541e40e-33ad-47ae-a694-81a80345df1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:33:27.418282 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-2541e40e-33ad-47ae-a694-81a80345df1b None None] MFA Rules not processed for user `e82ff8b6266846a99e44b946e4beed29`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:33:27.419495 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-2541e40e-33ad-47ae-a694-81a80345df1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:33:27.445057 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1345/2694] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:33:27 2021] POST /identity/v3/auth/tokens => generated 3244 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:33:27.767305 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc959a0-0b73-4254-ac9b-d4d62d26454c service nova] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:33:27.769159 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-5cc959a0-0b73-4254-ac9b-d4d62d26454c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:33:27.844910 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc959a0-0b73-4254-ac9b-d4d62d26454c service nova] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:33:27.848953 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e3bcf-e738-4d25-8f5e-13f6081940fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:33:27.849596 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e3bcf-e738-4d25-8f5e-13f6081940fd service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:33:27.849877 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e3bcf-e738-4d25-8f5e-13f6081940fd service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:33:27.850149 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81e3bcf-e738-4d25-8f5e-13f6081940fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:33:27.852092 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-b81e3bcf-e738-4d25-8f5e-13f6081940fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:33:27.861487 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e3bcf-e738-4d25-8f5e-13f6081940fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:33:27.862983 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81e3bcf-e738-4d25-8f5e-13f6081940fd service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:33:27.871277 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1350/2695] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:33:27 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:33:28.350338 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541e40e-33ad-47ae-a694-81a80345df1b None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:33:28.351812 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-2541e40e-33ad-47ae-a694-81a80345df1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:33:28.428693 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541e40e-33ad-47ae-a694-81a80345df1b None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:33:28.433668 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959084a-1438-46ab-9ce9-9e242cb77312 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b954c18d7e9349e899f4c1cd42b89166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:33:28.434325 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959084a-1438-46ab-9ce9-9e242cb77312 service placement] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:33:28.434606 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959084a-1438-46ab-9ce9-9e242cb77312 service placement] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:33:28.434913 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6959084a-1438-46ab-9ce9-9e242cb77312 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:33:28.436689 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-6959084a-1438-46ab-9ce9-9e242cb77312 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:33:28.447691 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6959084a-1438-46ab-9ce9-9e242cb77312 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:33:28.449321 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6959084a-1438-46ab-9ce9-9e242cb77312 service placement] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:33:28.458909 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1346/2696] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:33:28 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:33:41.125341 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e3bcf-e738-4d25-8f5e-13f6081940fd service neutron] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:33:41.215814 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81e3bcf-e738-4d25-8f5e-13f6081940fd service neutron] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:33:41.221171 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b5859-efb7-457d-863b-54b22eb61e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:33:41.222045 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b5859-efb7-457d-863b-54b22eb61e6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:33:41.222323 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b5859-efb7-457d-863b-54b22eb61e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:33:41.222593 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b5859-efb7-457d-863b-54b22eb61e6b admin admin] PATH_INFO: `/v3/users/e82ff8b6266846a99e44b946e4beed29` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:33:41.223876 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b5859-efb7-457d-863b-54b22eb61e6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e82ff8b6266846a99e44b946e4beed29)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:33:41.225787 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b5859-efb7-457d-863b-54b22eb61e6b admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:33:41.276588 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ed5b5859-efb7-457d-863b-54b22eb61e6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e82ff8b6266846a99e44b946e4beed29'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:33:41.284186 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ed5b5859-efb7-457d-863b-54b22eb61e6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e82ff8b6266846a99e44b946e4beed29'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:33:41.293169 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ed5b5859-efb7-457d-863b-54b22eb61e6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e82ff8b6266846a99e44b946e4beed29'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:33:41.306104 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ed5b5859-efb7-457d-863b-54b22eb61e6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e82ff8b6266846a99e44b946e4beed29'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:33:41.306871 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ed5b5859-efb7-457d-863b-54b22eb61e6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e82ff8b6266846a99e44b946e4beed29'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:33:41.312976 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1351/2697] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:33:41 2021] DELETE /identity/v3/users/e82ff8b6266846a99e44b946e4beed29 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:33:41.488364 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959084a-1438-46ab-9ce9-9e242cb77312 service placement] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:33:41.498927 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6959084a-1438-46ab-9ce9-9e242cb77312 service placement] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:33:41.556014 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f99a79e-7f28-434c-bba7-a083caade398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:33:41.556797 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99a79e-7f28-434c-bba7-a083caade398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:33:41.557080 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99a79e-7f28-434c-bba7-a083caade398 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:33:41.557352 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99a79e-7f28-434c-bba7-a083caade398 admin admin] PATH_INFO: `/v3/projects/5799f393b0024a3382f40df665141d04` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:33:41.558565 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f99a79e-7f28-434c-bba7-a083caade398 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5799f393b0024a3382f40df665141d04)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:33:41.560525 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f99a79e-7f28-434c-bba7-a083caade398 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:33:41.605813 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-9f99a79e-7f28-434c-bba7-a083caade398 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5799f393b0024a3382f40df665141d04', 'request_id': 'req-9f99a79e-7f28-434c-bba7-a083caade398'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:33:41.611692 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-9f99a79e-7f28-434c-bba7-a083caade398 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5799f393b0024a3382f40df665141d04', 'request_id': 'req-9f99a79e-7f28-434c-bba7-a083caade398'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:33:41.617476 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-9f99a79e-7f28-434c-bba7-a083caade398 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5799f393b0024a3382f40df665141d04', 'request_id': 'req-9f99a79e-7f28-434c-bba7-a083caade398'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:33:41.644982 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-9f99a79e-7f28-434c-bba7-a083caade398 admin admin] The token cache is being invalidate because project 5799f393b0024a3382f40df665141d04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:33:41.645274 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-9f99a79e-7f28-434c-bba7-a083caade398 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:33:41.645927 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-9f99a79e-7f28-434c-bba7-a083caade398 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:33:41.647880 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1347/2698] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:33:41 2021] DELETE /identity/v3/projects/5799f393b0024a3382f40df665141d04 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:33:41.652184 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b5859-efb7-457d-863b-54b22eb61e6b admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:33:41.653783 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-ed5b5859-efb7-457d-863b-54b22eb61e6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:33:41.667507 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b5859-efb7-457d-863b-54b22eb61e6b admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:33:41.726913 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c60644-6d06-4c6c-bf78-064032b15bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:33:41.727798 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c60644-6d06-4c6c-bf78-064032b15bca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:33:41.728073 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c60644-6d06-4c6c-bf78-064032b15bca admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:33:41.728343 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c60644-6d06-4c6c-bf78-064032b15bca admin admin] PATH_INFO: `/v3/users/74d3950ba6d14c539c365c43c5d84cd0` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:33:41.729547 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c60644-6d06-4c6c-bf78-064032b15bca admin admin] RBAC: Authorizing `identity:delete_user(user_id=74d3950ba6d14c539c365c43c5d84cd0)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:33:41.731484 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c60644-6d06-4c6c-bf78-064032b15bca admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:33:41.778341 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-c7c60644-6d06-4c6c-bf78-064032b15bca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74d3950ba6d14c539c365c43c5d84cd0'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:33:41.785648 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-c7c60644-6d06-4c6c-bf78-064032b15bca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74d3950ba6d14c539c365c43c5d84cd0'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:33:41.793813 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-c7c60644-6d06-4c6c-bf78-064032b15bca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74d3950ba6d14c539c365c43c5d84cd0'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:33:41.805144 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-c7c60644-6d06-4c6c-bf78-064032b15bca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74d3950ba6d14c539c365c43c5d84cd0'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:33:41.805806 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-c7c60644-6d06-4c6c-bf78-064032b15bca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74d3950ba6d14c539c365c43c5d84cd0'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:33:41.811780 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1352/2699] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:33:41 2021] DELETE /identity/v3/users/74d3950ba6d14c539c365c43c5d84cd0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:33:41.997873 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f99a79e-7f28-434c-bba7-a083caade398 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:33:41.999461 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-9f99a79e-7f28-434c-bba7-a083caade398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:33:42.015549 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f99a79e-7f28-434c-bba7-a083caade398 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:33:42.073149 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9c440-56db-4ab0-abb0-5fc83ddbc02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:33:42.074041 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9c440-56db-4ab0-abb0-5fc83ddbc02d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:33:42.074315 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9c440-56db-4ab0-abb0-5fc83ddbc02d admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:33:42.074581 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9c440-56db-4ab0-abb0-5fc83ddbc02d admin admin] PATH_INFO: `/v3/projects/4f26ba40577e4bc18e01c73df9293534` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:33:42.075889 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c9c440-56db-4ab0-abb0-5fc83ddbc02d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f26ba40577e4bc18e01c73df9293534)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:33:42.077821 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c9c440-56db-4ab0-abb0-5fc83ddbc02d admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:33:42.124489 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-68c9c440-56db-4ab0-abb0-5fc83ddbc02d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f26ba40577e4bc18e01c73df9293534', 'request_id': 'req-68c9c440-56db-4ab0-abb0-5fc83ddbc02d'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:33:42.130638 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-68c9c440-56db-4ab0-abb0-5fc83ddbc02d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f26ba40577e4bc18e01c73df9293534', 'request_id': 'req-68c9c440-56db-4ab0-abb0-5fc83ddbc02d'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:33:42.136098 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-68c9c440-56db-4ab0-abb0-5fc83ddbc02d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f26ba40577e4bc18e01c73df9293534', 'request_id': 'req-68c9c440-56db-4ab0-abb0-5fc83ddbc02d'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:33:42.150064 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-68c9c440-56db-4ab0-abb0-5fc83ddbc02d admin admin] The token cache is being invalidate because project 4f26ba40577e4bc18e01c73df9293534 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:33:42.150352 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-68c9c440-56db-4ab0-abb0-5fc83ddbc02d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:33:42.151099 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-68c9c440-56db-4ab0-abb0-5fc83ddbc02d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:33:42.152778 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1348/2700] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:33:41 2021] DELETE /identity/v3/projects/4f26ba40577e4bc18e01c73df9293534 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:33:44.093146 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c60644-6d06-4c6c-bf78-064032b15bca admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:33:44.095496 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-c7c60644-6d06-4c6c-bf78-064032b15bca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:33:44.192823 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c60644-6d06-4c6c-bf78-064032b15bca admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:33:44.252641 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3cbb05-ef55-41f7-9ee1-746be9cac284 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b954c18d7e9349e899f4c1cd42b89166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:33:44.253317 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3cbb05-ef55-41f7-9ee1-746be9cac284 service placement] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:33:44.253599 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3cbb05-ef55-41f7-9ee1-746be9cac284 service placement] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:33:44.253902 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3cbb05-ef55-41f7-9ee1-746be9cac284 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:33:44.255815 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-5e3cbb05-ef55-41f7-9ee1-746be9cac284 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:33:44.267124 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3cbb05-ef55-41f7-9ee1-746be9cac284 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:33:44.268742 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3cbb05-ef55-41f7-9ee1-746be9cac284 service placement] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:33:44.282741 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1353/2701] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:33:44 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:35:13.930687 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9c440-56db-4ab0-abb0-5fc83ddbc02d admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:35:13.933391 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-68c9c440-56db-4ab0-abb0-5fc83ddbc02d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:35:13.994761 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9c440-56db-4ab0-abb0-5fc83ddbc02d admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:35:13.999110 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52294247-aa43-4fa3-af5e-4ee55135954a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:35:13.999750 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52294247-aa43-4fa3-af5e-4ee55135954a service cinder] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:35:14.000024 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52294247-aa43-4fa3-af5e-4ee55135954a service cinder] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:35:14.000299 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52294247-aa43-4fa3-af5e-4ee55135954a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:35:14.002404 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-52294247-aa43-4fa3-af5e-4ee55135954a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:35:14.061876 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52294247-aa43-4fa3-af5e-4ee55135954a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:35:14.063370 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52294247-aa43-4fa3-af5e-4ee55135954a service cinder] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:35:14.072999 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1349/2702] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:35:13 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:35:37.876138 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3cbb05-ef55-41f7-9ee1-746be9cac284 service placement] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:35:37.877990 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-5e3cbb05-ef55-41f7-9ee1-746be9cac284 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:35:37.913646 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3cbb05-ef55-41f7-9ee1-746be9cac284 service placement] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:35:37.918523 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811942e9-a0b1-43d2-b8f6-b123a058bed4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:35:37.919207 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811942e9-a0b1-43d2-b8f6-b123a058bed4 service cinder] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:35:37.919488 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811942e9-a0b1-43d2-b8f6-b123a058bed4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:35:37.919764 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811942e9-a0b1-43d2-b8f6-b123a058bed4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:35:37.921719 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-811942e9-a0b1-43d2-b8f6-b123a058bed4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:35:37.979678 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811942e9-a0b1-43d2-b8f6-b123a058bed4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:35:37.981103 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811942e9-a0b1-43d2-b8f6-b123a058bed4 service cinder] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:35:37.990188 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1354/2703] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:35:37 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:36:13.996455 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52294247-aa43-4fa3-af5e-4ee55135954a service cinder] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:36:13.998099 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-52294247-aa43-4fa3-af5e-4ee55135954a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:36:14.083749 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52294247-aa43-4fa3-af5e-4ee55135954a service cinder] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:36:14.088073 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffca7c2-8e9f-4327-a184-5742995e9dc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:36:14.088716 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffca7c2-8e9f-4327-a184-5742995e9dc4 service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:36:14.088992 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffca7c2-8e9f-4327-a184-5742995e9dc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:36:14.089269 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffca7c2-8e9f-4327-a184-5742995e9dc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:36:14.091275 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-dffca7c2-8e9f-4327-a184-5742995e9dc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:36:14.185010 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffca7c2-8e9f-4327-a184-5742995e9dc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:36:14.186462 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffca7c2-8e9f-4327-a184-5742995e9dc4 service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:36:14.206185 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1350/2704] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:36:13 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:36:15.433765 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811942e9-a0b1-43d2-b8f6-b123a058bed4 service cinder] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:36:15.435313 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-811942e9-a0b1-43d2-b8f6-b123a058bed4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:36:15.447081 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811942e9-a0b1-43d2-b8f6-b123a058bed4 service cinder] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:36:15.452054 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc15b5-e948-4d90-97bb-af262121abe9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:36:15.452649 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc15b5-e948-4d90-97bb-af262121abe9 service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:36:15.455316 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc15b5-e948-4d90-97bb-af262121abe9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:36:15.455316 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc15b5-e948-4d90-97bb-af262121abe9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:36:15.456759 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-79dc15b5-e948-4d90-97bb-af262121abe9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:36:15.475095 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dc15b5-e948-4d90-97bb-af262121abe9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:36:15.476767 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dc15b5-e948-4d90-97bb-af262121abe9 service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:36:15.488729 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1355/2705] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:36:15 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:36:19.753721 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffca7c2-8e9f-4327-a184-5742995e9dc4 service neutron] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:36:19.763418 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffca7c2-8e9f-4327-a184-5742995e9dc4 service neutron] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:36:19.768241 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb491e-bef7-48dd-831e-82fb7fe4d048 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:36:19.768886 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb491e-bef7-48dd-831e-82fb7fe4d048 service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:36:19.769162 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb491e-bef7-48dd-831e-82fb7fe4d048 service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:36:19.769436 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb491e-bef7-48dd-831e-82fb7fe4d048 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:36:19.771757 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-d1cb491e-bef7-48dd-831e-82fb7fe4d048 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:36:19.839576 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb491e-bef7-48dd-831e-82fb7fe4d048 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:36:19.841025 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb491e-bef7-48dd-831e-82fb7fe4d048 service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:36:19.850924 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1351/2706] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:36:19 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:36:23.049423 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc15b5-e948-4d90-97bb-af262121abe9 service neutron] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:36:23.053253 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-79dc15b5-e948-4d90-97bb-af262121abe9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:36:23.065032 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc15b5-e948-4d90-97bb-af262121abe9 service neutron] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:36:23.069936 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b75f275-be82-489d-bcaa-da14dc79e380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:36:23.070808 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75f275-be82-489d-bcaa-da14dc79e380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:36:23.071120 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75f275-be82-489d-bcaa-da14dc79e380 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:36:23.071393 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75f275-be82-489d-bcaa-da14dc79e380 admin admin] PATH_INFO: `/v3/users/682a8ea75de1423199659f6f850d2ade` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:36:23.072632 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b75f275-be82-489d-bcaa-da14dc79e380 admin admin] RBAC: Authorizing `identity:delete_user(user_id=682a8ea75de1423199659f6f850d2ade)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:36:23.074544 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b75f275-be82-489d-bcaa-da14dc79e380 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:36:23.125541 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-0b75f275-be82-489d-bcaa-da14dc79e380 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '682a8ea75de1423199659f6f850d2ade'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:36:23.132484 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-0b75f275-be82-489d-bcaa-da14dc79e380 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '682a8ea75de1423199659f6f850d2ade'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:36:23.141156 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-0b75f275-be82-489d-bcaa-da14dc79e380 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '682a8ea75de1423199659f6f850d2ade'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:36:23.153542 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-0b75f275-be82-489d-bcaa-da14dc79e380 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '682a8ea75de1423199659f6f850d2ade'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:36:23.154184 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-0b75f275-be82-489d-bcaa-da14dc79e380 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '682a8ea75de1423199659f6f850d2ade'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:36:23.160040 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1356/2707] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:36:23 2021] DELETE /identity/v3/users/682a8ea75de1423199659f6f850d2ade => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:36:23.332805 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb491e-bef7-48dd-831e-82fb7fe4d048 service neutron] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:36:23.343313 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb491e-bef7-48dd-831e-82fb7fe4d048 service neutron] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:36:23.399046 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb99503-41c1-43d6-9933-fb3be62307ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:36:23.399898 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb99503-41c1-43d6-9933-fb3be62307ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:36:23.400168 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb99503-41c1-43d6-9933-fb3be62307ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:36:23.400443 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb99503-41c1-43d6-9933-fb3be62307ec admin admin] PATH_INFO: `/v3/projects/3e43daf7f595459f97cf2eb7960291a1` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:36:23.401622 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb99503-41c1-43d6-9933-fb3be62307ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e43daf7f595459f97cf2eb7960291a1)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:36:23.403589 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb99503-41c1-43d6-9933-fb3be62307ec admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:36:23.452138 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-0bb99503-41c1-43d6-9933-fb3be62307ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e43daf7f595459f97cf2eb7960291a1', 'request_id': 'req-0bb99503-41c1-43d6-9933-fb3be62307ec'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:36:23.458057 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-0bb99503-41c1-43d6-9933-fb3be62307ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e43daf7f595459f97cf2eb7960291a1', 'request_id': 'req-0bb99503-41c1-43d6-9933-fb3be62307ec'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:36:23.463477 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-0bb99503-41c1-43d6-9933-fb3be62307ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e43daf7f595459f97cf2eb7960291a1', 'request_id': 'req-0bb99503-41c1-43d6-9933-fb3be62307ec'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:36:23.477483 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-0bb99503-41c1-43d6-9933-fb3be62307ec admin admin] The token cache is being invalidate because project 3e43daf7f595459f97cf2eb7960291a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:36:23.477825 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-0bb99503-41c1-43d6-9933-fb3be62307ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:36:23.478466 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-0bb99503-41c1-43d6-9933-fb3be62307ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:36:23.480066 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1352/2708] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:36:23 2021] DELETE /identity/v3/projects/3e43daf7f595459f97cf2eb7960291a1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:36:23.486794 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34580a77-5248-45a2-a367-b96c19cfa40e None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:36:23.487114 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34580a77-5248-45a2-a367-b96c19cfa40e None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:36:23.487387 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34580a77-5248-45a2-a367-b96c19cfa40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:36:23.545332 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-34580a77-5248-45a2-a367-b96c19cfa40e None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:36:23.546547 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-34580a77-5248-45a2-a367-b96c19cfa40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:36:23.611865 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1357/2709] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:36:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:36:23.619835 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859bce6-aa02-48f3-8a78-85cdf40215bd None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:36:23.620146 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859bce6-aa02-48f3-8a78-85cdf40215bd None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:36:23.620433 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859bce6-aa02-48f3-8a78-85cdf40215bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:36:23.640212 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-b859bce6-aa02-48f3-8a78-85cdf40215bd None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:36:23.641413 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-b859bce6-aa02-48f3-8a78-85cdf40215bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:36:23.651241 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1353/2710] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:36:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:36:23.655614 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34580a77-5248-45a2-a367-b96c19cfa40e None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:36:23.665830 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34580a77-5248-45a2-a367-b96c19cfa40e None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:36:23.671676 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e0da4-cbeb-4dc9-acc5-0b1c712006af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:36:23.672331 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e0da4-cbeb-4dc9-acc5-0b1c712006af admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:36:23.672609 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e0da4-cbeb-4dc9-acc5-0b1c712006af admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:36:23.672908 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e0da4-cbeb-4dc9-acc5-0b1c712006af admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:36:23.673652 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e0da4-cbeb-4dc9-acc5-0b1c712006af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:36:23.673952 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e0da4-cbeb-4dc9-acc5-0b1c712006af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:36:23.675597 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e0da4-cbeb-4dc9-acc5-0b1c712006af admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:36:23.687617 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1358/2711] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:36:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:36:23.691897 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859bce6-aa02-48f3-8a78-85cdf40215bd None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:36:23.701409 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859bce6-aa02-48f3-8a78-85cdf40215bd None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:36:23.707455 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb1c5e-add3-428b-bb07-82499d658b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:36:23.708102 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb1c5e-add3-428b-bb07-82499d658b58 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:36:23.708378 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb1c5e-add3-428b-bb07-82499d658b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:36:23.708650 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb1c5e-add3-428b-bb07-82499d658b58 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:36:23.709350 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceb1c5e-add3-428b-bb07-82499d658b58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:36:23.711320 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceb1c5e-add3-428b-bb07-82499d658b58 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:36:23.740773 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1354/2712] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:36:23 2021] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:36:23.744966 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e0da4-cbeb-4dc9-acc5-0b1c712006af admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:36:23.755311 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e0da4-cbeb-4dc9-acc5-0b1c712006af admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:36:23.821902 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d3b94-8a7c-409e-ab99-bac84b19512c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:36:23.822584 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d3b94-8a7c-409e-ab99-bac84b19512c admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:36:23.822873 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d3b94-8a7c-409e-ab99-bac84b19512c admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:36:23.823178 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d3b94-8a7c-409e-ab99-bac84b19512c admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:36:23.823886 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d3b94-8a7c-409e-ab99-bac84b19512c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:36:23.825804 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2d3b94-8a7c-409e-ab99-bac84b19512c admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:36:23.849733 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1359/2713] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:36:23 2021] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:36:23.854030 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb1c5e-add3-428b-bb07-82499d658b58 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:36:23.864591 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb1c5e-add3-428b-bb07-82499d658b58 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:36:23.869479 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d402a68-3541-480c-b4f5-8ddef35997c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:36:23.870164 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d402a68-3541-480c-b4f5-8ddef35997c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:36:23.877936 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d402a68-3541-480c-b4f5-8ddef35997c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:36:23.877936 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d402a68-3541-480c-b4f5-8ddef35997c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:36:23.877936 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d402a68-3541-480c-b4f5-8ddef35997c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:36:23.877936 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d402a68-3541-480c-b4f5-8ddef35997c7 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:36:23.883883 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1355/2714] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:36:23 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:36:23.888213 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d3b94-8a7c-409e-ab99-bac84b19512c admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:36:23.899531 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d3b94-8a7c-409e-ab99-bac84b19512c admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:36:23.906032 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb2ccf-1669-4186-b2ed-a6b0f16cb7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:36:23.907022 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb2ccf-1669-4186-b2ed-a6b0f16cb7a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:36:23.907398 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb2ccf-1669-4186-b2ed-a6b0f16cb7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:36:23.907799 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb2ccf-1669-4186-b2ed-a6b0f16cb7a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:36:23.908925 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb2ccf-1669-4186-b2ed-a6b0f16cb7a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:36:23.911519 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb2ccf-1669-4186-b2ed-a6b0f16cb7a3 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:36:23.926842 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1360/2715] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:36:23 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:36:23.931675 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d402a68-3541-480c-b4f5-8ddef35997c7 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:36:23.947258 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d402a68-3541-480c-b4f5-8ddef35997c7 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:36:23.955398 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b302b2f-d46e-4616-ba11-8c10c0055db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:36:23.956861 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b302b2f-d46e-4616-ba11-8c10c0055db7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:36:23.957134 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b302b2f-d46e-4616-ba11-8c10c0055db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:36:23.957413 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b302b2f-d46e-4616-ba11-8c10c0055db7 admin admin] PATH_INFO: `/v3/projects/753f8f601ebc411e8685be666b507a27/users/cecc67c17ecc4b2c8bb526be632f0575/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:36:23.973784 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b302b2f-d46e-4616-ba11-8c10c0055db7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=753f8f601ebc411e8685be666b507a27, user_id=cecc67c17ecc4b2c8bb526be632f0575, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:36:23.976589 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b302b2f-d46e-4616-ba11-8c10c0055db7 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:36:23.991520 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1356/2716] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:36:23 2021] PUT /identity/v3/projects/753f8f601ebc411e8685be666b507a27/users/cecc67c17ecc4b2c8bb526be632f0575/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:36:23.996706 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c7026-09e5-417b-b840-a71e06a6cff9 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:36:23.996994 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c7026-09e5-417b-b840-a71e06a6cff9 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:36:23.997268 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c7026-09e5-417b-b840-a71e06a6cff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:36:24.015325 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-399c7026-09e5-417b-b840-a71e06a6cff9 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:36:24.016521 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-399c7026-09e5-417b-b840-a71e06a6cff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:36:24.080331 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1361/2717] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:36:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:36:24.090481 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b302b2f-d46e-4616-ba11-8c10c0055db7 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:36:24.092614 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-4b302b2f-d46e-4616-ba11-8c10c0055db7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:36:24.149156 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b302b2f-d46e-4616-ba11-8c10c0055db7 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:36:24.153306 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59242ca-82dd-41fc-8cd4-e69e11b67175 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:36:24.153941 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59242ca-82dd-41fc-8cd4-e69e11b67175 service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:36:24.154216 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59242ca-82dd-41fc-8cd4-e69e11b67175 service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:36:24.154483 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59242ca-82dd-41fc-8cd4-e69e11b67175 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:36:24.163755 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59242ca-82dd-41fc-8cd4-e69e11b67175 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:36:24.165674 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59242ca-82dd-41fc-8cd4-e69e11b67175 service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:36:24.175120 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1357/2718] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:36:24 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:36:24.776744 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8b29c-cd14-4498-8580-d6ea088d1e50 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:36:24.777024 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8b29c-cd14-4498-8580-d6ea088d1e50 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:36:24.777296 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8b29c-cd14-4498-8580-d6ea088d1e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:36:24.806710 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-7bb8b29c-cd14-4498-8580-d6ea088d1e50 None None] MFA Rules not processed for user `cecc67c17ecc4b2c8bb526be632f0575`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:36:24.807972 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-7bb8b29c-cd14-4498-8580-d6ea088d1e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:36:24.882552 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1362/2719] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:36:24 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:36:24.893269 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada253d-6723-4c66-ba40-8d906aa30c17 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:36:24.893805 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada253d-6723-4c66-ba40-8d906aa30c17 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:36:24.893805 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada253d-6723-4c66-ba40-8d906aa30c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:36:24.911172 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-8ada253d-6723-4c66-ba40-8d906aa30c17 None None] MFA Rules not processed for user `cecc67c17ecc4b2c8bb526be632f0575`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:36:24.912410 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-8ada253d-6723-4c66-ba40-8d906aa30c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:36:24.919274 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1358/2720] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:36:24 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:36:24.932153 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8b29c-cd14-4498-8580-d6ea088d1e50 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:36:24.933979 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-7bb8b29c-cd14-4498-8580-d6ea088d1e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:36:25.004701 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb8b29c-cd14-4498-8580-d6ea088d1e50 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:36:25.010401 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b57d9d-cb62-4ee7-b900-9eb2829153b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:36:25.011076 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b57d9d-cb62-4ee7-b900-9eb2829153b2 service nova] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:36:25.011360 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b57d9d-cb62-4ee7-b900-9eb2829153b2 service nova] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:36:25.011632 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b57d9d-cb62-4ee7-b900-9eb2829153b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:36:25.019876 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b57d9d-cb62-4ee7-b900-9eb2829153b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:36:25.021051 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b57d9d-cb62-4ee7-b900-9eb2829153b2 service nova] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:36:25.030142 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1363/2721] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:36:24 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:36:25.273435 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada253d-6723-4c66-ba40-8d906aa30c17 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:36:25.275040 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-8ada253d-6723-4c66-ba40-8d906aa30c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:36:25.288680 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada253d-6723-4c66-ba40-8d906aa30c17 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:36:25.294168 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670c14e-56de-4530-a01d-8f64db37e827 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:36:25.294882 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670c14e-56de-4530-a01d-8f64db37e827 service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:36:25.295175 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670c14e-56de-4530-a01d-8f64db37e827 service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:36:25.295425 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670c14e-56de-4530-a01d-8f64db37e827 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:36:25.297750 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-d670c14e-56de-4530-a01d-8f64db37e827 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:36:25.308350 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d670c14e-56de-4530-a01d-8f64db37e827 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:36:25.309767 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d670c14e-56de-4530-a01d-8f64db37e827 service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:36:25.317911 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1359/2722] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:36:25 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:36:36.497187 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b57d9d-cb62-4ee7-b900-9eb2829153b2 service nova] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:36:36.509107 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b57d9d-cb62-4ee7-b900-9eb2829153b2 service nova] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:36:36.514937 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f5428-9350-474c-a358-5a1cee009a09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:36:36.515596 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f5428-9350-474c-a358-5a1cee009a09 service nova] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:36:36.515879 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f5428-9350-474c-a358-5a1cee009a09 service nova] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:36:36.516158 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f5428-9350-474c-a358-5a1cee009a09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:36:36.518153 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-175f5428-9350-474c-a358-5a1cee009a09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:36:36.531398 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f5428-9350-474c-a358-5a1cee009a09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:36:36.532998 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f5428-9350-474c-a358-5a1cee009a09 service nova] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:36:36.543892 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1364/2723] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:36:36 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:36:57.238887 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405c463-d1be-4602-a1f0-cbb2939cb71b None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:36:57.239428 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405c463-d1be-4602-a1f0-cbb2939cb71b None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:36:57.239428 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405c463-d1be-4602-a1f0-cbb2939cb71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:36:57.257974 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-d405c463-d1be-4602-a1f0-cbb2939cb71b None None] MFA Rules not processed for user `b0cab81601004a4b87852dd3ed53ef70`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:36:57.259302 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-d405c463-d1be-4602-a1f0-cbb2939cb71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:36:57.313607 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1360/2724] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:36:57 2021] POST /identity/v3/auth/tokens => generated 3248 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:36:59.698778 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f5428-9350-474c-a358-5a1cee009a09 service nova] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:36:59.708804 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f5428-9350-474c-a358-5a1cee009a09 service nova] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:36:59.712713 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fdbf4-89be-479a-b93b-c17ef90cfb01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:36:59.713354 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fdbf4-89be-479a-b93b-c17ef90cfb01 service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:36:59.713637 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fdbf4-89be-479a-b93b-c17ef90cfb01 service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:36:59.713912 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fdbf4-89be-479a-b93b-c17ef90cfb01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:36:59.716003 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-e74fdbf4-89be-479a-b93b-c17ef90cfb01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:36:59.725725 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fdbf4-89be-479a-b93b-c17ef90cfb01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:36:59.727224 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fdbf4-89be-479a-b93b-c17ef90cfb01 service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:36:59.737463 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1365/2725] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:36:59 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:38:49.093386 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405c463-d1be-4602-a1f0-cbb2939cb71b None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:38:49.095137 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-d405c463-d1be-4602-a1f0-cbb2939cb71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:38:49.167735 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405c463-d1be-4602-a1f0-cbb2939cb71b None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:38:49.176486 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d35bdc-03bf-4a77-b6e2-6bfcb2307fcc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b954c18d7e9349e899f4c1cd42b89166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:38:49.177266 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d35bdc-03bf-4a77-b6e2-6bfcb2307fcc service placement] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:38:49.177572 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d35bdc-03bf-4a77-b6e2-6bfcb2307fcc service placement] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:38:49.177836 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d35bdc-03bf-4a77-b6e2-6bfcb2307fcc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:38:49.179822 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-22d35bdc-03bf-4a77-b6e2-6bfcb2307fcc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:38:49.192002 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d35bdc-03bf-4a77-b6e2-6bfcb2307fcc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:38:49.193577 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d35bdc-03bf-4a77-b6e2-6bfcb2307fcc service placement] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:38:49.205610 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1361/2726] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:38:49 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:40:14.500603 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fdbf4-89be-479a-b93b-c17ef90cfb01 service neutron] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:40:14.502335 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-e74fdbf4-89be-479a-b93b-c17ef90cfb01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:40:14.561098 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fdbf4-89be-479a-b93b-c17ef90cfb01 service neutron] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:40:14.565621 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffefcd6-8601-42db-b79d-c9f8f846e662 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:40:14.566307 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffefcd6-8601-42db-b79d-c9f8f846e662 service cinder] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:40:14.566590 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffefcd6-8601-42db-b79d-c9f8f846e662 service cinder] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:40:14.566870 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffefcd6-8601-42db-b79d-c9f8f846e662 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:40:14.568942 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-2ffefcd6-8601-42db-b79d-c9f8f846e662 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:40:14.601762 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffefcd6-8601-42db-b79d-c9f8f846e662 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:40:14.603226 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffefcd6-8601-42db-b79d-c9f8f846e662 service cinder] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:40:14.624968 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1366/2727] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:40:14 2021] GET /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:41:24.608120 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d35bdc-03bf-4a77-b6e2-6bfcb2307fcc service placement] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:41:24.610264 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-22d35bdc-03bf-4a77-b6e2-6bfcb2307fcc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:41:24.622751 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d35bdc-03bf-4a77-b6e2-6bfcb2307fcc service placement] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:41:24.627388 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b644e2b-a30a-41bc-a73f-4199ec00fd2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:41:24.628023 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b644e2b-a30a-41bc-a73f-4199ec00fd2f service cinder] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:41:24.628418 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b644e2b-a30a-41bc-a73f-4199ec00fd2f service cinder] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:41:24.628692 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b644e2b-a30a-41bc-a73f-4199ec00fd2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:41:24.637905 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b644e2b-a30a-41bc-a73f-4199ec00fd2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:41:24.639399 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b644e2b-a30a-41bc-a73f-4199ec00fd2f service cinder] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:41:24.649110 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1362/2728] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:41:24 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:42:39.610690 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e7829-03ee-4ccb-99e3-45e04e5b2262 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:42:39.611316 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e7829-03ee-4ccb-99e3-45e04e5b2262 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:42:39.611316 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e7829-03ee-4ccb-99e3-45e04e5b2262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:42:39.629657 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-f82e7829-03ee-4ccb-99e3-45e04e5b2262 None None] MFA Rules not processed for user `cecc67c17ecc4b2c8bb526be632f0575`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:42:39.630880 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-f82e7829-03ee-4ccb-99e3-45e04e5b2262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:42:39.639466 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1367/2729] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:42:39 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:42:39.680461 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b644e2b-a30a-41bc-a73f-4199ec00fd2f service cinder] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:42:39.682554 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-2b644e2b-a30a-41bc-a73f-4199ec00fd2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:42:39.772460 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b644e2b-a30a-41bc-a73f-4199ec00fd2f service cinder] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:42:39.776198 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0fd24-ae18-4096-8022-c36a0c19b454 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcc415af1f5a42febbdbd187e066cf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:42:39.776844 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0fd24-ae18-4096-8022-c36a0c19b454 service glance] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:42:39.777121 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0fd24-ae18-4096-8022-c36a0c19b454 service glance] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:42:39.777398 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0fd24-ae18-4096-8022-c36a0c19b454 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:42:39.779261 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-c0b0fd24-ae18-4096-8022-c36a0c19b454 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:42:39.792538 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b0fd24-ae18-4096-8022-c36a0c19b454 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:42:39.793963 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b0fd24-ae18-4096-8022-c36a0c19b454 service glance] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:42:39.804713 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1363/2730] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:42:39 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:42:40.028452 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e7829-03ee-4ccb-99e3-45e04e5b2262 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:42:40.038411 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e7829-03ee-4ccb-99e3-45e04e5b2262 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:42:40.042487 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc623dd-8d06-4cd5-99c5-bf108a91bfc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:42:40.043166 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc623dd-8d06-4cd5-99c5-bf108a91bfc8 service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:42:40.043449 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc623dd-8d06-4cd5-99c5-bf108a91bfc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:42:40.043730 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc623dd-8d06-4cd5-99c5-bf108a91bfc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:42:40.045644 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-bcc623dd-8d06-4cd5-99c5-bf108a91bfc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:42:40.055525 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc623dd-8d06-4cd5-99c5-bf108a91bfc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:42:40.056958 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc623dd-8d06-4cd5-99c5-bf108a91bfc8 service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:42:40.065004 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1368/2731] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:42:40 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:42:40.404511 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0fd24-ae18-4096-8022-c36a0c19b454 service glance] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:42:40.412538 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc623dd-8d06-4cd5-99c5-bf108a91bfc8 service neutron] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:42:40.416612 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0fd24-ae18-4096-8022-c36a0c19b454 service glance] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:42:40.421398 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc623dd-8d06-4cd5-99c5-bf108a91bfc8 service neutron] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:42:40.422640 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64409b-3694-4ffc-8b25-afd78f9f28dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b954c18d7e9349e899f4c1cd42b89166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:42:40.423324 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64409b-3694-4ffc-8b25-afd78f9f28dc service placement] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:42:40.423677 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64409b-3694-4ffc-8b25-afd78f9f28dc service placement] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:42:40.423934 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64409b-3694-4ffc-8b25-afd78f9f28dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:42:40.425712 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498a6c7-f62b-437e-b6ff-69f650b73c6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:42:40.425962 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-bd64409b-3694-4ffc-8b25-afd78f9f28dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:42:40.426497 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498a6c7-f62b-437e-b6ff-69f650b73c6d service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:42:40.426903 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498a6c7-f62b-437e-b6ff-69f650b73c6d service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:42:40.427249 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5498a6c7-f62b-437e-b6ff-69f650b73c6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:42:40.429071 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-5498a6c7-f62b-437e-b6ff-69f650b73c6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:42:40.437756 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd64409b-3694-4ffc-8b25-afd78f9f28dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:42:40.439380 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd64409b-3694-4ffc-8b25-afd78f9f28dc service placement] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:42:40.442490 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498a6c7-f62b-437e-b6ff-69f650b73c6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:42:40.444005 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5498a6c7-f62b-437e-b6ff-69f650b73c6d service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:42:40.449576 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1364/2732] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:42:40 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:42:40.455046 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1369/2733] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:42:40 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:42:42.317578 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64409b-3694-4ffc-8b25-afd78f9f28dc service placement] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:42:42.327496 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64409b-3694-4ffc-8b25-afd78f9f28dc service placement] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:42:42.331279 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da966446-ee6a-464d-9f63-50713bc35707 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:42:42.331951 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da966446-ee6a-464d-9f63-50713bc35707 service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:42:42.332224 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da966446-ee6a-464d-9f63-50713bc35707 service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:42:42.332492 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da966446-ee6a-464d-9f63-50713bc35707 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:42:42.339766 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da966446-ee6a-464d-9f63-50713bc35707 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:42:42.341187 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da966446-ee6a-464d-9f63-50713bc35707 service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:42:42.348793 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1365/2734] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:42:42 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:42:42.949579 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498a6c7-f62b-437e-b6ff-69f650b73c6d service neutron] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:42:42.951590 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-5498a6c7-f62b-437e-b6ff-69f650b73c6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:42:42.975223 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5498a6c7-f62b-437e-b6ff-69f650b73c6d service neutron] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:42:42.982696 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207d019-6b04-42ec-bf5d-deffe133709c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:42:42.983352 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207d019-6b04-42ec-bf5d-deffe133709c service nova] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:42:42.983849 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207d019-6b04-42ec-bf5d-deffe133709c service nova] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:42:42.984125 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207d019-6b04-42ec-bf5d-deffe133709c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:42:42.986256 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-2207d019-6b04-42ec-bf5d-deffe133709c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:42:42.999766 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207d019-6b04-42ec-bf5d-deffe133709c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:42:43.001554 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207d019-6b04-42ec-bf5d-deffe133709c service nova] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:42:43.012860 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1370/2735] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:42:42 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:42:48.433112 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da966446-ee6a-464d-9f63-50713bc35707 service neutron] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:42:48.447149 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da966446-ee6a-464d-9f63-50713bc35707 service neutron] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:42:48.453528 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e78b8-8d15-4190-b1b7-222371272111 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:42:48.454173 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e78b8-8d15-4190-b1b7-222371272111 service nova] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:42:48.454446 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e78b8-8d15-4190-b1b7-222371272111 service nova] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:42:48.454715 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e78b8-8d15-4190-b1b7-222371272111 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:42:48.464082 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e78b8-8d15-4190-b1b7-222371272111 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:42:48.465657 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e78b8-8d15-4190-b1b7-222371272111 service nova] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:42:48.476284 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1366/2736] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:42:48 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:43:35.278408 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207d019-6b04-42ec-bf5d-deffe133709c service nova] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:43:35.299161 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207d019-6b04-42ec-bf5d-deffe133709c service nova] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:43:35.303202 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4906a8f-ac94-4134-8449-e995112b7735 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:43:35.303852 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4906a8f-ac94-4134-8449-e995112b7735 service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:43:35.304139 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4906a8f-ac94-4134-8449-e995112b7735 service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:43:35.304414 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4906a8f-ac94-4134-8449-e995112b7735 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:43:35.306243 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-a4906a8f-ac94-4134-8449-e995112b7735 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:43:35.349209 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4906a8f-ac94-4134-8449-e995112b7735 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:43:35.350650 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4906a8f-ac94-4134-8449-e995112b7735 service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:43:35.360529 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1371/2737] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:43:35 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:43:35.909285 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e78b8-8d15-4190-b1b7-222371272111 service nova] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:43:35.910890 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-4e3e78b8-8d15-4190-b1b7-222371272111 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:43:35.952820 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e78b8-8d15-4190-b1b7-222371272111 service nova] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:43:35.958261 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62cbc7d-9d84-4d5b-90c9-2b4879d41571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:43:35.959241 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cbc7d-9d84-4d5b-90c9-2b4879d41571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:43:35.959522 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cbc7d-9d84-4d5b-90c9-2b4879d41571 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:43:35.959794 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cbc7d-9d84-4d5b-90c9-2b4879d41571 admin admin] PATH_INFO: `/v3/users/b0cab81601004a4b87852dd3ed53ef70` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:43:35.961043 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62cbc7d-9d84-4d5b-90c9-2b4879d41571 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0cab81601004a4b87852dd3ed53ef70)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:43:35.963036 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62cbc7d-9d84-4d5b-90c9-2b4879d41571 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:43:36.012914 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-a62cbc7d-9d84-4d5b-90c9-2b4879d41571 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0cab81601004a4b87852dd3ed53ef70'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:43:36.020837 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-a62cbc7d-9d84-4d5b-90c9-2b4879d41571 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0cab81601004a4b87852dd3ed53ef70'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:43:36.033474 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-a62cbc7d-9d84-4d5b-90c9-2b4879d41571 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0cab81601004a4b87852dd3ed53ef70'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:43:36.034188 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-a62cbc7d-9d84-4d5b-90c9-2b4879d41571 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0cab81601004a4b87852dd3ed53ef70'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:43:36.034828 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-a62cbc7d-9d84-4d5b-90c9-2b4879d41571 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0cab81601004a4b87852dd3ed53ef70'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:43:36.048834 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1367/2738] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:43:35 2021] DELETE /identity/v3/users/b0cab81601004a4b87852dd3ed53ef70 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:43:36.221692 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4906a8f-ac94-4134-8449-e995112b7735 service neutron] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:43:36.231782 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4906a8f-ac94-4134-8449-e995112b7735 service neutron] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:43:36.294109 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167a1e09-02d0-4545-ac36-6cb41765dfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:43:36.295072 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a1e09-02d0-4545-ac36-6cb41765dfef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:43:36.295353 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a1e09-02d0-4545-ac36-6cb41765dfef admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:43:36.295645 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167a1e09-02d0-4545-ac36-6cb41765dfef admin admin] PATH_INFO: `/v3/projects/da97463c6b6a424b9e12695a9e6eb94f` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:43:36.296980 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a1e09-02d0-4545-ac36-6cb41765dfef admin admin] RBAC: Authorizing `identity:delete_project(project_id=da97463c6b6a424b9e12695a9e6eb94f)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:43:36.298929 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167a1e09-02d0-4545-ac36-6cb41765dfef admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:43:36.349293 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-167a1e09-02d0-4545-ac36-6cb41765dfef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da97463c6b6a424b9e12695a9e6eb94f', 'request_id': 'req-167a1e09-02d0-4545-ac36-6cb41765dfef'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:43:36.355219 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-167a1e09-02d0-4545-ac36-6cb41765dfef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da97463c6b6a424b9e12695a9e6eb94f', 'request_id': 'req-167a1e09-02d0-4545-ac36-6cb41765dfef'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:43:36.365746 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-167a1e09-02d0-4545-ac36-6cb41765dfef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da97463c6b6a424b9e12695a9e6eb94f', 'request_id': 'req-167a1e09-02d0-4545-ac36-6cb41765dfef'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:43:36.376247 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-167a1e09-02d0-4545-ac36-6cb41765dfef admin admin] The token cache is being invalidate because project da97463c6b6a424b9e12695a9e6eb94f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:43:36.376530 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-167a1e09-02d0-4545-ac36-6cb41765dfef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:43:36.377240 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-167a1e09-02d0-4545-ac36-6cb41765dfef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:43:36.378945 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1372/2739] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:43:36 2021] DELETE /identity/v3/projects/da97463c6b6a424b9e12695a9e6eb94f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:43:36.385498 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14013f8f-5281-4f40-ada8-7a9bd38bc80d None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:43:36.385846 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14013f8f-5281-4f40-ada8-7a9bd38bc80d None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:43:36.386220 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14013f8f-5281-4f40-ada8-7a9bd38bc80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:43:36.409450 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-14013f8f-5281-4f40-ada8-7a9bd38bc80d None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:43:36.410643 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-14013f8f-5281-4f40-ada8-7a9bd38bc80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:43:36.471156 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1368/2740] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:43:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:43:36.482936 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d71c35-7161-45b0-8905-94cd3f68f2b9 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:43:36.483225 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d71c35-7161-45b0-8905-94cd3f68f2b9 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:43:36.483502 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d71c35-7161-45b0-8905-94cd3f68f2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:43:36.502064 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-71d71c35-7161-45b0-8905-94cd3f68f2b9 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:43:36.503276 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-71d71c35-7161-45b0-8905-94cd3f68f2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:43:36.511261 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1373/2741] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:43:36 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:43:36.515633 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14013f8f-5281-4f40-ada8-7a9bd38bc80d None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:43:36.526946 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14013f8f-5281-4f40-ada8-7a9bd38bc80d None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:43:36.532370 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53581d6-678f-4a48-842b-d76a9551f27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:43:36.533015 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53581d6-678f-4a48-842b-d76a9551f27a admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:43:36.533290 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53581d6-678f-4a48-842b-d76a9551f27a admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:43:36.533557 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53581d6-678f-4a48-842b-d76a9551f27a admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:43:36.534387 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53581d6-678f-4a48-842b-d76a9551f27a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:43:36.534685 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53581d6-678f-4a48-842b-d76a9551f27a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:43:36.536315 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53581d6-678f-4a48-842b-d76a9551f27a admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:43:36.549325 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1369/2742] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:43:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:43:36.554023 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d71c35-7161-45b0-8905-94cd3f68f2b9 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:43:36.564401 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d71c35-7161-45b0-8905-94cd3f68f2b9 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:43:36.571007 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54037f64-bc87-44f4-92ed-73911c86dd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:43:36.571711 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54037f64-bc87-44f4-92ed-73911c86dd23 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:43:36.572011 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54037f64-bc87-44f4-92ed-73911c86dd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:43:36.572234 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54037f64-bc87-44f4-92ed-73911c86dd23 admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:43:36.572967 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54037f64-bc87-44f4-92ed-73911c86dd23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:43:36.574839 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54037f64-bc87-44f4-92ed-73911c86dd23 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:43:36.614272 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1374/2743] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:43:36 2021] POST /identity/v3/projects => generated 391 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:43:36.618452 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53581d6-678f-4a48-842b-d76a9551f27a admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:43:36.628872 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53581d6-678f-4a48-842b-d76a9551f27a admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:43:36.684834 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e3e57b-6ab0-43fd-afca-bf88d629affe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:43:36.685497 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3e57b-6ab0-43fd-afca-bf88d629affe admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:43:36.685769 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3e57b-6ab0-43fd-afca-bf88d629affe admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:43:36.686047 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3e57b-6ab0-43fd-afca-bf88d629affe admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:43:36.686733 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e3e57b-6ab0-43fd-afca-bf88d629affe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:43:36.688655 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e3e57b-6ab0-43fd-afca-bf88d629affe admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:43:36.716579 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1370/2744] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:43:36 2021] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:43:36.721698 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54037f64-bc87-44f4-92ed-73911c86dd23 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:43:36.735230 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54037f64-bc87-44f4-92ed-73911c86dd23 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:43:36.740637 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9f2af-c815-4622-b3b9-306bb967ddfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:43:36.741306 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9f2af-c815-4622-b3b9-306bb967ddfc admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:43:36.741610 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9f2af-c815-4622-b3b9-306bb967ddfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:43:36.741891 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde9f2af-c815-4622-b3b9-306bb967ddfc admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:43:36.742644 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde9f2af-c815-4622-b3b9-306bb967ddfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:43:36.744304 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde9f2af-c815-4622-b3b9-306bb967ddfc admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:43:36.754334 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1375/2745] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:43:36 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:43:36.758353 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e3e57b-6ab0-43fd-afca-bf88d629affe admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:43:36.769271 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e3e57b-6ab0-43fd-afca-bf88d629affe admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:43:36.774987 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c0cf3-2fba-4f7e-9e65-64430d76a586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:43:36.775650 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c0cf3-2fba-4f7e-9e65-64430d76a586 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:43:36.775932 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c0cf3-2fba-4f7e-9e65-64430d76a586 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:43:36.776190 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c0cf3-2fba-4f7e-9e65-64430d76a586 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:43:36.776927 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c0cf3-2fba-4f7e-9e65-64430d76a586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:43:36.778546 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c0cf3-2fba-4f7e-9e65-64430d76a586 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:43:36.789293 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1371/2746] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:43:36 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:43:36.795265 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9f2af-c815-4622-b3b9-306bb967ddfc admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:43:36.805762 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde9f2af-c815-4622-b3b9-306bb967ddfc admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:43:36.810935 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d43fc4-e0e8-4754-af29-5437362d41d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:43:36.811822 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d43fc4-e0e8-4754-af29-5437362d41d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:43:36.812105 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d43fc4-e0e8-4754-af29-5437362d41d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:43:36.812382 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d43fc4-e0e8-4754-af29-5437362d41d7 admin admin] PATH_INFO: `/v3/projects/4a7f2476ebde4261854b76a795f01f15/users/dffc569c65bb420894d0ece1eb77c24a/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:43:36.828277 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d43fc4-e0e8-4754-af29-5437362d41d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a7f2476ebde4261854b76a795f01f15, user_id=dffc569c65bb420894d0ece1eb77c24a, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:43:36.831018 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d43fc4-e0e8-4754-af29-5437362d41d7 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:43:36.846346 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1376/2747] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:43:36 2021] PUT /identity/v3/projects/4a7f2476ebde4261854b76a795f01f15/users/dffc569c65bb420894d0ece1eb77c24a/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:43:36.856810 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8eedd8-3738-4c01-a051-a2247fbad933 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:43:36.857098 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8eedd8-3738-4c01-a051-a2247fbad933 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:43:36.857377 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8eedd8-3738-4c01-a051-a2247fbad933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:43:36.883615 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-2f8eedd8-3738-4c01-a051-a2247fbad933 None None] MFA Rules not processed for user `dffc569c65bb420894d0ece1eb77c24a`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:43:36.884824 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-2f8eedd8-3738-4c01-a051-a2247fbad933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:43:36.948825 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1372/2748] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:43:36 2021] POST /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:43:36.959259 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d43fc4-e0e8-4754-af29-5437362d41d7 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:43:36.961308 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-31d43fc4-e0e8-4754-af29-5437362d41d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:43:37.029929 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d43fc4-e0e8-4754-af29-5437362d41d7 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:43:37.033828 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e97f6-fcf9-4915-a85b-fd1fd90527d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:43:37.034481 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e97f6-fcf9-4915-a85b-fd1fd90527d2 service cinder] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:43:37.034766 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e97f6-fcf9-4915-a85b-fd1fd90527d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:43:37.035072 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e97f6-fcf9-4915-a85b-fd1fd90527d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:43:37.043516 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e97f6-fcf9-4915-a85b-fd1fd90527d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:43:37.044990 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e97f6-fcf9-4915-a85b-fd1fd90527d2 service cinder] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:43:37.053662 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1377/2749] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:43:36 2021] GET /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:43:54.254527 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8eedd8-3738-4c01-a051-a2247fbad933 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:43:54.339100 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8eedd8-3738-4c01-a051-a2247fbad933 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:43:54.345152 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024d2dd-060e-4320-934c-ae7a486da845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:43:54.346056 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024d2dd-060e-4320-934c-ae7a486da845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:43:54.346332 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024d2dd-060e-4320-934c-ae7a486da845 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:43:54.346602 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024d2dd-060e-4320-934c-ae7a486da845 admin admin] PATH_INFO: `/v3/users/dffc569c65bb420894d0ece1eb77c24a` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:43:54.347902 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6024d2dd-060e-4320-934c-ae7a486da845 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dffc569c65bb420894d0ece1eb77c24a)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:43:54.349829 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6024d2dd-060e-4320-934c-ae7a486da845 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:43:54.406411 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-6024d2dd-060e-4320-934c-ae7a486da845 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dffc569c65bb420894d0ece1eb77c24a'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:43:54.413962 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-6024d2dd-060e-4320-934c-ae7a486da845 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dffc569c65bb420894d0ece1eb77c24a'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:43:54.426623 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-6024d2dd-060e-4320-934c-ae7a486da845 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dffc569c65bb420894d0ece1eb77c24a'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:43:54.427354 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-6024d2dd-060e-4320-934c-ae7a486da845 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dffc569c65bb420894d0ece1eb77c24a'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:43:54.427989 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-6024d2dd-060e-4320-934c-ae7a486da845 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dffc569c65bb420894d0ece1eb77c24a'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:43:54.442748 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1373/2750] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:43:54 2021] DELETE /identity/v3/users/dffc569c65bb420894d0ece1eb77c24a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:43:54.447439 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bbec1-090e-4054-8642-b0b8c5882a5f None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:43:54.447975 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bbec1-090e-4054-8642-b0b8c5882a5f None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:43:54.447975 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86bbec1-090e-4054-8642-b0b8c5882a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:43:54.479820 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-d86bbec1-090e-4054-8642-b0b8c5882a5f None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:43:54.480968 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-d86bbec1-090e-4054-8642-b0b8c5882a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:43:54.542727 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1378/2751] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:43:54 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:43:54.552795 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024d2dd-060e-4320-934c-ae7a486da845 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:43:54.554261 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-6024d2dd-060e-4320-934c-ae7a486da845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:43:54.612671 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024d2dd-060e-4320-934c-ae7a486da845 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:43:54.616678 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc698a1-722c-4a82-beb5-55389acf2df8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:43:54.617359 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc698a1-722c-4a82-beb5-55389acf2df8 service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:43:54.617771 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc698a1-722c-4a82-beb5-55389acf2df8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:43:54.618099 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc698a1-722c-4a82-beb5-55389acf2df8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:43:54.628217 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc698a1-722c-4a82-beb5-55389acf2df8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:43:54.629661 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc698a1-722c-4a82-beb5-55389acf2df8 service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:43:54.639427 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1374/2752] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:43:54 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:43:54.913767 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86bbec1-090e-4054-8642-b0b8c5882a5f None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:43:54.915344 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-d86bbec1-090e-4054-8642-b0b8c5882a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:43:54.927164 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86bbec1-090e-4054-8642-b0b8c5882a5f None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:43:54.935641 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d82b7-e4c5-479b-989b-361c32c08f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:43:54.936569 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d82b7-e4c5-479b-989b-361c32c08f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:43:54.936840 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d82b7-e4c5-479b-989b-361c32c08f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:43:54.937236 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13d82b7-e4c5-479b-989b-361c32c08f94 admin admin] PATH_INFO: `/v3/projects/4a7f2476ebde4261854b76a795f01f15` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:43:54.938357 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d82b7-e4c5-479b-989b-361c32c08f94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a7f2476ebde4261854b76a795f01f15)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:43:54.940440 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13d82b7-e4c5-479b-989b-361c32c08f94 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:43:54.995895 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-a13d82b7-e4c5-479b-989b-361c32c08f94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a7f2476ebde4261854b76a795f01f15', 'request_id': 'req-a13d82b7-e4c5-479b-989b-361c32c08f94'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:43:55.002195 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-a13d82b7-e4c5-479b-989b-361c32c08f94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a7f2476ebde4261854b76a795f01f15', 'request_id': 'req-a13d82b7-e4c5-479b-989b-361c32c08f94'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:43:55.011844 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-a13d82b7-e4c5-479b-989b-361c32c08f94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a7f2476ebde4261854b76a795f01f15', 'request_id': 'req-a13d82b7-e4c5-479b-989b-361c32c08f94'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:43:55.025423 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-a13d82b7-e4c5-479b-989b-361c32c08f94 admin admin] The token cache is being invalidate because project 4a7f2476ebde4261854b76a795f01f15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:43:55.025833 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-a13d82b7-e4c5-479b-989b-361c32c08f94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:43:55.026640 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-a13d82b7-e4c5-479b-989b-361c32c08f94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:43:55.028787 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1379/2753] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:43:54 2021] DELETE /identity/v3/projects/4a7f2476ebde4261854b76a795f01f15 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:43:57.044130 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc698a1-722c-4a82-beb5-55389acf2df8 service neutron] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:43:57.045557 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-5dc698a1-722c-4a82-beb5-55389acf2df8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:43:57.136385 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc698a1-722c-4a82-beb5-55389acf2df8 service neutron] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:43:57.196280 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafeffa-a3d2-4a6f-b789-ef8cb67ba834 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b954c18d7e9349e899f4c1cd42b89166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:43:57.196925 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafeffa-a3d2-4a6f-b789-ef8cb67ba834 service placement] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:43:57.197210 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafeffa-a3d2-4a6f-b789-ef8cb67ba834 service placement] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:43:57.197485 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafeffa-a3d2-4a6f-b789-ef8cb67ba834 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:43:57.199441 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-1dafeffa-a3d2-4a6f-b789-ef8cb67ba834 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:43:57.210532 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dafeffa-a3d2-4a6f-b789-ef8cb67ba834 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:43:57.212148 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dafeffa-a3d2-4a6f-b789-ef8cb67ba834 service placement] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:43:57.221885 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1375/2754] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:43:57 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:46:24.482331 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d82b7-e4c5-479b-989b-361c32c08f94 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:46:24.483819 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-a13d82b7-e4c5-479b-989b-361c32c08f94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:46:24.564767 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13d82b7-e4c5-479b-989b-361c32c08f94 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:46:24.569355 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae8a208-076a-4c06-94ec-3342a49af029 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:46:24.570558 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8a208-076a-4c06-94ec-3342a49af029 service cinder] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:46:24.571053 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8a208-076a-4c06-94ec-3342a49af029 service cinder] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:46:24.571449 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8a208-076a-4c06-94ec-3342a49af029 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:46:24.573723 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-cae8a208-076a-4c06-94ec-3342a49af029 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:46:24.660612 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae8a208-076a-4c06-94ec-3342a49af029 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:46:24.662178 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae8a208-076a-4c06-94ec-3342a49af029 service cinder] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:46:24.671670 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1380/2755] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:46:24 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:47:59.769090 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafeffa-a3d2-4a6f-b789-ef8cb67ba834 service placement] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:47:59.771451 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-1dafeffa-a3d2-4a6f-b789-ef8cb67ba834 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:47:59.874399 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafeffa-a3d2-4a6f-b789-ef8cb67ba834 service placement] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:47:59.878147 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099e6af-7385-4036-9f4b-a725dde2500d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:47:59.878806 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099e6af-7385-4036-9f4b-a725dde2500d service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:47:59.879121 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099e6af-7385-4036-9f4b-a725dde2500d service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:47:59.879387 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099e6af-7385-4036-9f4b-a725dde2500d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:47:59.881253 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-c099e6af-7385-4036-9f4b-a725dde2500d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:47:59.892979 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099e6af-7385-4036-9f4b-a725dde2500d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:47:59.894792 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099e6af-7385-4036-9f4b-a725dde2500d service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:47:59.903080 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1376/2756] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:47:59 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:48:53.032598 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1e04d-4ab2-484e-987f-1346029229b8 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:48:53.033244 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1e04d-4ab2-484e-987f-1346029229b8 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:48:53.033244 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1e04d-4ab2-484e-987f-1346029229b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:48:53.067387 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-01d1e04d-4ab2-484e-987f-1346029229b8 None None] MFA Rules not processed for user `cecc67c17ecc4b2c8bb526be632f0575`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:48:53.069198 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-01d1e04d-4ab2-484e-987f-1346029229b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:48:53.089627 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1381/2757] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:48:53 2021] POST /identity/v3/auth/tokens => generated 3252 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:48:53.129515 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099e6af-7385-4036-9f4b-a725dde2500d service neutron] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:48:53.131324 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-c099e6af-7385-4036-9f4b-a725dde2500d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:48:53.200611 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099e6af-7385-4036-9f4b-a725dde2500d service neutron] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:48:53.206469 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5ec00-23e0-4b6d-a1e4-17175dbfbc43 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcc415af1f5a42febbdbd187e066cf85', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:48:53.207159 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5ec00-23e0-4b6d-a1e4-17175dbfbc43 service glance] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:48:53.207442 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5ec00-23e0-4b6d-a1e4-17175dbfbc43 service glance] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:48:53.207711 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5ec00-23e0-4b6d-a1e4-17175dbfbc43 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:48:53.209698 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-55b5ec00-23e0-4b6d-a1e4-17175dbfbc43 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:48:53.309029 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5ec00-23e0-4b6d-a1e4-17175dbfbc43 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:48:53.310541 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5ec00-23e0-4b6d-a1e4-17175dbfbc43 service glance] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:48:53.333922 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1377/2758] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:48:53 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:48:53.568573 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1e04d-4ab2-484e-987f-1346029229b8 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:48:53.570480 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-01d1e04d-4ab2-484e-987f-1346029229b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:48:53.588578 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1e04d-4ab2-484e-987f-1346029229b8 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:48:53.593573 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17361287-d13f-464a-81c6-a118c66a3f80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:48:53.594237 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17361287-d13f-464a-81c6-a118c66a3f80 service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:48:53.594509 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17361287-d13f-464a-81c6-a118c66a3f80 service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:48:53.594774 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17361287-d13f-464a-81c6-a118c66a3f80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:48:53.596884 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-17361287-d13f-464a-81c6-a118c66a3f80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:48:53.608712 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17361287-d13f-464a-81c6-a118c66a3f80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:48:53.610069 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17361287-d13f-464a-81c6-a118c66a3f80 service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:48:53.618480 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1382/2759] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:48:53 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:48:55.008768 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5ec00-23e0-4b6d-a1e4-17175dbfbc43 service glance] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:48:55.021858 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5ec00-23e0-4b6d-a1e4-17175dbfbc43 service glance] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:48:55.026360 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1dc49-d31b-414a-8d32-2774e2adb87d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:48:55.027047 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1dc49-d31b-414a-8d32-2774e2adb87d service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:48:55.027325 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1dc49-d31b-414a-8d32-2774e2adb87d service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:48:55.027595 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1dc49-d31b-414a-8d32-2774e2adb87d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:48:55.029596 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-d4b1dc49-d31b-414a-8d32-2774e2adb87d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:48:55.044682 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b1dc49-d31b-414a-8d32-2774e2adb87d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:48:55.046133 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b1dc49-d31b-414a-8d32-2774e2adb87d service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:48:55.057768 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1378/2760] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:48:55 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:48:56.024483 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17361287-d13f-464a-81c6-a118c66a3f80 service neutron] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:48:56.026148 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-17361287-d13f-464a-81c6-a118c66a3f80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:48:56.042752 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17361287-d13f-464a-81c6-a118c66a3f80 service neutron] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:48:56.049241 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab801e07-7b0c-42e4-b570-4c52a819c006 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b954c18d7e9349e899f4c1cd42b89166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:48:56.049932 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab801e07-7b0c-42e4-b570-4c52a819c006 service placement] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:48:56.050212 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab801e07-7b0c-42e4-b570-4c52a819c006 service placement] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:48:56.050485 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab801e07-7b0c-42e4-b570-4c52a819c006 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:48:56.052683 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-ab801e07-7b0c-42e4-b570-4c52a819c006 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:48:56.066167 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab801e07-7b0c-42e4-b570-4c52a819c006 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:48:56.067857 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab801e07-7b0c-42e4-b570-4c52a819c006 service placement] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:48:56.078865 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1383/2761] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:48:56 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:48:59.618758 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1dc49-d31b-414a-8d32-2774e2adb87d service neutron] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:48:59.620219 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-d4b1dc49-d31b-414a-8d32-2774e2adb87d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:48:59.635043 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1dc49-d31b-414a-8d32-2774e2adb87d service neutron] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:48:59.641691 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1475cb5-76ad-47f6-8589-ae61f9da2ded service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b954c18d7e9349e899f4c1cd42b89166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:48:59.642317 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1475cb5-76ad-47f6-8589-ae61f9da2ded service placement] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:48:59.642621 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1475cb5-76ad-47f6-8589-ae61f9da2ded service placement] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:48:59.642978 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1475cb5-76ad-47f6-8589-ae61f9da2ded service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:48:59.653261 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1475cb5-76ad-47f6-8589-ae61f9da2ded service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:48:59.654912 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1475cb5-76ad-47f6-8589-ae61f9da2ded service placement] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:48:59.665558 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1379/2762] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:48:59 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:49:01.955154 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab801e07-7b0c-42e4-b570-4c52a819c006 service placement] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:49:01.956814 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-ab801e07-7b0c-42e4-b570-4c52a819c006 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:49:01.973079 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab801e07-7b0c-42e4-b570-4c52a819c006 service placement] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:49:01.979712 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a5fcb-78f6-4814-b0ba-0aea688efc74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:49:01.980776 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a5fcb-78f6-4814-b0ba-0aea688efc74 service nova] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:49:01.981131 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a5fcb-78f6-4814-b0ba-0aea688efc74 service nova] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:49:01.981494 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72a5fcb-78f6-4814-b0ba-0aea688efc74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:49:01.983753 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-b72a5fcb-78f6-4814-b0ba-0aea688efc74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:49:02.000029 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a5fcb-78f6-4814-b0ba-0aea688efc74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:49:02.002216 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72a5fcb-78f6-4814-b0ba-0aea688efc74 service nova] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:49:02.018236 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1384/2763] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:49:01 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:49:06.315228 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1475cb5-76ad-47f6-8589-ae61f9da2ded service placement] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:49:06.316510 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-d1475cb5-76ad-47f6-8589-ae61f9da2ded service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:49:06.335711 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1475cb5-76ad-47f6-8589-ae61f9da2ded service placement] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:49:06.341916 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027a258-4009-44f9-8d51-a21dafe868ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:49:06.342581 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027a258-4009-44f9-8d51-a21dafe868ab service nova] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:49:06.342874 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027a258-4009-44f9-8d51-a21dafe868ab service nova] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:49:06.343160 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027a258-4009-44f9-8d51-a21dafe868ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:49:06.344962 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-8027a258-4009-44f9-8d51-a21dafe868ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:49:06.358141 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8027a258-4009-44f9-8d51-a21dafe868ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:49:06.359783 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8027a258-4009-44f9-8d51-a21dafe868ab service nova] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:49:06.371374 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1380/2764] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:49:06 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:51:25.011867 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a5fcb-78f6-4814-b0ba-0aea688efc74 service nova] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:51:25.013554 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-b72a5fcb-78f6-4814-b0ba-0aea688efc74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:51:25.028988 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72a5fcb-78f6-4814-b0ba-0aea688efc74 service nova] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:51:25.034425 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d5312-d1c5-48d0-9263-3bd1c7c0deaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:51:25.035112 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d5312-d1c5-48d0-9263-3bd1c7c0deaf service cinder] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:51:25.035397 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d5312-d1c5-48d0-9263-3bd1c7c0deaf service cinder] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:51:25.035671 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d5312-d1c5-48d0-9263-3bd1c7c0deaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:51:25.045606 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d5312-d1c5-48d0-9263-3bd1c7c0deaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:51:25.047167 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d5312-d1c5-48d0-9263-3bd1c7c0deaf service cinder] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:51:25.056700 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1385/2765] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:51:25 2021] GET /identity/v3/auth/tokens => generated 3252 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:53:05.783130 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027a258-4009-44f9-8d51-a21dafe868ab service nova] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:53:05.794988 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027a258-4009-44f9-8d51-a21dafe868ab service nova] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:53:05.799433 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cae0db-8289-4e11-94b1-89e2c93d3357 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:53:05.800163 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cae0db-8289-4e11-94b1-89e2c93d3357 service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:53:05.800444 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cae0db-8289-4e11-94b1-89e2c93d3357 service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:53:05.800724 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cae0db-8289-4e11-94b1-89e2c93d3357 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:53:05.808643 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cae0db-8289-4e11-94b1-89e2c93d3357 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:53:05.810138 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cae0db-8289-4e11-94b1-89e2c93d3357 service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:53:05.819289 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1381/2766] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:53:05 2021] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:54:14.032241 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d5312-d1c5-48d0-9263-3bd1c7c0deaf service cinder] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:54:14.162359 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d5312-d1c5-48d0-9263-3bd1c7c0deaf service cinder] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:54:14.167876 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a3b02d-48df-4b18-b8e8-96fbc70228ac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b954c18d7e9349e899f4c1cd42b89166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:54:14.168532 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3b02d-48df-4b18-b8e8-96fbc70228ac service placement] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:54:14.168819 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3b02d-48df-4b18-b8e8-96fbc70228ac service placement] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:54:14.169093 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3b02d-48df-4b18-b8e8-96fbc70228ac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:54:14.171145 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-53a3b02d-48df-4b18-b8e8-96fbc70228ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:54:14.207988 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a3b02d-48df-4b18-b8e8-96fbc70228ac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:54:14.209602 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a3b02d-48df-4b18-b8e8-96fbc70228ac service placement] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:54:14.220332 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1386/2767] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:54:14 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:55:11.451821 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cae0db-8289-4e11-94b1-89e2c93d3357 service neutron] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:11.471364 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cae0db-8289-4e11-94b1-89e2c93d3357 service neutron] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:11.476058 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8d558-37d2-42d5-acf9-74c85a27aa5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:11.476710 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8d558-37d2-42d5-acf9-74c85a27aa5a service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:11.476985 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8d558-37d2-42d5-acf9-74c85a27aa5a service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:11.477255 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8d558-37d2-42d5-acf9-74c85a27aa5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:11.489344 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a8d558-37d2-42d5-acf9-74c85a27aa5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:11.493288 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a8d558-37d2-42d5-acf9-74c85a27aa5a service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:11.502252 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1382/2768] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:55:11 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:55:12.350109 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a3b02d-48df-4b18-b8e8-96fbc70228ac service placement] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:12.367541 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a3b02d-48df-4b18-b8e8-96fbc70228ac service placement] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:12.375064 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ded50-b25d-43eb-9e52-174568ed9eb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:12.376099 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ded50-b25d-43eb-9e52-174568ed9eb3 service nova] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:12.376560 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ded50-b25d-43eb-9e52-174568ed9eb3 service nova] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:12.377020 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ded50-b25d-43eb-9e52-174568ed9eb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:12.391590 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ded50-b25d-43eb-9e52-174568ed9eb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:12.393331 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ded50-b25d-43eb-9e52-174568ed9eb3 service nova] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:12.405345 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1387/2769] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:55:12 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:55:15.115373 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8d558-37d2-42d5-acf9-74c85a27aa5a service neutron] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:15.124348 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8d558-37d2-42d5-acf9-74c85a27aa5a service neutron] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:15.128863 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e972ba-2b6e-4020-be12-ec667aa4c17e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:15.129510 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e972ba-2b6e-4020-be12-ec667aa4c17e service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:15.129789 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e972ba-2b6e-4020-be12-ec667aa4c17e service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:15.130060 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e972ba-2b6e-4020-be12-ec667aa4c17e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:15.141662 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e972ba-2b6e-4020-be12-ec667aa4c17e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:15.143126 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e972ba-2b6e-4020-be12-ec667aa4c17e service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:15.154745 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1383/2770] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:55:15 2021] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:55:21.038679 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ded50-b25d-43eb-9e52-174568ed9eb3 service nova] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:21.049057 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ded50-b25d-43eb-9e52-174568ed9eb3 service nova] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:21.053747 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778951b-f8e3-44a9-b0e8-b3dcf5f31a86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:21.054524 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778951b-f8e3-44a9-b0e8-b3dcf5f31a86 service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:21.054895 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778951b-f8e3-44a9-b0e8-b3dcf5f31a86 service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:21.055243 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778951b-f8e3-44a9-b0e8-b3dcf5f31a86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:21.058568 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-a778951b-f8e3-44a9-b0e8-b3dcf5f31a86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:21.158722 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a778951b-f8e3-44a9-b0e8-b3dcf5f31a86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:21.160104 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a778951b-f8e3-44a9-b0e8-b3dcf5f31a86 service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:21.180419 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1388/2771] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:55:21 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:55:21.709447 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e972ba-2b6e-4020-be12-ec667aa4c17e service neutron] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:21.711277 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-d1e972ba-2b6e-4020-be12-ec667aa4c17e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:21.725918 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e972ba-2b6e-4020-be12-ec667aa4c17e service neutron] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:21.731317 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e240a71-dff2-43d1-85c0-ac1d0bc2e1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:21.732202 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e240a71-dff2-43d1-85c0-ac1d0bc2e1f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:21.732480 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e240a71-dff2-43d1-85c0-ac1d0bc2e1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:21.732751 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e240a71-dff2-43d1-85c0-ac1d0bc2e1f0 admin admin] PATH_INFO: `/v3/users/cecc67c17ecc4b2c8bb526be632f0575` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:21.733996 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e240a71-dff2-43d1-85c0-ac1d0bc2e1f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cecc67c17ecc4b2c8bb526be632f0575)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:21.735968 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e240a71-dff2-43d1-85c0-ac1d0bc2e1f0 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:21.784738 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-3e240a71-dff2-43d1-85c0-ac1d0bc2e1f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cecc67c17ecc4b2c8bb526be632f0575'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:21.792141 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-3e240a71-dff2-43d1-85c0-ac1d0bc2e1f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cecc67c17ecc4b2c8bb526be632f0575'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:21.804026 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-3e240a71-dff2-43d1-85c0-ac1d0bc2e1f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cecc67c17ecc4b2c8bb526be632f0575'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:21.804882 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-3e240a71-dff2-43d1-85c0-ac1d0bc2e1f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cecc67c17ecc4b2c8bb526be632f0575'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:21.805621 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-3e240a71-dff2-43d1-85c0-ac1d0bc2e1f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cecc67c17ecc4b2c8bb526be632f0575'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:21.823553 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1384/2772] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:55:21 2021] DELETE /identity/v3/users/cecc67c17ecc4b2c8bb526be632f0575 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:55:22.001866 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778951b-f8e3-44a9-b0e8-b3dcf5f31a86 service neutron] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:22.013694 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778951b-f8e3-44a9-b0e8-b3dcf5f31a86 service neutron] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:22.076442 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba6a67-62bd-410d-bb5d-988c88530f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:22.077436 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba6a67-62bd-410d-bb5d-988c88530f57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:22.077785 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba6a67-62bd-410d-bb5d-988c88530f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:22.078060 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba6a67-62bd-410d-bb5d-988c88530f57 admin admin] PATH_INFO: `/v3/projects/753f8f601ebc411e8685be666b507a27` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:22.079321 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba6a67-62bd-410d-bb5d-988c88530f57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=753f8f601ebc411e8685be666b507a27)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:22.081365 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ba6a67-62bd-410d-bb5d-988c88530f57 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:22.138527 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-19ba6a67-62bd-410d-bb5d-988c88530f57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '753f8f601ebc411e8685be666b507a27', 'request_id': 'req-19ba6a67-62bd-410d-bb5d-988c88530f57'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:22.145322 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-19ba6a67-62bd-410d-bb5d-988c88530f57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '753f8f601ebc411e8685be666b507a27', 'request_id': 'req-19ba6a67-62bd-410d-bb5d-988c88530f57'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:22.158522 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-19ba6a67-62bd-410d-bb5d-988c88530f57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '753f8f601ebc411e8685be666b507a27', 'request_id': 'req-19ba6a67-62bd-410d-bb5d-988c88530f57'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:22.175231 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-19ba6a67-62bd-410d-bb5d-988c88530f57 admin admin] The token cache is being invalidate because project 753f8f601ebc411e8685be666b507a27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:55:22.175622 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-19ba6a67-62bd-410d-bb5d-988c88530f57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:22.176054 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-19ba6a67-62bd-410d-bb5d-988c88530f57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:22.177665 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1389/2773] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:55:22 2021] DELETE /identity/v3/projects/753f8f601ebc411e8685be666b507a27 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:55:22.184689 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b066c-77d3-4365-a233-149caeb693a1 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:22.184944 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b066c-77d3-4365-a233-149caeb693a1 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:22.185230 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b066c-77d3-4365-a233-149caeb693a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:22.255487 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-344b066c-77d3-4365-a233-149caeb693a1 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:55:22.256656 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-344b066c-77d3-4365-a233-149caeb693a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:22.321964 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1385/2774] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:55:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:55:22.329745 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b0f2f-ccbf-4f92-b036-45253852e18c None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:22.329986 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b0f2f-ccbf-4f92-b036-45253852e18c None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:22.330296 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b0f2f-ccbf-4f92-b036-45253852e18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:22.349664 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-cc0b0f2f-ccbf-4f92-b036-45253852e18c None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:55:22.350968 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-cc0b0f2f-ccbf-4f92-b036-45253852e18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:22.360788 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1390/2775] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:55:22 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:55:22.365368 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b066c-77d3-4365-a233-149caeb693a1 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:22.375767 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b066c-77d3-4365-a233-149caeb693a1 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:22.380909 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ab2ce-a45d-4d0d-a255-23842e3d0397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:22.381615 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ab2ce-a45d-4d0d-a255-23842e3d0397 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:22.381893 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ab2ce-a45d-4d0d-a255-23842e3d0397 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:22.382161 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ab2ce-a45d-4d0d-a255-23842e3d0397 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:22.382897 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ab2ce-a45d-4d0d-a255-23842e3d0397 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:55:22.383202 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ab2ce-a45d-4d0d-a255-23842e3d0397 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:22.384793 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ab2ce-a45d-4d0d-a255-23842e3d0397 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:22.400142 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1386/2776] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:55:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Nov 29 20:55:22.404705 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b0f2f-ccbf-4f92-b036-45253852e18c None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:22.414558 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b0f2f-ccbf-4f92-b036-45253852e18c None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:22.419962 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929e84f-31fc-4cfa-9cde-2a841308e988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:22.420624 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929e84f-31fc-4cfa-9cde-2a841308e988 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:22.420899 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929e84f-31fc-4cfa-9cde-2a841308e988 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:22.421164 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929e84f-31fc-4cfa-9cde-2a841308e988 admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:22.421863 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c929e84f-31fc-4cfa-9cde-2a841308e988 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:22.423958 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c929e84f-31fc-4cfa-9cde-2a841308e988 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:22.463244 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1391/2777] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:55:22 2021] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:55:22.467810 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ab2ce-a45d-4d0d-a255-23842e3d0397 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:22.479475 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ab2ce-a45d-4d0d-a255-23842e3d0397 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:22.537374 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecaa04a-2e0c-43bf-989e-106928bb4adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:22.537999 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecaa04a-2e0c-43bf-989e-106928bb4adf admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:22.538271 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecaa04a-2e0c-43bf-989e-106928bb4adf admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:22.538546 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecaa04a-2e0c-43bf-989e-106928bb4adf admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:22.539322 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecaa04a-2e0c-43bf-989e-106928bb4adf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:22.541681 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecaa04a-2e0c-43bf-989e-106928bb4adf admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:22.562865 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1387/2778] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:55:22 2021] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:55:22.568406 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929e84f-31fc-4cfa-9cde-2a841308e988 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:22.579364 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929e84f-31fc-4cfa-9cde-2a841308e988 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:22.585280 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175634bc-a0b0-4d79-9c8a-b899b087faf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:22.585947 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175634bc-a0b0-4d79-9c8a-b899b087faf2 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:22.586228 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175634bc-a0b0-4d79-9c8a-b899b087faf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:22.586503 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175634bc-a0b0-4d79-9c8a-b899b087faf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:22.587299 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175634bc-a0b0-4d79-9c8a-b899b087faf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:22.588895 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175634bc-a0b0-4d79-9c8a-b899b087faf2 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:22.599738 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1392/2779] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:55:22 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:55:22.604088 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecaa04a-2e0c-43bf-989e-106928bb4adf admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:22.614892 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecaa04a-2e0c-43bf-989e-106928bb4adf admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:22.620829 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ec0ba-478f-4adc-a972-9ee2d3e9e8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:22.621506 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ec0ba-478f-4adc-a972-9ee2d3e9e8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:22.621786 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ec0ba-478f-4adc-a972-9ee2d3e9e8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:22.622057 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ec0ba-478f-4adc-a972-9ee2d3e9e8c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:22.622799 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ec0ba-478f-4adc-a972-9ee2d3e9e8c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:22.624449 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ec0ba-478f-4adc-a972-9ee2d3e9e8c8 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:22.636138 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1388/2780] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:55:22 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:55:22.641010 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175634bc-a0b0-4d79-9c8a-b899b087faf2 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:22.652627 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175634bc-a0b0-4d79-9c8a-b899b087faf2 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:22.658467 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ec7cc-fff2-427a-97c0-5dd888795060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:22.659403 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ec7cc-fff2-427a-97c0-5dd888795060 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:22.659682 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ec7cc-fff2-427a-97c0-5dd888795060 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:22.659952 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ec7cc-fff2-427a-97c0-5dd888795060 admin admin] PATH_INFO: `/v3/projects/b594e80ff4884683a30d944175d24d9e/users/9c844630aafc476ea510644fef5c5040/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:22.676609 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ec7cc-fff2-427a-97c0-5dd888795060 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b594e80ff4884683a30d944175d24d9e, user_id=9c844630aafc476ea510644fef5c5040, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:22.679425 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ec7cc-fff2-427a-97c0-5dd888795060 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:22.693714 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1393/2781] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:55:22 2021] PUT /identity/v3/projects/b594e80ff4884683a30d944175d24d9e/users/9c844630aafc476ea510644fef5c5040/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:55:22.704325 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce26d56-7b73-44d5-be05-78b4551e5b75 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:22.704614 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce26d56-7b73-44d5-be05-78b4551e5b75 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:22.704885 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce26d56-7b73-44d5-be05-78b4551e5b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:22.735370 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-cce26d56-7b73-44d5-be05-78b4551e5b75 None None] MFA Rules not processed for user `9c844630aafc476ea510644fef5c5040`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:55:22.736610 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-cce26d56-7b73-44d5-be05-78b4551e5b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:22.821268 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1389/2782] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:55:22 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:55:22.832910 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ec7cc-fff2-427a-97c0-5dd888795060 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:22.834807 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-351ec7cc-fff2-427a-97c0-5dd888795060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:22.915013 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ec7cc-fff2-427a-97c0-5dd888795060 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:22.921293 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c12f174-5e8e-4dc3-a620-9362fe158f76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f76a8c3d04e440b92d12ced18d97941', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:22.921960 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12f174-5e8e-4dc3-a620-9362fe158f76 service nova] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:22.922266 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12f174-5e8e-4dc3-a620-9362fe158f76 service nova] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:22.922544 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c12f174-5e8e-4dc3-a620-9362fe158f76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:22.931796 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c12f174-5e8e-4dc3-a620-9362fe158f76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:22.933398 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c12f174-5e8e-4dc3-a620-9362fe158f76 service nova] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:22.943111 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1394/2783] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:55:22 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:55:25.626672 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce26d56-7b73-44d5-be05-78b4551e5b75 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:25.698387 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce26d56-7b73-44d5-be05-78b4551e5b75 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:25.703973 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96737a92-204b-4ce8-b8bf-1e6c63a3d46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:25.704851 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96737a92-204b-4ce8-b8bf-1e6c63a3d46a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:25.705155 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96737a92-204b-4ce8-b8bf-1e6c63a3d46a admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:25.705424 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96737a92-204b-4ce8-b8bf-1e6c63a3d46a admin admin] PATH_INFO: `/v3/users/9c844630aafc476ea510644fef5c5040` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:25.706682 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96737a92-204b-4ce8-b8bf-1e6c63a3d46a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c844630aafc476ea510644fef5c5040)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:25.708665 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96737a92-204b-4ce8-b8bf-1e6c63a3d46a admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:25.761147 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-96737a92-204b-4ce8-b8bf-1e6c63a3d46a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c844630aafc476ea510644fef5c5040'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:25.768777 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-96737a92-204b-4ce8-b8bf-1e6c63a3d46a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c844630aafc476ea510644fef5c5040'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:25.782055 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-96737a92-204b-4ce8-b8bf-1e6c63a3d46a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c844630aafc476ea510644fef5c5040'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:25.783634 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-96737a92-204b-4ce8-b8bf-1e6c63a3d46a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c844630aafc476ea510644fef5c5040'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:25.784592 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-96737a92-204b-4ce8-b8bf-1e6c63a3d46a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c844630aafc476ea510644fef5c5040'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:25.799845 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1390/2784] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:55:25 2021] DELETE /identity/v3/users/9c844630aafc476ea510644fef5c5040 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:55:25.804738 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc071e7-ef5a-4580-84ee-9d7ff78de8b7 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:25.805268 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc071e7-ef5a-4580-84ee-9d7ff78de8b7 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:25.805268 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc071e7-ef5a-4580-84ee-9d7ff78de8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:25.826466 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-7fc071e7-ef5a-4580-84ee-9d7ff78de8b7 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:55:25.828226 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-7fc071e7-ef5a-4580-84ee-9d7ff78de8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:25.895433 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1395/2785] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:55:25 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:55:25.906282 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96737a92-204b-4ce8-b8bf-1e6c63a3d46a admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:25.907485 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-96737a92-204b-4ce8-b8bf-1e6c63a3d46a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:25.968745 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96737a92-204b-4ce8-b8bf-1e6c63a3d46a admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:25.972816 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55413a53-ca45-4d71-a684-59ab8be8b199 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:25.973466 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55413a53-ca45-4d71-a684-59ab8be8b199 service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:25.973744 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55413a53-ca45-4d71-a684-59ab8be8b199 service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:25.974012 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55413a53-ca45-4d71-a684-59ab8be8b199 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:25.984644 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55413a53-ca45-4d71-a684-59ab8be8b199 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:25.986091 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55413a53-ca45-4d71-a684-59ab8be8b199 service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:25.996602 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1391/2786] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:55:25 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:55:26.285883 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc071e7-ef5a-4580-84ee-9d7ff78de8b7 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:26.287331 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-7fc071e7-ef5a-4580-84ee-9d7ff78de8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:26.299527 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc071e7-ef5a-4580-84ee-9d7ff78de8b7 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:26.305180 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fbb1e7-6616-42c4-96f9-a01f903ced49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:26.306069 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbb1e7-6616-42c4-96f9-a01f903ced49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:26.306340 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbb1e7-6616-42c4-96f9-a01f903ced49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:26.306608 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbb1e7-6616-42c4-96f9-a01f903ced49 admin admin] PATH_INFO: `/v3/projects/b594e80ff4884683a30d944175d24d9e` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:26.307886 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fbb1e7-6616-42c4-96f9-a01f903ced49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b594e80ff4884683a30d944175d24d9e)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:26.309809 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fbb1e7-6616-42c4-96f9-a01f903ced49 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:26.359095 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-45fbb1e7-6616-42c4-96f9-a01f903ced49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b594e80ff4884683a30d944175d24d9e', 'request_id': 'req-45fbb1e7-6616-42c4-96f9-a01f903ced49'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:26.366002 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-45fbb1e7-6616-42c4-96f9-a01f903ced49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b594e80ff4884683a30d944175d24d9e', 'request_id': 'req-45fbb1e7-6616-42c4-96f9-a01f903ced49'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:26.374685 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-45fbb1e7-6616-42c4-96f9-a01f903ced49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b594e80ff4884683a30d944175d24d9e', 'request_id': 'req-45fbb1e7-6616-42c4-96f9-a01f903ced49'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:26.385080 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-45fbb1e7-6616-42c4-96f9-a01f903ced49 admin admin] The token cache is being invalidate because project b594e80ff4884683a30d944175d24d9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:55:26.385366 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-45fbb1e7-6616-42c4-96f9-a01f903ced49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:26.386087 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-45fbb1e7-6616-42c4-96f9-a01f903ced49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:26.387874 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1396/2787] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:55:26 2021] DELETE /identity/v3/projects/b594e80ff4884683a30d944175d24d9e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:55:26.393903 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5d253-b149-49e1-955c-ad8cc1ebdc81 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:26.394189 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5d253-b149-49e1-955c-ad8cc1ebdc81 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:26.394515 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5d253-b149-49e1-955c-ad8cc1ebdc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:26.413979 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-96b5d253-b149-49e1-955c-ad8cc1ebdc81 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:55:26.415142 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-96b5d253-b149-49e1-955c-ad8cc1ebdc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:26.478367 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1392/2788] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:55:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:55:26.486605 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a605c-a2e5-4baf-9928-baaf3dcf7df8 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:26.486930 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a605c-a2e5-4baf-9928-baaf3dcf7df8 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:26.487228 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a605c-a2e5-4baf-9928-baaf3dcf7df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:26.507113 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-d28a605c-a2e5-4baf-9928-baaf3dcf7df8 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:55:26.508349 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-d28a605c-a2e5-4baf-9928-baaf3dcf7df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:26.517961 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1397/2789] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:55:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:55:26.522972 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5d253-b149-49e1-955c-ad8cc1ebdc81 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:26.533202 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5d253-b149-49e1-955c-ad8cc1ebdc81 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:26.538790 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fda9ab-a5e9-4d3f-bf27-7bbe9cbbcc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:26.539512 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fda9ab-a5e9-4d3f-bf27-7bbe9cbbcc8b admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:26.539793 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fda9ab-a5e9-4d3f-bf27-7bbe9cbbcc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:26.540090 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fda9ab-a5e9-4d3f-bf27-7bbe9cbbcc8b admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:26.540831 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fda9ab-a5e9-4d3f-bf27-7bbe9cbbcc8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:55:26.541138 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fda9ab-a5e9-4d3f-bf27-7bbe9cbbcc8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:26.542774 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fda9ab-a5e9-4d3f-bf27-7bbe9cbbcc8b admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:26.556222 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1393/2790] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:55:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:55:26.560972 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a605c-a2e5-4baf-9928-baaf3dcf7df8 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:26.571237 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a605c-a2e5-4baf-9928-baaf3dcf7df8 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:26.576873 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4815a2a-6c70-4050-889d-2d877ed9d132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:26.578661 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4815a2a-6c70-4050-889d-2d877ed9d132 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:26.578661 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4815a2a-6c70-4050-889d-2d877ed9d132 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:26.578661 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4815a2a-6c70-4050-889d-2d877ed9d132 admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:26.579064 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4815a2a-6c70-4050-889d-2d877ed9d132 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:26.580697 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4815a2a-6c70-4050-889d-2d877ed9d132 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:26.613155 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1398/2791] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:55:26 2021] POST /identity/v3/projects => generated 363 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:55:26.614377 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fda9ab-a5e9-4d3f-bf27-7bbe9cbbcc8b admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:26.625514 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fda9ab-a5e9-4d3f-bf27-7bbe9cbbcc8b admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:26.685040 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0436b15-ac2c-478c-add8-e47b71903e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:26.685711 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0436b15-ac2c-478c-add8-e47b71903e8c admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:26.685893 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0436b15-ac2c-478c-add8-e47b71903e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:26.686167 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0436b15-ac2c-478c-add8-e47b71903e8c admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:26.686904 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0436b15-ac2c-478c-add8-e47b71903e8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:26.688844 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0436b15-ac2c-478c-add8-e47b71903e8c admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:26.709769 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1394/2792] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:55:26 2021] POST /identity/v3/users => generated 282 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:55:26.714158 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4815a2a-6c70-4050-889d-2d877ed9d132 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:26.725202 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4815a2a-6c70-4050-889d-2d877ed9d132 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:26.731105 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23363c91-5050-4820-b417-0c986bc7fcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:26.731847 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23363c91-5050-4820-b417-0c986bc7fcb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:26.732074 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23363c91-5050-4820-b417-0c986bc7fcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:26.732347 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23363c91-5050-4820-b417-0c986bc7fcb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:26.733095 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23363c91-5050-4820-b417-0c986bc7fcb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:26.734718 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23363c91-5050-4820-b417-0c986bc7fcb9 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:26.748541 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1399/2793] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:55:26 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:55:26.752585 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0436b15-ac2c-478c-add8-e47b71903e8c admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:26.763135 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0436b15-ac2c-478c-add8-e47b71903e8c admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:26.770902 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfdb761-4722-42e6-a882-80c0d6a2a3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:26.771580 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfdb761-4722-42e6-a882-80c0d6a2a3d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:26.771891 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfdb761-4722-42e6-a882-80c0d6a2a3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:26.772169 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfdb761-4722-42e6-a882-80c0d6a2a3d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:26.772907 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfdb761-4722-42e6-a882-80c0d6a2a3d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:26.774517 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfdb761-4722-42e6-a882-80c0d6a2a3d0 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:26.785327 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1395/2794] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:55:26 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:55:26.791476 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23363c91-5050-4820-b417-0c986bc7fcb9 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:26.803034 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23363c91-5050-4820-b417-0c986bc7fcb9 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:26.808081 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b6430-aa46-41f5-a294-84fd2276ccb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:26.808955 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b6430-aa46-41f5-a294-84fd2276ccb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:26.809234 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b6430-aa46-41f5-a294-84fd2276ccb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:26.809511 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b6430-aa46-41f5-a294-84fd2276ccb4 admin admin] PATH_INFO: `/v3/projects/6952e4cc9652479d81a1f0188299ba93/users/a640264f1b0647eebcb5f06097cb7f87/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:26.825594 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b6430-aa46-41f5-a294-84fd2276ccb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6952e4cc9652479d81a1f0188299ba93, user_id=a640264f1b0647eebcb5f06097cb7f87, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:26.828319 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b6430-aa46-41f5-a294-84fd2276ccb4 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:26.842176 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1400/2795] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:55:26 2021] PUT /identity/v3/projects/6952e4cc9652479d81a1f0188299ba93/users/a640264f1b0647eebcb5f06097cb7f87/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:55:26.852635 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8d276-b748-4ee7-9353-351c57e7e20f None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:26.852942 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8d276-b748-4ee7-9353-351c57e7e20f None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:26.853218 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8d276-b748-4ee7-9353-351c57e7e20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:26.880842 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-38a8d276-b748-4ee7-9353-351c57e7e20f None None] MFA Rules not processed for user `a640264f1b0647eebcb5f06097cb7f87`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:55:26.882100 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-38a8d276-b748-4ee7-9353-351c57e7e20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:26.951625 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1396/2796] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:55:26 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:55:26.956324 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b6430-aa46-41f5-a294-84fd2276ccb4 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:27.021230 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b6430-aa46-41f5-a294-84fd2276ccb4 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:27.026394 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d00760-fe0d-42ca-b99b-0735be90fd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:27.027094 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d00760-fe0d-42ca-b99b-0735be90fd8e admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:27.027373 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d00760-fe0d-42ca-b99b-0735be90fd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:27.027643 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d00760-fe0d-42ca-b99b-0735be90fd8e admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:27.028363 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d00760-fe0d-42ca-b99b-0735be90fd8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:27.030261 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d00760-fe0d-42ca-b99b-0735be90fd8e admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:27.061580 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1401/2797] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:55:26 2021] POST /identity/v3/projects => generated 363 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:55:27.065828 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8d276-b748-4ee7-9353-351c57e7e20f None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:27.077011 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8d276-b748-4ee7-9353-351c57e7e20f None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:27.141786 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118488b-e14b-4b2b-ac87-29745854f4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:27.142624 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118488b-e14b-4b2b-ac87-29745854f4ff admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:27.142762 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118488b-e14b-4b2b-ac87-29745854f4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:27.142998 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118488b-e14b-4b2b-ac87-29745854f4ff admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:27.143734 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118488b-e14b-4b2b-ac87-29745854f4ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:27.145973 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118488b-e14b-4b2b-ac87-29745854f4ff admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:27.166768 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1397/2798] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:55:27 2021] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 29 20:55:27.171015 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d00760-fe0d-42ca-b99b-0735be90fd8e admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:27.183709 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d00760-fe0d-42ca-b99b-0735be90fd8e admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:27.189698 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e755ee23-2700-4d28-aa17-45de29ea813f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:27.190413 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755ee23-2700-4d28-aa17-45de29ea813f admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:27.190691 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755ee23-2700-4d28-aa17-45de29ea813f admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:27.190992 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e755ee23-2700-4d28-aa17-45de29ea813f admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:27.191750 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e755ee23-2700-4d28-aa17-45de29ea813f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:27.193365 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e755ee23-2700-4d28-aa17-45de29ea813f admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:27.204329 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1402/2799] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:55:27 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 29 20:55:27.208723 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118488b-e14b-4b2b-ac87-29745854f4ff admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:27.219857 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118488b-e14b-4b2b-ac87-29745854f4ff admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:27.225533 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e7ad2-fdae-41ab-b955-5af5cb9dc494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:27.226431 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e7ad2-fdae-41ab-b955-5af5cb9dc494 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:27.226675 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e7ad2-fdae-41ab-b955-5af5cb9dc494 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:27.227073 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e7ad2-fdae-41ab-b955-5af5cb9dc494 admin admin] PATH_INFO: `/v3/projects/63e1dbd2b5594833b509fdc3edbf37eb/users/2b97527f6e0e44348297fe60b1500ed3/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:27.243151 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e7ad2-fdae-41ab-b955-5af5cb9dc494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63e1dbd2b5594833b509fdc3edbf37eb, user_id=2b97527f6e0e44348297fe60b1500ed3, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:27.245786 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e7ad2-fdae-41ab-b955-5af5cb9dc494 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:27.262599 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1398/2800] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:55:27 2021] PUT /identity/v3/projects/63e1dbd2b5594833b509fdc3edbf37eb/users/2b97527f6e0e44348297fe60b1500ed3/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:55:27.268989 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e755ee23-2700-4d28-aa17-45de29ea813f admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:27.280387 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e755ee23-2700-4d28-aa17-45de29ea813f admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:27.352024 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877b2ad6-9274-4a0b-9af5-17e09e3da339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:27.352706 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b2ad6-9274-4a0b-9af5-17e09e3da339 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:27.353003 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b2ad6-9274-4a0b-9af5-17e09e3da339 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:27.353271 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877b2ad6-9274-4a0b-9af5-17e09e3da339 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:27.354041 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877b2ad6-9274-4a0b-9af5-17e09e3da339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:27.355860 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877b2ad6-9274-4a0b-9af5-17e09e3da339 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:27.366977 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1403/2801] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:55:27 2021] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:55:27.371449 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e7ad2-fdae-41ab-b955-5af5cb9dc494 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:27.382621 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e7ad2-fdae-41ab-b955-5af5cb9dc494 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:27.388622 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f5c83-a11d-4b61-9eee-76f8d7436e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:27.389509 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f5c83-a11d-4b61-9eee-76f8d7436e01 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:27.389792 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f5c83-a11d-4b61-9eee-76f8d7436e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:27.390063 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f5c83-a11d-4b61-9eee-76f8d7436e01 admin admin] PATH_INFO: `/v3/projects/63e1dbd2b5594833b509fdc3edbf37eb/users/2b97527f6e0e44348297fe60b1500ed3/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:27.392243 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f5c83-a11d-4b61-9eee-76f8d7436e01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63e1dbd2b5594833b509fdc3edbf37eb, user_id=2b97527f6e0e44348297fe60b1500ed3, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:27.394905 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f5c83-a11d-4b61-9eee-76f8d7436e01 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:27.407375 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1399/2802] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:55:27 2021] PUT /identity/v3/projects/63e1dbd2b5594833b509fdc3edbf37eb/users/2b97527f6e0e44348297fe60b1500ed3/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:55:27.417979 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069a4f0-d6f6-4658-87be-c9ee390ce65b None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:27.418359 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069a4f0-d6f6-4658-87be-c9ee390ce65b None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:27.418641 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069a4f0-d6f6-4658-87be-c9ee390ce65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:27.446952 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-4069a4f0-d6f6-4658-87be-c9ee390ce65b None None] MFA Rules not processed for user `2b97527f6e0e44348297fe60b1500ed3`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:55:27.448171 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-4069a4f0-d6f6-4658-87be-c9ee390ce65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:27.524663 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1404/2803] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:55:27 2021] POST /identity/v3/auth/tokens => generated 3297 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:55:27.535479 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f5c83-a11d-4b61-9eee-76f8d7436e01 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:27.537261 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-9f7f5c83-a11d-4b61-9eee-76f8d7436e01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:27.600370 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f5c83-a11d-4b61-9eee-76f8d7436e01 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:27.604925 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c9c16c-b47c-42c5-8ee6-fd0a957c3cae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:27.605582 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9c16c-b47c-42c5-8ee6-fd0a957c3cae service cinder] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:27.605858 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9c16c-b47c-42c5-8ee6-fd0a957c3cae service cinder] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:27.606128 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9c16c-b47c-42c5-8ee6-fd0a957c3cae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:27.617225 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c9c16c-b47c-42c5-8ee6-fd0a957c3cae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:27.618679 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c9c16c-b47c-42c5-8ee6-fd0a957c3cae service cinder] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:27.628881 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1400/2804] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:55:27 2021] GET /identity/v3/auth/tokens => generated 3297 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:55:27.804425 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069a4f0-d6f6-4658-87be-c9ee390ce65b None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:27.870599 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069a4f0-d6f6-4658-87be-c9ee390ce65b None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:27.875778 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ac5b9-4b9d-42fa-ab4e-cdb80e9250d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:27.876655 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ac5b9-4b9d-42fa-ab4e-cdb80e9250d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:27.876903 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ac5b9-4b9d-42fa-ab4e-cdb80e9250d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:27.877202 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56ac5b9-4b9d-42fa-ab4e-cdb80e9250d5 admin admin] PATH_INFO: `/v3/users/a640264f1b0647eebcb5f06097cb7f87` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:27.878426 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ac5b9-4b9d-42fa-ab4e-cdb80e9250d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a640264f1b0647eebcb5f06097cb7f87)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:27.880373 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56ac5b9-4b9d-42fa-ab4e-cdb80e9250d5 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:27.933066 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-f56ac5b9-4b9d-42fa-ab4e-cdb80e9250d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a640264f1b0647eebcb5f06097cb7f87'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:27.942800 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-f56ac5b9-4b9d-42fa-ab4e-cdb80e9250d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a640264f1b0647eebcb5f06097cb7f87'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:27.953818 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-f56ac5b9-4b9d-42fa-ab4e-cdb80e9250d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a640264f1b0647eebcb5f06097cb7f87'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:27.970823 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-f56ac5b9-4b9d-42fa-ab4e-cdb80e9250d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a640264f1b0647eebcb5f06097cb7f87'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:27.971643 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-f56ac5b9-4b9d-42fa-ab4e-cdb80e9250d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a640264f1b0647eebcb5f06097cb7f87'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:27.979743 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1405/2805] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:55:27 2021] DELETE /identity/v3/users/a640264f1b0647eebcb5f06097cb7f87 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:55:27.985535 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39003ca1-fe20-4c45-97e5-840fc8d2517f None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:27.986066 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39003ca1-fe20-4c45-97e5-840fc8d2517f None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:27.986066 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39003ca1-fe20-4c45-97e5-840fc8d2517f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:28.005209 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-39003ca1-fe20-4c45-97e5-840fc8d2517f None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:55:28.006436 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-39003ca1-fe20-4c45-97e5-840fc8d2517f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:28.072330 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1401/2806] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:55:27 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:55:28.082561 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ac5b9-4b9d-42fa-ab4e-cdb80e9250d5 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:28.084134 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-f56ac5b9-4b9d-42fa-ab4e-cdb80e9250d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:28.144686 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56ac5b9-4b9d-42fa-ab4e-cdb80e9250d5 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:28.148987 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c77ec50-05af-4b9b-9f5c-5bad868924be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:28.149640 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77ec50-05af-4b9b-9f5c-5bad868924be service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:28.149914 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77ec50-05af-4b9b-9f5c-5bad868924be service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:28.150185 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77ec50-05af-4b9b-9f5c-5bad868924be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:28.160192 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c77ec50-05af-4b9b-9f5c-5bad868924be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:28.161640 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c77ec50-05af-4b9b-9f5c-5bad868924be service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:28.172364 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1406/2807] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:55:28 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:55:28.452000 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39003ca1-fe20-4c45-97e5-840fc8d2517f None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:28.454439 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-39003ca1-fe20-4c45-97e5-840fc8d2517f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:28.467995 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39003ca1-fe20-4c45-97e5-840fc8d2517f None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:28.473364 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a252c-7a8c-49e2-bc5a-413499a05cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:28.474402 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a252c-7a8c-49e2-bc5a-413499a05cb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:28.474678 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a252c-7a8c-49e2-bc5a-413499a05cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:28.474961 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6a252c-7a8c-49e2-bc5a-413499a05cb9 admin admin] PATH_INFO: `/v3/projects/6952e4cc9652479d81a1f0188299ba93` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:28.477079 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a252c-7a8c-49e2-bc5a-413499a05cb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6952e4cc9652479d81a1f0188299ba93)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:28.479021 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6a252c-7a8c-49e2-bc5a-413499a05cb9 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:28.531027 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-4f6a252c-7a8c-49e2-bc5a-413499a05cb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6952e4cc9652479d81a1f0188299ba93', 'request_id': 'req-4f6a252c-7a8c-49e2-bc5a-413499a05cb9'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:28.537233 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-4f6a252c-7a8c-49e2-bc5a-413499a05cb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6952e4cc9652479d81a1f0188299ba93', 'request_id': 'req-4f6a252c-7a8c-49e2-bc5a-413499a05cb9'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:28.542919 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-4f6a252c-7a8c-49e2-bc5a-413499a05cb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6952e4cc9652479d81a1f0188299ba93', 'request_id': 'req-4f6a252c-7a8c-49e2-bc5a-413499a05cb9'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:28.556584 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-4f6a252c-7a8c-49e2-bc5a-413499a05cb9 admin admin] The token cache is being invalidate because project 6952e4cc9652479d81a1f0188299ba93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:55:28.556876 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-4f6a252c-7a8c-49e2-bc5a-413499a05cb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:28.557660 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-4f6a252c-7a8c-49e2-bc5a-413499a05cb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:28.559412 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1402/2808] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:55:28 2021] DELETE /identity/v3/projects/6952e4cc9652479d81a1f0188299ba93 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:55:28.563513 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c77ec50-05af-4b9b-9f5c-5bad868924be service neutron] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:28.573177 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c77ec50-05af-4b9b-9f5c-5bad868924be service neutron] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:28.635172 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611209f0-752d-4439-99e4-bd57aa794bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:28.635972 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611209f0-752d-4439-99e4-bd57aa794bca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:28.636246 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611209f0-752d-4439-99e4-bd57aa794bca admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:28.636516 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611209f0-752d-4439-99e4-bd57aa794bca admin admin] PATH_INFO: `/v3/users/2b97527f6e0e44348297fe60b1500ed3` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:28.637849 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611209f0-752d-4439-99e4-bd57aa794bca admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b97527f6e0e44348297fe60b1500ed3)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:28.639817 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611209f0-752d-4439-99e4-bd57aa794bca admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:28.691846 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-611209f0-752d-4439-99e4-bd57aa794bca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b97527f6e0e44348297fe60b1500ed3'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:28.698864 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-611209f0-752d-4439-99e4-bd57aa794bca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b97527f6e0e44348297fe60b1500ed3'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:28.707099 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-611209f0-752d-4439-99e4-bd57aa794bca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b97527f6e0e44348297fe60b1500ed3'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:28.719020 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-611209f0-752d-4439-99e4-bd57aa794bca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b97527f6e0e44348297fe60b1500ed3'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:28.719789 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-611209f0-752d-4439-99e4-bd57aa794bca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b97527f6e0e44348297fe60b1500ed3'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:28.726059 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1407/2809] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:55:28 2021] DELETE /identity/v3/users/2b97527f6e0e44348297fe60b1500ed3 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:55:29.017850 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a252c-7a8c-49e2-bc5a-413499a05cb9 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:29.019483 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-4f6a252c-7a8c-49e2-bc5a-413499a05cb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:29.038010 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6a252c-7a8c-49e2-bc5a-413499a05cb9 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:29.109676 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227a9ca-88c6-4ebc-a2e5-6c978d3f5869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:29.110608 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227a9ca-88c6-4ebc-a2e5-6c978d3f5869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:29.110891 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227a9ca-88c6-4ebc-a2e5-6c978d3f5869 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:29.111198 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227a9ca-88c6-4ebc-a2e5-6c978d3f5869 admin admin] PATH_INFO: `/v3/projects/63e1dbd2b5594833b509fdc3edbf37eb` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:29.112408 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c227a9ca-88c6-4ebc-a2e5-6c978d3f5869 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63e1dbd2b5594833b509fdc3edbf37eb)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:29.114332 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c227a9ca-88c6-4ebc-a2e5-6c978d3f5869 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:29.169070 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-c227a9ca-88c6-4ebc-a2e5-6c978d3f5869 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63e1dbd2b5594833b509fdc3edbf37eb', 'request_id': 'req-c227a9ca-88c6-4ebc-a2e5-6c978d3f5869'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:29.175996 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-c227a9ca-88c6-4ebc-a2e5-6c978d3f5869 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63e1dbd2b5594833b509fdc3edbf37eb', 'request_id': 'req-c227a9ca-88c6-4ebc-a2e5-6c978d3f5869'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:29.182352 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-c227a9ca-88c6-4ebc-a2e5-6c978d3f5869 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63e1dbd2b5594833b509fdc3edbf37eb', 'request_id': 'req-c227a9ca-88c6-4ebc-a2e5-6c978d3f5869'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:29.202725 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-c227a9ca-88c6-4ebc-a2e5-6c978d3f5869 admin admin] The token cache is being invalidate because project 63e1dbd2b5594833b509fdc3edbf37eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:55:29.203080 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-c227a9ca-88c6-4ebc-a2e5-6c978d3f5869 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:29.203688 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-c227a9ca-88c6-4ebc-a2e5-6c978d3f5869 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:29.205258 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1403/2810] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:55:29 2021] DELETE /identity/v3/projects/63e1dbd2b5594833b509fdc3edbf37eb => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:55:29.211302 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe07a9-ed49-47f2-afb6-3b3cb2a72eb1 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:29.211811 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe07a9-ed49-47f2-afb6-3b3cb2a72eb1 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:29.211916 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe07a9-ed49-47f2-afb6-3b3cb2a72eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:29.230806 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-83fe07a9-ed49-47f2-afb6-3b3cb2a72eb1 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:55:29.232059 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-83fe07a9-ed49-47f2-afb6-3b3cb2a72eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:29.294935 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1408/2811] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:55:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:55:29.304580 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0d6cf-9720-4506-9f69-b676fbfa324c None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:29.304825 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0d6cf-9720-4506-9f69-b676fbfa324c None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:29.305120 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0d6cf-9720-4506-9f69-b676fbfa324c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:29.324022 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-1af0d6cf-9720-4506-9f69-b676fbfa324c None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:55:29.325251 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-1af0d6cf-9720-4506-9f69-b676fbfa324c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:29.333861 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1404/2812] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:55:29 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:55:29.338372 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe07a9-ed49-47f2-afb6-3b3cb2a72eb1 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:29.348528 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fe07a9-ed49-47f2-afb6-3b3cb2a72eb1 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:29.356856 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39b109-e735-4aa1-aafd-4c54c8a10fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:29.358031 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39b109-e735-4aa1-aafd-4c54c8a10fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:29.358427 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39b109-e735-4aa1-aafd-4c54c8a10fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:29.358880 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39b109-e735-4aa1-aafd-4c54c8a10fb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:29.359816 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f39b109-e735-4aa1-aafd-4c54c8a10fb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:55:29.360117 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f39b109-e735-4aa1-aafd-4c54c8a10fb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:29.361769 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f39b109-e735-4aa1-aafd-4c54c8a10fb7 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:29.374839 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1409/2813] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:55:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:55:29.379721 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0d6cf-9720-4506-9f69-b676fbfa324c None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:29.391399 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0d6cf-9720-4506-9f69-b676fbfa324c None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:29.398884 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d941b71-7cc1-4317-98f5-73c807d09771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:29.399962 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d941b71-7cc1-4317-98f5-73c807d09771 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:29.400371 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d941b71-7cc1-4317-98f5-73c807d09771 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:29.400777 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d941b71-7cc1-4317-98f5-73c807d09771 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:29.401858 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d941b71-7cc1-4317-98f5-73c807d09771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:29.404709 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d941b71-7cc1-4317-98f5-73c807d09771 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:29.435099 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1405/2814] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:55:29 2021] POST /identity/v3/projects => generated 363 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:55:29.439735 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39b109-e735-4aa1-aafd-4c54c8a10fb7 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:29.450209 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39b109-e735-4aa1-aafd-4c54c8a10fb7 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:29.521522 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869e182-5805-4eed-bdc7-50e4c4427e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:29.522272 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869e182-5805-4eed-bdc7-50e4c4427e53 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:29.522556 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869e182-5805-4eed-bdc7-50e4c4427e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:29.522835 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9869e182-5805-4eed-bdc7-50e4c4427e53 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:29.523590 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9869e182-5805-4eed-bdc7-50e4c4427e53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:29.525543 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9869e182-5805-4eed-bdc7-50e4c4427e53 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:29.552982 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1410/2815] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:55:29 2021] POST /identity/v3/users => generated 282 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 29 20:55:29.557161 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d941b71-7cc1-4317-98f5-73c807d09771 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:29.568806 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d941b71-7cc1-4317-98f5-73c807d09771 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:29.574065 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1b2e6-41da-40c4-a3d7-d8a8dfd5f6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:29.574748 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1b2e6-41da-40c4-a3d7-d8a8dfd5f6eb admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:29.575054 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1b2e6-41da-40c4-a3d7-d8a8dfd5f6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:29.575329 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1b2e6-41da-40c4-a3d7-d8a8dfd5f6eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:29.576080 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de1b2e6-41da-40c4-a3d7-d8a8dfd5f6eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:29.577691 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de1b2e6-41da-40c4-a3d7-d8a8dfd5f6eb admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:29.589301 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1406/2816] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:55:29 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:55:29.595282 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869e182-5805-4eed-bdc7-50e4c4427e53 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:29.606735 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9869e182-5805-4eed-bdc7-50e4c4427e53 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:29.613966 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688080a-958e-44aa-9fc7-536ae33a0704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:29.614647 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688080a-958e-44aa-9fc7-536ae33a0704 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:29.614964 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688080a-958e-44aa-9fc7-536ae33a0704 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:29.615716 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688080a-958e-44aa-9fc7-536ae33a0704 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:29.615979 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688080a-958e-44aa-9fc7-536ae33a0704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:29.617563 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688080a-958e-44aa-9fc7-536ae33a0704 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:29.632353 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1411/2817] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:55:29 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:55:29.636564 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1b2e6-41da-40c4-a3d7-d8a8dfd5f6eb admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:29.647292 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1b2e6-41da-40c4-a3d7-d8a8dfd5f6eb admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:29.658954 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3540c910-a28c-45d5-9d47-372ce3ba4906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:29.659847 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540c910-a28c-45d5-9d47-372ce3ba4906 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:29.660118 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540c910-a28c-45d5-9d47-372ce3ba4906 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:29.660391 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3540c910-a28c-45d5-9d47-372ce3ba4906 admin admin] PATH_INFO: `/v3/projects/3c71077c01f946609d8918b5e586642a/users/9a766013d7a74c2687f567ebaf302840/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:29.676786 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3540c910-a28c-45d5-9d47-372ce3ba4906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c71077c01f946609d8918b5e586642a, user_id=9a766013d7a74c2687f567ebaf302840, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:29.679539 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3540c910-a28c-45d5-9d47-372ce3ba4906 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:29.693745 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1407/2818] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:55:29 2021] PUT /identity/v3/projects/3c71077c01f946609d8918b5e586642a/users/9a766013d7a74c2687f567ebaf302840/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:55:29.704696 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334966a-645a-4f28-ae1f-644d5c41f159 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:29.704937 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334966a-645a-4f28-ae1f-644d5c41f159 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:29.705238 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334966a-645a-4f28-ae1f-644d5c41f159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:29.736125 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-4334966a-645a-4f28-ae1f-644d5c41f159 None None] MFA Rules not processed for user `9a766013d7a74c2687f567ebaf302840`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:55:29.737409 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-4334966a-645a-4f28-ae1f-644d5c41f159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:29.815963 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1412/2819] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:55:29 2021] POST /identity/v3/auth/tokens => generated 3230 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:55:29.821658 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3540c910-a28c-45d5-9d47-372ce3ba4906 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:29.892418 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3540c910-a28c-45d5-9d47-372ce3ba4906 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:29.898693 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709ad29-3667-441e-80ac-1a566956a79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:29.899420 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709ad29-3667-441e-80ac-1a566956a79b admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:29.899691 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709ad29-3667-441e-80ac-1a566956a79b admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:29.899954 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709ad29-3667-441e-80ac-1a566956a79b admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:29.900695 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6709ad29-3667-441e-80ac-1a566956a79b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:29.902645 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6709ad29-3667-441e-80ac-1a566956a79b admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:29.931930 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1408/2820] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:55:29 2021] POST /identity/v3/projects => generated 363 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:55:29.935750 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334966a-645a-4f28-ae1f-644d5c41f159 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:29.947631 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334966a-645a-4f28-ae1f-644d5c41f159 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:30.005478 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef96453-190f-49d0-a249-00563db996d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:30.006163 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef96453-190f-49d0-a249-00563db996d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:30.006468 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef96453-190f-49d0-a249-00563db996d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:30.006748 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef96453-190f-49d0-a249-00563db996d6 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:30.007491 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef96453-190f-49d0-a249-00563db996d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:30.009432 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef96453-190f-49d0-a249-00563db996d6 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:30.032653 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1413/2821] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:55:29 2021] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:55:30.036916 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709ad29-3667-441e-80ac-1a566956a79b admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:30.047448 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709ad29-3667-441e-80ac-1a566956a79b admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:30.052813 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998c4bc-3568-4c1a-8062-759df4e445a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:30.053548 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998c4bc-3568-4c1a-8062-759df4e445a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:30.053858 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998c4bc-3568-4c1a-8062-759df4e445a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:30.054100 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998c4bc-3568-4c1a-8062-759df4e445a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:30.054893 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3998c4bc-3568-4c1a-8062-759df4e445a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:30.056502 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3998c4bc-3568-4c1a-8062-759df4e445a7 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:30.068218 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1409/2822] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:55:30 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 29 20:55:30.074732 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef96453-190f-49d0-a249-00563db996d6 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:30.085282 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef96453-190f-49d0-a249-00563db996d6 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:30.094762 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5552121-63f5-4dcd-93a8-8fc91a23ab67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:30.095709 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5552121-63f5-4dcd-93a8-8fc91a23ab67 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:30.095994 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5552121-63f5-4dcd-93a8-8fc91a23ab67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:30.096271 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5552121-63f5-4dcd-93a8-8fc91a23ab67 admin admin] PATH_INFO: `/v3/projects/7b4471a939ec4d058f01fefe89f9b72b/users/50a7ede7ccb8476a99f10d2c3842e944/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:30.111953 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5552121-63f5-4dcd-93a8-8fc91a23ab67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b4471a939ec4d058f01fefe89f9b72b, user_id=50a7ede7ccb8476a99f10d2c3842e944, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:30.114633 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5552121-63f5-4dcd-93a8-8fc91a23ab67 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:30.130746 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1414/2823] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:55:30 2021] PUT /identity/v3/projects/7b4471a939ec4d058f01fefe89f9b72b/users/50a7ede7ccb8476a99f10d2c3842e944/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:55:30.135568 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998c4bc-3568-4c1a-8062-759df4e445a7 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:30.145981 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998c4bc-3568-4c1a-8062-759df4e445a7 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:30.209792 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9377c0-db9f-4b84-8688-1c9c817aed84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:30.210375 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9377c0-db9f-4b84-8688-1c9c817aed84 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:30.210648 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9377c0-db9f-4b84-8688-1c9c817aed84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:30.210960 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9377c0-db9f-4b84-8688-1c9c817aed84 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:30.213198 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9377c0-db9f-4b84-8688-1c9c817aed84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:30.213354 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9377c0-db9f-4b84-8688-1c9c817aed84 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:30.223785 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1410/2824] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:55:30 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:55:30.228275 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5552121-63f5-4dcd-93a8-8fc91a23ab67 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:30.239571 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5552121-63f5-4dcd-93a8-8fc91a23ab67 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:30.245537 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed3d9a-bf33-4adb-ac6a-abe11cb38df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:30.246430 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed3d9a-bf33-4adb-ac6a-abe11cb38df2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:30.246702 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed3d9a-bf33-4adb-ac6a-abe11cb38df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:30.247003 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed3d9a-bf33-4adb-ac6a-abe11cb38df2 admin admin] PATH_INFO: `/v3/projects/7b4471a939ec4d058f01fefe89f9b72b/users/50a7ede7ccb8476a99f10d2c3842e944/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:30.249192 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed3d9a-bf33-4adb-ac6a-abe11cb38df2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b4471a939ec4d058f01fefe89f9b72b, user_id=50a7ede7ccb8476a99f10d2c3842e944, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:30.252016 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed3d9a-bf33-4adb-ac6a-abe11cb38df2 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:30.263957 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1415/2825] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:55:30 2021] PUT /identity/v3/projects/7b4471a939ec4d058f01fefe89f9b72b/users/50a7ede7ccb8476a99f10d2c3842e944/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:55:30.274842 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad87cf-b73d-4408-adee-263ab2ccfba4 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:30.275180 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad87cf-b73d-4408-adee-263ab2ccfba4 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:30.275457 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad87cf-b73d-4408-adee-263ab2ccfba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:30.303987 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-6fad87cf-b73d-4408-adee-263ab2ccfba4 None None] MFA Rules not processed for user `50a7ede7ccb8476a99f10d2c3842e944`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:55:30.305236 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-6fad87cf-b73d-4408-adee-263ab2ccfba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:30.388800 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1411/2826] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:55:30 2021] POST /identity/v3/auth/tokens => generated 3297 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:55:30.400214 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed3d9a-bf33-4adb-ac6a-abe11cb38df2 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:30.402463 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-73ed3d9a-bf33-4adb-ac6a-abe11cb38df2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:30.474354 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed3d9a-bf33-4adb-ac6a-abe11cb38df2 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:30.478289 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cbf9c9-b809-4f56-9d76-c849d0067788 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:30.478980 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbf9c9-b809-4f56-9d76-c849d0067788 service cinder] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:30.479265 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbf9c9-b809-4f56-9d76-c849d0067788 service cinder] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:30.479539 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbf9c9-b809-4f56-9d76-c849d0067788 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:30.488929 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cbf9c9-b809-4f56-9d76-c849d0067788 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:30.490357 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cbf9c9-b809-4f56-9d76-c849d0067788 service cinder] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:30.499632 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1416/2827] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:55:30 2021] GET /identity/v3/auth/tokens => generated 3297 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:55:30.574676 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad87cf-b73d-4408-adee-263ab2ccfba4 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:30.584737 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad87cf-b73d-4408-adee-263ab2ccfba4 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:30.589065 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439d99f-ca77-4bfa-8281-ffad399544cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:30.589719 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439d99f-ca77-4bfa-8281-ffad399544cc service cinder] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:30.589998 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439d99f-ca77-4bfa-8281-ffad399544cc service cinder] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:30.590272 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439d99f-ca77-4bfa-8281-ffad399544cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:30.651941 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e439d99f-ca77-4bfa-8281-ffad399544cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:30.653400 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e439d99f-ca77-4bfa-8281-ffad399544cc service cinder] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:30.663343 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1412/2828] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:55:30 2021] GET /identity/v3/auth/tokens => generated 3230 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:55:39.821249 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cbf9c9-b809-4f56-9d76-c849d0067788 service cinder] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:39.886709 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cbf9c9-b809-4f56-9d76-c849d0067788 service cinder] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:39.892024 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e092eb3-d810-40d2-8f04-496ce2918258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:39.892921 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e092eb3-d810-40d2-8f04-496ce2918258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:39.893198 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e092eb3-d810-40d2-8f04-496ce2918258 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:39.893475 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e092eb3-d810-40d2-8f04-496ce2918258 admin admin] PATH_INFO: `/v3/users/9a766013d7a74c2687f567ebaf302840` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:39.894704 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e092eb3-d810-40d2-8f04-496ce2918258 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a766013d7a74c2687f567ebaf302840)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:39.897020 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e092eb3-d810-40d2-8f04-496ce2918258 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:39.942674 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-4e092eb3-d810-40d2-8f04-496ce2918258 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a766013d7a74c2687f567ebaf302840'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:39.950173 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-4e092eb3-d810-40d2-8f04-496ce2918258 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a766013d7a74c2687f567ebaf302840'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:39.961476 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-4e092eb3-d810-40d2-8f04-496ce2918258 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a766013d7a74c2687f567ebaf302840'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:39.982399 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-4e092eb3-d810-40d2-8f04-496ce2918258 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a766013d7a74c2687f567ebaf302840'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:39.983288 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-4e092eb3-d810-40d2-8f04-496ce2918258 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a766013d7a74c2687f567ebaf302840'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:39.990041 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1417/2829] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:55:39 2021] DELETE /identity/v3/users/9a766013d7a74c2687f567ebaf302840 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:55:39.994832 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718a6e7-cc06-4f8f-ba05-f283d8a79595 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:39.995406 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718a6e7-cc06-4f8f-ba05-f283d8a79595 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:39.995406 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718a6e7-cc06-4f8f-ba05-f283d8a79595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:40.016309 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-0718a6e7-cc06-4f8f-ba05-f283d8a79595 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:55:40.017551 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-0718a6e7-cc06-4f8f-ba05-f283d8a79595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:40.080523 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1413/2830] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:55:39 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:55:40.092421 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e092eb3-d810-40d2-8f04-496ce2918258 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:40.094030 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-4e092eb3-d810-40d2-8f04-496ce2918258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:40.153049 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e092eb3-d810-40d2-8f04-496ce2918258 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:40.156741 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83e749-30ff-42db-9363-92d1c151ac5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:40.157387 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83e749-30ff-42db-9363-92d1c151ac5e service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:40.157665 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83e749-30ff-42db-9363-92d1c151ac5e service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:40.157932 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83e749-30ff-42db-9363-92d1c151ac5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:40.168294 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f83e749-30ff-42db-9363-92d1c151ac5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:40.169749 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f83e749-30ff-42db-9363-92d1c151ac5e service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:40.179912 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1418/2831] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:55:40 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:55:40.476362 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718a6e7-cc06-4f8f-ba05-f283d8a79595 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:40.477816 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-0718a6e7-cc06-4f8f-ba05-f283d8a79595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:40.490272 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718a6e7-cc06-4f8f-ba05-f283d8a79595 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:40.496775 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e084f9-d3f0-46b2-bf2f-8810bc587bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:40.497639 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e084f9-d3f0-46b2-bf2f-8810bc587bd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:40.498075 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e084f9-d3f0-46b2-bf2f-8810bc587bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:40.498521 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e084f9-d3f0-46b2-bf2f-8810bc587bd0 admin admin] PATH_INFO: `/v3/projects/3c71077c01f946609d8918b5e586642a` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:40.499899 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e084f9-d3f0-46b2-bf2f-8810bc587bd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c71077c01f946609d8918b5e586642a)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:40.501915 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e084f9-d3f0-46b2-bf2f-8810bc587bd0 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:40.550869 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-72e084f9-d3f0-46b2-bf2f-8810bc587bd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c71077c01f946609d8918b5e586642a', 'request_id': 'req-72e084f9-d3f0-46b2-bf2f-8810bc587bd0'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:40.557708 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-72e084f9-d3f0-46b2-bf2f-8810bc587bd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c71077c01f946609d8918b5e586642a', 'request_id': 'req-72e084f9-d3f0-46b2-bf2f-8810bc587bd0'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:40.564188 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-72e084f9-d3f0-46b2-bf2f-8810bc587bd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c71077c01f946609d8918b5e586642a', 'request_id': 'req-72e084f9-d3f0-46b2-bf2f-8810bc587bd0'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:40.577940 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-72e084f9-d3f0-46b2-bf2f-8810bc587bd0 admin admin] The token cache is being invalidate because project 3c71077c01f946609d8918b5e586642a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:55:40.578211 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-72e084f9-d3f0-46b2-bf2f-8810bc587bd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:40.578930 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-72e084f9-d3f0-46b2-bf2f-8810bc587bd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:40.580511 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1414/2832] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:55:40 2021] DELETE /identity/v3/projects/3c71077c01f946609d8918b5e586642a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:55:40.584788 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83e749-30ff-42db-9363-92d1c151ac5e service neutron] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:40.595308 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83e749-30ff-42db-9363-92d1c151ac5e service neutron] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:40.651951 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18eeff4-4821-4481-b451-392226b19ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:40.652812 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18eeff4-4821-4481-b451-392226b19ef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:40.653087 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18eeff4-4821-4481-b451-392226b19ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:40.653354 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18eeff4-4821-4481-b451-392226b19ef3 admin admin] PATH_INFO: `/v3/users/50a7ede7ccb8476a99f10d2c3842e944` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:40.654566 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18eeff4-4821-4481-b451-392226b19ef3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50a7ede7ccb8476a99f10d2c3842e944)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:40.656499 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18eeff4-4821-4481-b451-392226b19ef3 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:40.709418 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-a18eeff4-4821-4481-b451-392226b19ef3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50a7ede7ccb8476a99f10d2c3842e944'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:40.716452 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-a18eeff4-4821-4481-b451-392226b19ef3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50a7ede7ccb8476a99f10d2c3842e944'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:40.724993 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-a18eeff4-4821-4481-b451-392226b19ef3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50a7ede7ccb8476a99f10d2c3842e944'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:40.736822 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-a18eeff4-4821-4481-b451-392226b19ef3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50a7ede7ccb8476a99f10d2c3842e944'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:40.737519 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-a18eeff4-4821-4481-b451-392226b19ef3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50a7ede7ccb8476a99f10d2c3842e944'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:40.743916 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1419/2833] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:55:40 2021] DELETE /identity/v3/users/50a7ede7ccb8476a99f10d2c3842e944 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:55:41.038994 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e084f9-d3f0-46b2-bf2f-8810bc587bd0 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:41.040522 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-72e084f9-d3f0-46b2-bf2f-8810bc587bd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:41.057049 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e084f9-d3f0-46b2-bf2f-8810bc587bd0 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:41.115288 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a8909-230a-4c65-a91a-bfaede67fa10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:41.116202 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a8909-230a-4c65-a91a-bfaede67fa10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:41.116462 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a8909-230a-4c65-a91a-bfaede67fa10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:41.116733 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a8909-230a-4c65-a91a-bfaede67fa10 admin admin] PATH_INFO: `/v3/projects/7b4471a939ec4d058f01fefe89f9b72b` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:41.117952 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a8909-230a-4c65-a91a-bfaede67fa10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b4471a939ec4d058f01fefe89f9b72b)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:41.119935 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a8909-230a-4c65-a91a-bfaede67fa10 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:41.171029 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-7e6a8909-230a-4c65-a91a-bfaede67fa10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b4471a939ec4d058f01fefe89f9b72b', 'request_id': 'req-7e6a8909-230a-4c65-a91a-bfaede67fa10'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:41.177862 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-7e6a8909-230a-4c65-a91a-bfaede67fa10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b4471a939ec4d058f01fefe89f9b72b', 'request_id': 'req-7e6a8909-230a-4c65-a91a-bfaede67fa10'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:41.184123 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-7e6a8909-230a-4c65-a91a-bfaede67fa10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b4471a939ec4d058f01fefe89f9b72b', 'request_id': 'req-7e6a8909-230a-4c65-a91a-bfaede67fa10'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:41.200830 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-7e6a8909-230a-4c65-a91a-bfaede67fa10 admin admin] The token cache is being invalidate because project 7b4471a939ec4d058f01fefe89f9b72b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:55:41.201107 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-7e6a8909-230a-4c65-a91a-bfaede67fa10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:41.201813 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-7e6a8909-230a-4c65-a91a-bfaede67fa10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:41.203554 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1415/2834] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:55:41 2021] DELETE /identity/v3/projects/7b4471a939ec4d058f01fefe89f9b72b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:55:41.210213 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e857a-23c0-4550-bb31-346bb856ea72 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:41.210758 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e857a-23c0-4550-bb31-346bb856ea72 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:41.210758 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e857a-23c0-4550-bb31-346bb856ea72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:41.233241 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-745e857a-23c0-4550-bb31-346bb856ea72 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:55:41.235077 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-745e857a-23c0-4550-bb31-346bb856ea72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:41.305291 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1420/2835] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:55:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:55:41.360124 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b54cd0-7c43-4f69-a988-369a4ddca9df None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:41.360552 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b54cd0-7c43-4f69-a988-369a4ddca9df None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:41.361032 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b54cd0-7c43-4f69-a988-369a4ddca9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:41.386976 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-e3b54cd0-7c43-4f69-a988-369a4ddca9df None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:55:41.388212 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-e3b54cd0-7c43-4f69-a988-369a4ddca9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:41.398322 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1416/2836] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:55:41 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:55:41.402926 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e857a-23c0-4550-bb31-346bb856ea72 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:41.413016 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e857a-23c0-4550-bb31-346bb856ea72 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:41.418242 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c85bd9-1024-4f3a-bdda-f06210e88cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:41.418911 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c85bd9-1024-4f3a-bdda-f06210e88cab admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:41.419217 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c85bd9-1024-4f3a-bdda-f06210e88cab admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:41.419463 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c85bd9-1024-4f3a-bdda-f06210e88cab admin admin] PATH_INFO: `/v3/domains` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:41.420236 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c85bd9-1024-4f3a-bdda-f06210e88cab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79168) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:55:41.420538 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c85bd9-1024-4f3a-bdda-f06210e88cab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:41.422128 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c85bd9-1024-4f3a-bdda-f06210e88cab admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:41.437759 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1421/2837] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:55:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:55:41.442370 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b54cd0-7c43-4f69-a988-369a4ddca9df None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:41.453409 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b54cd0-7c43-4f69-a988-369a4ddca9df None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:41.460188 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d096c8d-4772-428e-8893-2f4e14348ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:41.460839 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d096c8d-4772-428e-8893-2f4e14348ff4 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:41.461113 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d096c8d-4772-428e-8893-2f4e14348ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:41.461389 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d096c8d-4772-428e-8893-2f4e14348ff4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:41.462091 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d096c8d-4772-428e-8893-2f4e14348ff4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:41.464031 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d096c8d-4772-428e-8893-2f4e14348ff4 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:41.491701 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1417/2838] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:55:41 2021] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:55:41.495873 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c85bd9-1024-4f3a-bdda-f06210e88cab admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:41.506418 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c85bd9-1024-4f3a-bdda-f06210e88cab admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:41.566876 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708335d-bd6b-4cdd-a762-fea22e1f2ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:41.567642 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708335d-bd6b-4cdd-a762-fea22e1f2ac1 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:41.568061 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708335d-bd6b-4cdd-a762-fea22e1f2ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:41.568375 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708335d-bd6b-4cdd-a762-fea22e1f2ac1 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:41.569172 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5708335d-bd6b-4cdd-a762-fea22e1f2ac1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:41.571141 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5708335d-bd6b-4cdd-a762-fea22e1f2ac1 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:41.592156 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1422/2839] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:55:41 2021] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:55:41.596487 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d096c8d-4772-428e-8893-2f4e14348ff4 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:41.607269 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d096c8d-4772-428e-8893-2f4e14348ff4 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:41.612214 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c7daa-3b11-498a-8870-c1bb98a9f441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:41.612876 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c7daa-3b11-498a-8870-c1bb98a9f441 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:41.613152 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c7daa-3b11-498a-8870-c1bb98a9f441 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:41.613450 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c7daa-3b11-498a-8870-c1bb98a9f441 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:41.614172 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c7daa-3b11-498a-8870-c1bb98a9f441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:41.615833 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c7daa-3b11-498a-8870-c1bb98a9f441 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:41.627019 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1418/2840] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:55:41 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:55:41.631769 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708335d-bd6b-4cdd-a762-fea22e1f2ac1 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:41.642403 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708335d-bd6b-4cdd-a762-fea22e1f2ac1 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:41.648873 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef1fdc-ff78-47e5-8b04-cca29c05db21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:41.649546 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef1fdc-ff78-47e5-8b04-cca29c05db21 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:41.649817 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef1fdc-ff78-47e5-8b04-cca29c05db21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:41.650084 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef1fdc-ff78-47e5-8b04-cca29c05db21 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:41.650816 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef1fdc-ff78-47e5-8b04-cca29c05db21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:41.652466 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ef1fdc-ff78-47e5-8b04-cca29c05db21 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:41.662985 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1423/2841] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:55:41 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:55:41.667361 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c7daa-3b11-498a-8870-c1bb98a9f441 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:41.677724 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c7daa-3b11-498a-8870-c1bb98a9f441 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:41.683260 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269a4a2-2eb0-4a9d-8b15-2332cfa99c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:41.684187 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269a4a2-2eb0-4a9d-8b15-2332cfa99c28 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:41.684464 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269a4a2-2eb0-4a9d-8b15-2332cfa99c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:41.684771 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269a4a2-2eb0-4a9d-8b15-2332cfa99c28 admin admin] PATH_INFO: `/v3/projects/428b20adcae84522967611b45b31dbea/users/477eb09860584e95941559dbe20302f3/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:41.705876 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269a4a2-2eb0-4a9d-8b15-2332cfa99c28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=428b20adcae84522967611b45b31dbea, user_id=477eb09860584e95941559dbe20302f3, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:41.710101 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269a4a2-2eb0-4a9d-8b15-2332cfa99c28 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:41.729234 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1419/2842] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:55:41 2021] PUT /identity/v3/projects/428b20adcae84522967611b45b31dbea/users/477eb09860584e95941559dbe20302f3/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:55:41.739784 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf980d7-ef81-4cee-8ca1-c4c24c20c652 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:41.740101 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf980d7-ef81-4cee-8ca1-c4c24c20c652 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:41.740376 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf980d7-ef81-4cee-8ca1-c4c24c20c652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:41.768745 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-caf980d7-ef81-4cee-8ca1-c4c24c20c652 None None] MFA Rules not processed for user `477eb09860584e95941559dbe20302f3`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:55:41.769880 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-caf980d7-ef81-4cee-8ca1-c4c24c20c652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:41.843926 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1424/2843] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:55:41 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:55:41.848650 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269a4a2-2eb0-4a9d-8b15-2332cfa99c28 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:41.911074 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269a4a2-2eb0-4a9d-8b15-2332cfa99c28 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:41.916312 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665191f-d6e7-4a35-a4c5-1c902da654ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:41.916980 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665191f-d6e7-4a35-a4c5-1c902da654ad admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:41.917257 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665191f-d6e7-4a35-a4c5-1c902da654ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:41.917527 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665191f-d6e7-4a35-a4c5-1c902da654ad admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:41.918239 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c665191f-d6e7-4a35-a4c5-1c902da654ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:41.920207 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c665191f-d6e7-4a35-a4c5-1c902da654ad admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:41.948924 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1420/2844] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:55:41 2021] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:55:41.953190 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf980d7-ef81-4cee-8ca1-c4c24c20c652 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:41.965886 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf980d7-ef81-4cee-8ca1-c4c24c20c652 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:42.026363 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a76b21-03ea-4e27-87b6-94b8ef3661a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:42.026998 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a76b21-03ea-4e27-87b6-94b8ef3661a3 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:42.027285 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a76b21-03ea-4e27-87b6-94b8ef3661a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:42.027564 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a76b21-03ea-4e27-87b6-94b8ef3661a3 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:42.028329 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a76b21-03ea-4e27-87b6-94b8ef3661a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:42.030266 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a76b21-03ea-4e27-87b6-94b8ef3661a3 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:42.053269 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1425/2845] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:55:41 2021] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:55:42.055493 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665191f-d6e7-4a35-a4c5-1c902da654ad admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:42.066185 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665191f-d6e7-4a35-a4c5-1c902da654ad admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:42.072255 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8869e50a-8d89-4eef-8cb4-9887c34cc3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:42.072917 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869e50a-8d89-4eef-8cb4-9887c34cc3a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:42.073202 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869e50a-8d89-4eef-8cb4-9887c34cc3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:42.073482 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869e50a-8d89-4eef-8cb4-9887c34cc3a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:42.074196 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8869e50a-8d89-4eef-8cb4-9887c34cc3a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:42.076673 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8869e50a-8d89-4eef-8cb4-9887c34cc3a1 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:42.089176 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1421/2846] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:55:42 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:55:42.093596 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a76b21-03ea-4e27-87b6-94b8ef3661a3 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:42.104132 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a76b21-03ea-4e27-87b6-94b8ef3661a3 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:42.109976 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f845cd7-b15d-4d28-908d-d960a7701b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:42.110652 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f845cd7-b15d-4d28-908d-d960a7701b2f admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:42.110970 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f845cd7-b15d-4d28-908d-d960a7701b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:42.111246 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f845cd7-b15d-4d28-908d-d960a7701b2f admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:42.111988 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f845cd7-b15d-4d28-908d-d960a7701b2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:42.113559 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f845cd7-b15d-4d28-908d-d960a7701b2f admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:42.124556 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1426/2847] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:55:42 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:55:42.128875 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8869e50a-8d89-4eef-8cb4-9887c34cc3a1 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:42.139725 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8869e50a-8d89-4eef-8cb4-9887c34cc3a1 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:42.145992 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423e0bb-1070-43b4-94c7-22e64c4c4584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:42.146965 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423e0bb-1070-43b4-94c7-22e64c4c4584 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:42.147244 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423e0bb-1070-43b4-94c7-22e64c4c4584 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:42.147498 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423e0bb-1070-43b4-94c7-22e64c4c4584 admin admin] PATH_INFO: `/v3/projects/30e2b70067ad492db7b667bed652547a/users/759bc9253b4f41a4a7f1763382faf5f0/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:42.163795 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d423e0bb-1070-43b4-94c7-22e64c4c4584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30e2b70067ad492db7b667bed652547a, user_id=759bc9253b4f41a4a7f1763382faf5f0, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:42.166471 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d423e0bb-1070-43b4-94c7-22e64c4c4584 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:42.182420 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1422/2848] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:55:42 2021] PUT /identity/v3/projects/30e2b70067ad492db7b667bed652547a/users/759bc9253b4f41a4a7f1763382faf5f0/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:55:42.192983 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed32c9-2235-4236-8892-f2f03ef3bb19 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:42.193242 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed32c9-2235-4236-8892-f2f03ef3bb19 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:42.193541 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed32c9-2235-4236-8892-f2f03ef3bb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:42.224434 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-1bed32c9-2235-4236-8892-f2f03ef3bb19 None None] MFA Rules not processed for user `759bc9253b4f41a4a7f1763382faf5f0`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:55:42.225674 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-1bed32c9-2235-4236-8892-f2f03ef3bb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:42.293152 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1427/2849] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:55:42 2021] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:55:42.297669 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423e0bb-1070-43b4-94c7-22e64c4c4584 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:42.362751 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423e0bb-1070-43b4-94c7-22e64c4c4584 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:42.368021 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d9dd4-9d6c-4f86-9a3d-661376d60a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:42.368698 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d9dd4-9d6c-4f86-9a3d-661376d60a5e admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:42.368966 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d9dd4-9d6c-4f86-9a3d-661376d60a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:42.369237 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d9dd4-9d6c-4f86-9a3d-661376d60a5e admin admin] PATH_INFO: `/v3/projects` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:42.369951 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d9dd4-9d6c-4f86-9a3d-661376d60a5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:42.371904 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523d9dd4-9d6c-4f86-9a3d-661376d60a5e admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:42.400288 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1423/2850] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:55:42 2021] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 29 20:55:42.404757 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed32c9-2235-4236-8892-f2f03ef3bb19 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:42.416994 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed32c9-2235-4236-8892-f2f03ef3bb19 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:42.477231 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3ca4f-83f7-48f4-a912-2631fe2f8d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:42.477913 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3ca4f-83f7-48f4-a912-2631fe2f8d89 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:42.478200 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3ca4f-83f7-48f4-a912-2631fe2f8d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:42.478476 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3ca4f-83f7-48f4-a912-2631fe2f8d89 admin admin] PATH_INFO: `/v3/users` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:42.479272 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d3ca4f-83f7-48f4-a912-2631fe2f8d89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:42.481156 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d3ca4f-83f7-48f4-a912-2631fe2f8d89 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:42.501191 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1428/2851] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:55:42 2021] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:55:42.505529 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d9dd4-9d6c-4f86-9a3d-661376d60a5e admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:42.517517 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523d9dd4-9d6c-4f86-9a3d-661376d60a5e admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:42.522872 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d69774-398a-4ea1-978d-6f35cb867851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:42.523561 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d69774-398a-4ea1-978d-6f35cb867851 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:42.523848 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d69774-398a-4ea1-978d-6f35cb867851 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:42.524093 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d69774-398a-4ea1-978d-6f35cb867851 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:42.524895 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d69774-398a-4ea1-978d-6f35cb867851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:42.526485 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d69774-398a-4ea1-978d-6f35cb867851 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:42.538093 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1424/2852] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:55:42 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:55:42.542653 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3ca4f-83f7-48f4-a912-2631fe2f8d89 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:42.553695 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3ca4f-83f7-48f4-a912-2631fe2f8d89 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:42.559269 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a2941-219a-4027-839c-e92e85413dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:42.560168 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a2941-219a-4027-839c-e92e85413dd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:42.560449 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a2941-219a-4027-839c-e92e85413dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:42.560725 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a2941-219a-4027-839c-e92e85413dd6 admin admin] PATH_INFO: `/v3/projects/06659b4988584f8b9bfb581a00ae2bd7/users/716bf759ed4c478090ddb0550fe8762c/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:42.577120 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a2941-219a-4027-839c-e92e85413dd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06659b4988584f8b9bfb581a00ae2bd7, user_id=716bf759ed4c478090ddb0550fe8762c, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:42.579852 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a2941-219a-4027-839c-e92e85413dd6 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:42.598354 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1429/2853] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:55:42 2021] PUT /identity/v3/projects/06659b4988584f8b9bfb581a00ae2bd7/users/716bf759ed4c478090ddb0550fe8762c/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:55:42.602665 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d69774-398a-4ea1-978d-6f35cb867851 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:42.612833 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d69774-398a-4ea1-978d-6f35cb867851 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:42.671779 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b0e3d-ab7c-4411-ac2a-a69869ab58e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:42.672506 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b0e3d-ab7c-4411-ac2a-a69869ab58e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:42.672937 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b0e3d-ab7c-4411-ac2a-a69869ab58e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:42.673264 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b0e3d-ab7c-4411-ac2a-a69869ab58e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:42.674067 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b0e3d-ab7c-4411-ac2a-a69869ab58e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:42.675876 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b0e3d-ab7c-4411-ac2a-a69869ab58e3 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:42.687582 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1425/2854] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:55:42 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:55:42.691945 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a2941-219a-4027-839c-e92e85413dd6 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:42.704495 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a2941-219a-4027-839c-e92e85413dd6 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:42.709544 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e79e19-5678-4ae7-bb5c-305756252c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:42.710426 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e79e19-5678-4ae7-bb5c-305756252c13 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:42.710704 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e79e19-5678-4ae7-bb5c-305756252c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:42.711082 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e79e19-5678-4ae7-bb5c-305756252c13 admin admin] PATH_INFO: `/v3/projects/06659b4988584f8b9bfb581a00ae2bd7/users/716bf759ed4c478090ddb0550fe8762c/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:42.713123 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e79e19-5678-4ae7-bb5c-305756252c13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06659b4988584f8b9bfb581a00ae2bd7, user_id=716bf759ed4c478090ddb0550fe8762c, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:42.715832 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e79e19-5678-4ae7-bb5c-305756252c13 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:42.726036 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1430/2855] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:55:42 2021] PUT /identity/v3/projects/06659b4988584f8b9bfb581a00ae2bd7/users/716bf759ed4c478090ddb0550fe8762c/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:55:42.737529 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c41cb1-502d-4aab-8d08-6d148f5e0482 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:42.737787 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c41cb1-502d-4aab-8d08-6d148f5e0482 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:42.738146 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c41cb1-502d-4aab-8d08-6d148f5e0482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:42.767997 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-06c41cb1-502d-4aab-8d08-6d148f5e0482 None None] MFA Rules not processed for user `716bf759ed4c478090ddb0550fe8762c`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:55:42.769376 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-06c41cb1-502d-4aab-8d08-6d148f5e0482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:42.840924 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1426/2856] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:55:42 2021] POST /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:55:42.851524 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e79e19-5678-4ae7-bb5c-305756252c13 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:42.853622 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-f8e79e19-5678-4ae7-bb5c-305756252c13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:42.916262 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e79e19-5678-4ae7-bb5c-305756252c13 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:42.920621 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f473e0-3cfc-4062-88fd-5150d0ca2838 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:42.921281 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f473e0-3cfc-4062-88fd-5150d0ca2838 service cinder] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:42.921565 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f473e0-3cfc-4062-88fd-5150d0ca2838 service cinder] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:42.921823 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f473e0-3cfc-4062-88fd-5150d0ca2838 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:42.931790 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f473e0-3cfc-4062-88fd-5150d0ca2838 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:42.933237 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f473e0-3cfc-4062-88fd-5150d0ca2838 service cinder] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:42.943358 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1431/2857] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:55:42 2021] GET /identity/v3/auth/tokens => generated 3321 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:55:43.446743 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c41cb1-502d-4aab-8d08-6d148f5e0482 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:43.448545 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-06c41cb1-502d-4aab-8d08-6d148f5e0482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:43.462112 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c41cb1-502d-4aab-8d08-6d148f5e0482 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:43.466783 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3edd2c-81b9-482d-9369-0941faaa2da6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:43.467473 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3edd2c-81b9-482d-9369-0941faaa2da6 service cinder] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:43.467753 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3edd2c-81b9-482d-9369-0941faaa2da6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:43.468060 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3edd2c-81b9-482d-9369-0941faaa2da6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:43.532345 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3edd2c-81b9-482d-9369-0941faaa2da6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:43.533800 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3edd2c-81b9-482d-9369-0941faaa2da6 service cinder] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:43.543358 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1427/2858] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:55:43 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:55:47.537564 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f473e0-3cfc-4062-88fd-5150d0ca2838 service cinder] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:47.546507 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f473e0-3cfc-4062-88fd-5150d0ca2838 service cinder] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:47.550520 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11a6e89-00fd-4596-9d12-4a973b142ec5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:47.551200 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a6e89-00fd-4596-9d12-4a973b142ec5 service cinder] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:47.551485 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a6e89-00fd-4596-9d12-4a973b142ec5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:47.551763 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a6e89-00fd-4596-9d12-4a973b142ec5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:47.613972 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a6e89-00fd-4596-9d12-4a973b142ec5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:47.615352 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11a6e89-00fd-4596-9d12-4a973b142ec5 service cinder] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:47.624988 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1432/2859] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:55:47 2021] GET /identity/v3/auth/tokens => generated 3254 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:55:49.708483 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3edd2c-81b9-482d-9369-0941faaa2da6 service cinder] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:49.774341 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3edd2c-81b9-482d-9369-0941faaa2da6 service cinder] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:49.780296 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f220b0-a46a-4d34-982f-57efde6a9422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:49.781279 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f220b0-a46a-4d34-982f-57efde6a9422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:49.781562 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f220b0-a46a-4d34-982f-57efde6a9422 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:49.781833 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f220b0-a46a-4d34-982f-57efde6a9422 admin admin] PATH_INFO: `/v3/users/477eb09860584e95941559dbe20302f3` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:49.783265 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f220b0-a46a-4d34-982f-57efde6a9422 admin admin] RBAC: Authorizing `identity:delete_user(user_id=477eb09860584e95941559dbe20302f3)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:49.785240 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f220b0-a46a-4d34-982f-57efde6a9422 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:49.835679 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-00f220b0-a46a-4d34-982f-57efde6a9422 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '477eb09860584e95941559dbe20302f3'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:49.843837 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-00f220b0-a46a-4d34-982f-57efde6a9422 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '477eb09860584e95941559dbe20302f3'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:49.859092 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-00f220b0-a46a-4d34-982f-57efde6a9422 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '477eb09860584e95941559dbe20302f3'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:49.859885 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-00f220b0-a46a-4d34-982f-57efde6a9422 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '477eb09860584e95941559dbe20302f3'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:49.860540 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-00f220b0-a46a-4d34-982f-57efde6a9422 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '477eb09860584e95941559dbe20302f3'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:49.874621 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1428/2860] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:55:49 2021] DELETE /identity/v3/users/477eb09860584e95941559dbe20302f3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:55:49.879449 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940613f1-ab01-44cf-a8c2-df9ca08514bc None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:49.880012 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940613f1-ab01-44cf-a8c2-df9ca08514bc None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:49.880012 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940613f1-ab01-44cf-a8c2-df9ca08514bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:49.898778 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-940613f1-ab01-44cf-a8c2-df9ca08514bc None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:55:49.900068 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-940613f1-ab01-44cf-a8c2-df9ca08514bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:49.962556 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1433/2861] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:55:49 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:55:49.974267 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f220b0-a46a-4d34-982f-57efde6a9422 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:49.976034 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-00f220b0-a46a-4d34-982f-57efde6a9422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:50.036414 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f220b0-a46a-4d34-982f-57efde6a9422 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:50.040401 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c99527-043c-4726-af3f-8be166c6dc69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:50.041058 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c99527-043c-4726-af3f-8be166c6dc69 service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:50.041331 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c99527-043c-4726-af3f-8be166c6dc69 service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:50.041605 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c99527-043c-4726-af3f-8be166c6dc69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:50.051584 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c99527-043c-4726-af3f-8be166c6dc69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:50.053071 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c99527-043c-4726-af3f-8be166c6dc69 service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:50.063079 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1429/2862] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:55:49 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:55:50.351004 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940613f1-ab01-44cf-a8c2-df9ca08514bc None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:50.352852 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-940613f1-ab01-44cf-a8c2-df9ca08514bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:50.366974 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940613f1-ab01-44cf-a8c2-df9ca08514bc None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:50.371883 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1d091-3267-451b-805f-6081bc31e07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:50.373509 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1d091-3267-451b-805f-6081bc31e07d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:50.373798 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1d091-3267-451b-805f-6081bc31e07d admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:50.374070 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1d091-3267-451b-805f-6081bc31e07d admin admin] PATH_INFO: `/v3/projects/428b20adcae84522967611b45b31dbea` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:50.375571 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e1d091-3267-451b-805f-6081bc31e07d admin admin] RBAC: Authorizing `identity:delete_project(project_id=428b20adcae84522967611b45b31dbea)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:50.377594 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e1d091-3267-451b-805f-6081bc31e07d admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:50.426576 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-40e1d091-3267-451b-805f-6081bc31e07d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '428b20adcae84522967611b45b31dbea', 'request_id': 'req-40e1d091-3267-451b-805f-6081bc31e07d'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:50.432962 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-40e1d091-3267-451b-805f-6081bc31e07d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '428b20adcae84522967611b45b31dbea', 'request_id': 'req-40e1d091-3267-451b-805f-6081bc31e07d'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:50.441574 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-40e1d091-3267-451b-805f-6081bc31e07d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '428b20adcae84522967611b45b31dbea', 'request_id': 'req-40e1d091-3267-451b-805f-6081bc31e07d'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:50.452371 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-40e1d091-3267-451b-805f-6081bc31e07d admin admin] The token cache is being invalidate because project 428b20adcae84522967611b45b31dbea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:55:50.452652 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-40e1d091-3267-451b-805f-6081bc31e07d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:50.453293 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-40e1d091-3267-451b-805f-6081bc31e07d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:50.455219 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1434/2863] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:55:50 2021] DELETE /identity/v3/projects/428b20adcae84522967611b45b31dbea => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:55:50.459312 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c99527-043c-4726-af3f-8be166c6dc69 service neutron] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:50.470504 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c99527-043c-4726-af3f-8be166c6dc69 service neutron] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:50.532117 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f663a8-4b42-4d8e-8f56-7c7285d3dd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:50.532988 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f663a8-4b42-4d8e-8f56-7c7285d3dd2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:50.533258 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f663a8-4b42-4d8e-8f56-7c7285d3dd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:50.533523 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f663a8-4b42-4d8e-8f56-7c7285d3dd2c admin admin] PATH_INFO: `/v3/users/759bc9253b4f41a4a7f1763382faf5f0` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:50.534792 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f663a8-4b42-4d8e-8f56-7c7285d3dd2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=759bc9253b4f41a4a7f1763382faf5f0)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:50.536767 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f663a8-4b42-4d8e-8f56-7c7285d3dd2c admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:50.583468 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-86f663a8-4b42-4d8e-8f56-7c7285d3dd2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '759bc9253b4f41a4a7f1763382faf5f0'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:50.590182 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-86f663a8-4b42-4d8e-8f56-7c7285d3dd2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '759bc9253b4f41a4a7f1763382faf5f0'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:50.602458 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-86f663a8-4b42-4d8e-8f56-7c7285d3dd2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '759bc9253b4f41a4a7f1763382faf5f0'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:50.603526 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-86f663a8-4b42-4d8e-8f56-7c7285d3dd2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '759bc9253b4f41a4a7f1763382faf5f0'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:50.604263 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-86f663a8-4b42-4d8e-8f56-7c7285d3dd2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '759bc9253b4f41a4a7f1763382faf5f0'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:50.618575 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1430/2864] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:55:50 2021] DELETE /identity/v3/users/759bc9253b4f41a4a7f1763382faf5f0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:55:50.896241 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1d091-3267-451b-805f-6081bc31e07d admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:50.898704 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-40e1d091-3267-451b-805f-6081bc31e07d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:50.916975 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1d091-3267-451b-805f-6081bc31e07d admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:50.975708 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d5517f-e7e5-47af-9050-d75ac542919c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:50.976568 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5517f-e7e5-47af-9050-d75ac542919c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:50.976848 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5517f-e7e5-47af-9050-d75ac542919c admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:50.977117 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d5517f-e7e5-47af-9050-d75ac542919c admin admin] PATH_INFO: `/v3/projects/30e2b70067ad492db7b667bed652547a` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:50.978371 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d5517f-e7e5-47af-9050-d75ac542919c admin admin] RBAC: Authorizing `identity:delete_project(project_id=30e2b70067ad492db7b667bed652547a)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:50.980371 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d5517f-e7e5-47af-9050-d75ac542919c admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:51.029147 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-42d5517f-e7e5-47af-9050-d75ac542919c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30e2b70067ad492db7b667bed652547a', 'request_id': 'req-42d5517f-e7e5-47af-9050-d75ac542919c'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:51.035460 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-42d5517f-e7e5-47af-9050-d75ac542919c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30e2b70067ad492db7b667bed652547a', 'request_id': 'req-42d5517f-e7e5-47af-9050-d75ac542919c'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:51.043752 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-42d5517f-e7e5-47af-9050-d75ac542919c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30e2b70067ad492db7b667bed652547a', 'request_id': 'req-42d5517f-e7e5-47af-9050-d75ac542919c'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:51.055648 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-42d5517f-e7e5-47af-9050-d75ac542919c admin admin] The token cache is being invalidate because project 30e2b70067ad492db7b667bed652547a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:55:51.055934 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-42d5517f-e7e5-47af-9050-d75ac542919c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:51.056626 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-42d5517f-e7e5-47af-9050-d75ac542919c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:51.058244 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1435/2865] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:55:50 2021] DELETE /identity/v3/projects/30e2b70067ad492db7b667bed652547a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:55:51.062294 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f663a8-4b42-4d8e-8f56-7c7285d3dd2c admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:51.064432 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-86f663a8-4b42-4d8e-8f56-7c7285d3dd2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:51.077868 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f663a8-4b42-4d8e-8f56-7c7285d3dd2c admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:51.139359 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc1d33-597d-48c6-9a4e-99dbcb6ca447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:51.140379 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc1d33-597d-48c6-9a4e-99dbcb6ca447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:51.140779 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc1d33-597d-48c6-9a4e-99dbcb6ca447 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:51.141152 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc1d33-597d-48c6-9a4e-99dbcb6ca447 admin admin] PATH_INFO: `/v3/users/716bf759ed4c478090ddb0550fe8762c` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:51.143352 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc1d33-597d-48c6-9a4e-99dbcb6ca447 admin admin] RBAC: Authorizing `identity:delete_user(user_id=716bf759ed4c478090ddb0550fe8762c)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:51.145674 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc1d33-597d-48c6-9a4e-99dbcb6ca447 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:51.199540 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-6ffc1d33-597d-48c6-9a4e-99dbcb6ca447 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '716bf759ed4c478090ddb0550fe8762c'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:51.206692 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-6ffc1d33-597d-48c6-9a4e-99dbcb6ca447 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '716bf759ed4c478090ddb0550fe8762c'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:51.220549 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-6ffc1d33-597d-48c6-9a4e-99dbcb6ca447 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '716bf759ed4c478090ddb0550fe8762c'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:51.221401 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-6ffc1d33-597d-48c6-9a4e-99dbcb6ca447 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '716bf759ed4c478090ddb0550fe8762c'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:51.222095 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-6ffc1d33-597d-48c6-9a4e-99dbcb6ca447 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '716bf759ed4c478090ddb0550fe8762c'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:51.235754 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1431/2866] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:55:51 2021] DELETE /identity/v3/users/716bf759ed4c478090ddb0550fe8762c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:55:51.523164 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d5517f-e7e5-47af-9050-d75ac542919c admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:51.525416 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-42d5517f-e7e5-47af-9050-d75ac542919c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:51.541433 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d5517f-e7e5-47af-9050-d75ac542919c admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:51.609756 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32b05c-8fca-483f-bcf6-4ce424d63b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:51.610626 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32b05c-8fca-483f-bcf6-4ce424d63b49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:51.610933 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32b05c-8fca-483f-bcf6-4ce424d63b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:51.611208 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32b05c-8fca-483f-bcf6-4ce424d63b49 admin admin] PATH_INFO: `/v3/projects/06659b4988584f8b9bfb581a00ae2bd7` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:51.612445 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32b05c-8fca-483f-bcf6-4ce424d63b49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06659b4988584f8b9bfb581a00ae2bd7)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:51.614365 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32b05c-8fca-483f-bcf6-4ce424d63b49 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:51.677539 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-4d32b05c-8fca-483f-bcf6-4ce424d63b49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06659b4988584f8b9bfb581a00ae2bd7', 'request_id': 'req-4d32b05c-8fca-483f-bcf6-4ce424d63b49'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:51.684270 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-4d32b05c-8fca-483f-bcf6-4ce424d63b49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06659b4988584f8b9bfb581a00ae2bd7', 'request_id': 'req-4d32b05c-8fca-483f-bcf6-4ce424d63b49'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:51.693612 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-4d32b05c-8fca-483f-bcf6-4ce424d63b49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06659b4988584f8b9bfb581a00ae2bd7', 'request_id': 'req-4d32b05c-8fca-483f-bcf6-4ce424d63b49'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:51.704463 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-4d32b05c-8fca-483f-bcf6-4ce424d63b49 admin admin] The token cache is being invalidate because project 06659b4988584f8b9bfb581a00ae2bd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:55:51.704728 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-4d32b05c-8fca-483f-bcf6-4ce424d63b49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:51.705432 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-4d32b05c-8fca-483f-bcf6-4ce424d63b49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:51.707167 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1436/2867] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:55:51 2021] DELETE /identity/v3/projects/06659b4988584f8b9bfb581a00ae2bd7 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:55:51.714315 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989861e6-fc6d-431b-a276-3b9d4abee346 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:51.714601 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989861e6-fc6d-431b-a276-3b9d4abee346 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:51.714908 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989861e6-fc6d-431b-a276-3b9d4abee346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:51.734949 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-989861e6-fc6d-431b-a276-3b9d4abee346 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:55:51.736164 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-989861e6-fc6d-431b-a276-3b9d4abee346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:51.812128 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1432/2868] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:55:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:55:51.820963 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ee69f-7aa5-4536-b9b2-2ea6c22b70c5 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:51.821211 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ee69f-7aa5-4536-b9b2-2ea6c22b70c5 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:51.821543 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ee69f-7aa5-4536-b9b2-2ea6c22b70c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:51.841129 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-488ee69f-7aa5-4536-b9b2-2ea6c22b70c5 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:55:51.842366 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-488ee69f-7aa5-4536-b9b2-2ea6c22b70c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:51.851187 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1437/2869] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:55:51 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Nov 29 20:55:51.855812 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989861e6-fc6d-431b-a276-3b9d4abee346 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:51.866242 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989861e6-fc6d-431b-a276-3b9d4abee346 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:51.871771 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b046b2-ba66-4114-8698-3b45bc6a1cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:51.872437 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b046b2-ba66-4114-8698-3b45bc6a1cea admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:51.872715 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b046b2-ba66-4114-8698-3b45bc6a1cea admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:51.872963 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b046b2-ba66-4114-8698-3b45bc6a1cea admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:51.873703 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b046b2-ba66-4114-8698-3b45bc6a1cea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:55:51.874006 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b046b2-ba66-4114-8698-3b45bc6a1cea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:51.875664 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b046b2-ba66-4114-8698-3b45bc6a1cea admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:51.887893 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1433/2870] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:55:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:55:51.894297 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ee69f-7aa5-4536-b9b2-2ea6c22b70c5 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:51.905136 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ee69f-7aa5-4536-b9b2-2ea6c22b70c5 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:51.910717 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c4278-8e43-40ba-b13b-abf50f5f033f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:51.911396 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c4278-8e43-40ba-b13b-abf50f5f033f admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:51.911695 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c4278-8e43-40ba-b13b-abf50f5f033f admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:51.911946 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c4278-8e43-40ba-b13b-abf50f5f033f admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:51.912652 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c4278-8e43-40ba-b13b-abf50f5f033f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:51.914573 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c4278-8e43-40ba-b13b-abf50f5f033f admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:51.947945 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1438/2871] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:55:51 2021] POST /identity/v3/projects => generated 367 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:55:51.952984 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b046b2-ba66-4114-8698-3b45bc6a1cea admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:51.965670 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b046b2-ba66-4114-8698-3b45bc6a1cea admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:52.022755 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55ab3a-097b-4ba7-8344-b3e991fab524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:52.023502 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55ab3a-097b-4ba7-8344-b3e991fab524 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:52.023781 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55ab3a-097b-4ba7-8344-b3e991fab524 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:52.024052 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55ab3a-097b-4ba7-8344-b3e991fab524 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:52.024761 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b55ab3a-097b-4ba7-8344-b3e991fab524 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:52.026683 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b55ab3a-097b-4ba7-8344-b3e991fab524 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:52.047825 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1434/2872] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:55:51 2021] POST /identity/v3/users => generated 284 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:55:52.051927 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c4278-8e43-40ba-b13b-abf50f5f033f admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:52.062656 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c4278-8e43-40ba-b13b-abf50f5f033f admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:52.068473 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d6907b-bb98-4ce6-815a-4938fd5072c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:52.069155 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6907b-bb98-4ce6-815a-4938fd5072c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:52.069435 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6907b-bb98-4ce6-815a-4938fd5072c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:52.069730 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d6907b-bb98-4ce6-815a-4938fd5072c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:52.070461 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d6907b-bb98-4ce6-815a-4938fd5072c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:52.072099 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d6907b-bb98-4ce6-815a-4938fd5072c7 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:52.084719 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1439/2873] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:55:52 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Nov 29 20:55:52.089274 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55ab3a-097b-4ba7-8344-b3e991fab524 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:52.102389 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55ab3a-097b-4ba7-8344-b3e991fab524 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:52.107969 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4695a7-0da9-4f92-9a60-f4081532a1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:52.108642 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4695a7-0da9-4f92-9a60-f4081532a1f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:52.108920 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4695a7-0da9-4f92-9a60-f4081532a1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:52.109189 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4695a7-0da9-4f92-9a60-f4081532a1f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:52.109889 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4695a7-0da9-4f92-9a60-f4081532a1f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:52.111532 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4695a7-0da9-4f92-9a60-f4081532a1f8 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:52.122304 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1435/2874] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:55:52 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:55:52.126727 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d6907b-bb98-4ce6-815a-4938fd5072c7 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:52.137547 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d6907b-bb98-4ce6-815a-4938fd5072c7 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:52.143867 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed00f25-7e00-4042-9a45-17e7d4d1cea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:52.144809 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed00f25-7e00-4042-9a45-17e7d4d1cea4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:52.145077 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed00f25-7e00-4042-9a45-17e7d4d1cea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:52.145639 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed00f25-7e00-4042-9a45-17e7d4d1cea4 admin admin] PATH_INFO: `/v3/projects/7f473e56074f48f8ac9743ca17c182ff/users/6d6b64389a7c4c9c905c22cbfc1441b7/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:52.163927 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed00f25-7e00-4042-9a45-17e7d4d1cea4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f473e56074f48f8ac9743ca17c182ff, user_id=6d6b64389a7c4c9c905c22cbfc1441b7, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:52.166632 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed00f25-7e00-4042-9a45-17e7d4d1cea4 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:52.185085 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1440/2875] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:55:52 2021] PUT /identity/v3/projects/7f473e56074f48f8ac9743ca17c182ff/users/6d6b64389a7c4c9c905c22cbfc1441b7/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:55:52.197408 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9da1a3-78ef-4ed8-8328-4cb6dbe49ecd None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:52.197669 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9da1a3-78ef-4ed8-8328-4cb6dbe49ecd None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:52.198004 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9da1a3-78ef-4ed8-8328-4cb6dbe49ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:52.225930 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-bb9da1a3-78ef-4ed8-8328-4cb6dbe49ecd None None] MFA Rules not processed for user `6d6b64389a7c4c9c905c22cbfc1441b7`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:55:52.227209 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-bb9da1a3-78ef-4ed8-8328-4cb6dbe49ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:52.292936 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1436/2876] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:55:52 2021] POST /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:55:52.297762 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed00f25-7e00-4042-9a45-17e7d4d1cea4 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:52.368073 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed00f25-7e00-4042-9a45-17e7d4d1cea4 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:52.372824 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8cf818-c5b5-4c52-884e-bb6ed9201fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:52.373489 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8cf818-c5b5-4c52-884e-bb6ed9201fcf admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:52.373764 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8cf818-c5b5-4c52-884e-bb6ed9201fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:52.374030 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8cf818-c5b5-4c52-884e-bb6ed9201fcf admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:52.374739 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8cf818-c5b5-4c52-884e-bb6ed9201fcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:52.376783 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8cf818-c5b5-4c52-884e-bb6ed9201fcf admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:52.406120 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1441/2877] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:55:52 2021] POST /identity/v3/projects => generated 367 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:55:52.410430 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9da1a3-78ef-4ed8-8328-4cb6dbe49ecd None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:52.421460 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9da1a3-78ef-4ed8-8328-4cb6dbe49ecd None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:52.478741 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88648429-a764-46d4-b8a5-2cb3716b1686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:52.479345 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88648429-a764-46d4-b8a5-2cb3716b1686 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:52.479618 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88648429-a764-46d4-b8a5-2cb3716b1686 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:52.479889 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88648429-a764-46d4-b8a5-2cb3716b1686 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:52.480586 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88648429-a764-46d4-b8a5-2cb3716b1686 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:52.482564 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88648429-a764-46d4-b8a5-2cb3716b1686 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:52.505097 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1437/2878] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:55:52 2021] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:55:52.509556 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8cf818-c5b5-4c52-884e-bb6ed9201fcf admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:52.520893 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8cf818-c5b5-4c52-884e-bb6ed9201fcf admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:52.525948 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb19b56-16a1-452c-99a5-f9c696e5c4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:52.526610 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb19b56-16a1-452c-99a5-f9c696e5c4b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:52.526907 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb19b56-16a1-452c-99a5-f9c696e5c4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:52.527196 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb19b56-16a1-452c-99a5-f9c696e5c4b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:52.527939 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb19b56-16a1-452c-99a5-f9c696e5c4b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:52.529543 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb19b56-16a1-452c-99a5-f9c696e5c4b1 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:52.542364 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1442/2879] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:55:52 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:55:52.546823 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88648429-a764-46d4-b8a5-2cb3716b1686 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:52.557442 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88648429-a764-46d4-b8a5-2cb3716b1686 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:52.562934 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29942743-1838-4c51-b439-a84a312b9ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:52.563840 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29942743-1838-4c51-b439-a84a312b9ab8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:52.564119 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29942743-1838-4c51-b439-a84a312b9ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:52.564418 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29942743-1838-4c51-b439-a84a312b9ab8 admin admin] PATH_INFO: `/v3/projects/7eb3b68d54c54773b635fe4c523f9a24/users/4c56be15a0244653aa75aca2272794e0/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:52.581179 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29942743-1838-4c51-b439-a84a312b9ab8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eb3b68d54c54773b635fe4c523f9a24, user_id=4c56be15a0244653aa75aca2272794e0, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:52.583874 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29942743-1838-4c51-b439-a84a312b9ab8 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:52.603657 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1438/2880] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:55:52 2021] PUT /identity/v3/projects/7eb3b68d54c54773b635fe4c523f9a24/users/4c56be15a0244653aa75aca2272794e0/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:55:52.606550 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb19b56-16a1-452c-99a5-f9c696e5c4b1 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:52.621169 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb19b56-16a1-452c-99a5-f9c696e5c4b1 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:52.683877 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc253b-1f1b-4fc3-9204-4b6a5595b861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:52.684549 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc253b-1f1b-4fc3-9204-4b6a5595b861 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:52.684826 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc253b-1f1b-4fc3-9204-4b6a5595b861 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:52.685090 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc253b-1f1b-4fc3-9204-4b6a5595b861 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:52.685811 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc253b-1f1b-4fc3-9204-4b6a5595b861 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:52.687429 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc253b-1f1b-4fc3-9204-4b6a5595b861 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:52.698698 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1443/2881] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:55:52 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:55:52.702880 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29942743-1838-4c51-b439-a84a312b9ab8 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:52.716445 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29942743-1838-4c51-b439-a84a312b9ab8 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:52.722200 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb15a2-7691-433b-b166-bca9288e020c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:52.723147 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb15a2-7691-433b-b166-bca9288e020c admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:52.723425 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb15a2-7691-433b-b166-bca9288e020c admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:52.723734 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb15a2-7691-433b-b166-bca9288e020c admin admin] PATH_INFO: `/v3/projects/7eb3b68d54c54773b635fe4c523f9a24/users/4c56be15a0244653aa75aca2272794e0/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:52.725980 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb15a2-7691-433b-b166-bca9288e020c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eb3b68d54c54773b635fe4c523f9a24, user_id=4c56be15a0244653aa75aca2272794e0, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:52.728864 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb15a2-7691-433b-b166-bca9288e020c admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:52.740261 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1439/2882] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:55:52 2021] PUT /identity/v3/projects/7eb3b68d54c54773b635fe4c523f9a24/users/4c56be15a0244653aa75aca2272794e0/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:55:52.750871 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373f135-fe86-48d0-9ce1-6efaad74b990 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:52.751166 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373f135-fe86-48d0-9ce1-6efaad74b990 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:52.751445 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373f135-fe86-48d0-9ce1-6efaad74b990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:52.780089 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-0373f135-fe86-48d0-9ce1-6efaad74b990 None None] MFA Rules not processed for user `4c56be15a0244653aa75aca2272794e0`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:55:52.781390 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-0373f135-fe86-48d0-9ce1-6efaad74b990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:52.851505 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1444/2883] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:55:52 2021] POST /identity/v3/auth/tokens => generated 3301 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:55:52.862603 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb15a2-7691-433b-b166-bca9288e020c admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:52.864498 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-a6eb15a2-7691-433b-b166-bca9288e020c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:52.921867 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb15a2-7691-433b-b166-bca9288e020c admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:52.925905 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86269a88-093a-4272-b912-f52b362e887d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:52.926552 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86269a88-093a-4272-b912-f52b362e887d service cinder] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:52.926833 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86269a88-093a-4272-b912-f52b362e887d service cinder] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:52.927137 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86269a88-093a-4272-b912-f52b362e887d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:52.937373 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86269a88-093a-4272-b912-f52b362e887d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:52.939659 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86269a88-093a-4272-b912-f52b362e887d service cinder] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:52.951571 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1440/2884] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:55:52 2021] GET /identity/v3/auth/tokens => generated 3301 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:55:53.039685 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373f135-fe86-48d0-9ce1-6efaad74b990 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:53.053025 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373f135-fe86-48d0-9ce1-6efaad74b990 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:53.058154 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31891c-7805-4e25-b7a7-8bd1c4c99743 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:53.058811 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31891c-7805-4e25-b7a7-8bd1c4c99743 service cinder] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:53.059130 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31891c-7805-4e25-b7a7-8bd1c4c99743 service cinder] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:53.059410 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31891c-7805-4e25-b7a7-8bd1c4c99743 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:53.119863 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31891c-7805-4e25-b7a7-8bd1c4c99743 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:53.121316 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31891c-7805-4e25-b7a7-8bd1c4c99743 service cinder] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:53.130527 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1445/2885] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:55:53 2021] GET /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:55:57.864944 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86269a88-093a-4272-b912-f52b362e887d service cinder] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:57.927019 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86269a88-093a-4272-b912-f52b362e887d service cinder] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:57.932393 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d27f7b-6c03-4c51-8832-0892fd6bd52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:57.933266 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d27f7b-6c03-4c51-8832-0892fd6bd52e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:57.933547 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d27f7b-6c03-4c51-8832-0892fd6bd52e admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:57.933826 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d27f7b-6c03-4c51-8832-0892fd6bd52e admin admin] PATH_INFO: `/v3/users/6d6b64389a7c4c9c905c22cbfc1441b7` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:57.935195 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d27f7b-6c03-4c51-8832-0892fd6bd52e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d6b64389a7c4c9c905c22cbfc1441b7)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:57.937155 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d27f7b-6c03-4c51-8832-0892fd6bd52e admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:57.995252 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-f2d27f7b-6c03-4c51-8832-0892fd6bd52e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d6b64389a7c4c9c905c22cbfc1441b7'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:58.002736 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-f2d27f7b-6c03-4c51-8832-0892fd6bd52e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d6b64389a7c4c9c905c22cbfc1441b7'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:58.015287 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-f2d27f7b-6c03-4c51-8832-0892fd6bd52e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d6b64389a7c4c9c905c22cbfc1441b7'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:58.016083 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-f2d27f7b-6c03-4c51-8832-0892fd6bd52e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d6b64389a7c4c9c905c22cbfc1441b7'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:58.016790 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-f2d27f7b-6c03-4c51-8832-0892fd6bd52e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d6b64389a7c4c9c905c22cbfc1441b7'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:58.031763 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1441/2886] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:55:57 2021] DELETE /identity/v3/users/6d6b64389a7c4c9c905c22cbfc1441b7 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:55:58.036541 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e80c34-adcf-44ad-89e9-c7c90eed4eff None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:58.037069 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e80c34-adcf-44ad-89e9-c7c90eed4eff None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:58.037069 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e80c34-adcf-44ad-89e9-c7c90eed4eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:58.054083 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-d0e80c34-adcf-44ad-89e9-c7c90eed4eff None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:55:58.055319 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-d0e80c34-adcf-44ad-89e9-c7c90eed4eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:58.122063 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1446/2887] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:55:58 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:55:58.135639 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d27f7b-6c03-4c51-8832-0892fd6bd52e admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:58.137588 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-f2d27f7b-6c03-4c51-8832-0892fd6bd52e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:58.205087 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d27f7b-6c03-4c51-8832-0892fd6bd52e admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:58.209359 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4934c2-ffcf-42c0-a866-78b7a1badc95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:58.209991 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4934c2-ffcf-42c0-a866-78b7a1badc95 service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:58.210267 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4934c2-ffcf-42c0-a866-78b7a1badc95 service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:58.210530 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4934c2-ffcf-42c0-a866-78b7a1badc95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:58.219948 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4934c2-ffcf-42c0-a866-78b7a1badc95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:58.221374 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4934c2-ffcf-42c0-a866-78b7a1badc95 service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:58.230584 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1442/2888] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:55:58 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:55:58.499242 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e80c34-adcf-44ad-89e9-c7c90eed4eff None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:58.500998 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-d0e80c34-adcf-44ad-89e9-c7c90eed4eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:58.513319 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e80c34-adcf-44ad-89e9-c7c90eed4eff None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:58.518951 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25732b1e-e55c-41d3-904f-ce62086d26e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:58.519782 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25732b1e-e55c-41d3-904f-ce62086d26e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:58.520042 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25732b1e-e55c-41d3-904f-ce62086d26e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:58.520631 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25732b1e-e55c-41d3-904f-ce62086d26e4 admin admin] PATH_INFO: `/v3/projects/7f473e56074f48f8ac9743ca17c182ff` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:58.521920 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25732b1e-e55c-41d3-904f-ce62086d26e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f473e56074f48f8ac9743ca17c182ff)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:58.525556 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25732b1e-e55c-41d3-904f-ce62086d26e4 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:58.571927 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-25732b1e-e55c-41d3-904f-ce62086d26e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f473e56074f48f8ac9743ca17c182ff', 'request_id': 'req-25732b1e-e55c-41d3-904f-ce62086d26e4'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:58.578358 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-25732b1e-e55c-41d3-904f-ce62086d26e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f473e56074f48f8ac9743ca17c182ff', 'request_id': 'req-25732b1e-e55c-41d3-904f-ce62086d26e4'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:58.587962 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-25732b1e-e55c-41d3-904f-ce62086d26e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f473e56074f48f8ac9743ca17c182ff', 'request_id': 'req-25732b1e-e55c-41d3-904f-ce62086d26e4'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:58.598257 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-25732b1e-e55c-41d3-904f-ce62086d26e4 admin admin] The token cache is being invalidate because project 7f473e56074f48f8ac9743ca17c182ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:55:58.598545 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-25732b1e-e55c-41d3-904f-ce62086d26e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:58.599184 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-25732b1e-e55c-41d3-904f-ce62086d26e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:58.601102 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1447/2889] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:55:58 2021] DELETE /identity/v3/projects/7f473e56074f48f8ac9743ca17c182ff => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:55:58.604896 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4934c2-ffcf-42c0-a866-78b7a1badc95 service neutron] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:58.614704 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4934c2-ffcf-42c0-a866-78b7a1badc95 service neutron] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:58.670784 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f8346-faa5-449f-b833-3ecddfaf0607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:58.671765 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f8346-faa5-449f-b833-3ecddfaf0607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:58.672037 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f8346-faa5-449f-b833-3ecddfaf0607 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:58.672305 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f8346-faa5-449f-b833-3ecddfaf0607 admin admin] PATH_INFO: `/v3/users/4c56be15a0244653aa75aca2272794e0` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:58.673562 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4f8346-faa5-449f-b833-3ecddfaf0607 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c56be15a0244653aa75aca2272794e0)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:58.675500 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4f8346-faa5-449f-b833-3ecddfaf0607 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:58.728941 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-4e4f8346-faa5-449f-b833-3ecddfaf0607 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c56be15a0244653aa75aca2272794e0'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:58.735423 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-4e4f8346-faa5-449f-b833-3ecddfaf0607 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c56be15a0244653aa75aca2272794e0'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:58.746286 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-4e4f8346-faa5-449f-b833-3ecddfaf0607 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c56be15a0244653aa75aca2272794e0'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:58.747077 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-4e4f8346-faa5-449f-b833-3ecddfaf0607 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c56be15a0244653aa75aca2272794e0'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:58.747798 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-4e4f8346-faa5-449f-b833-3ecddfaf0607 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c56be15a0244653aa75aca2272794e0'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:58.763544 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1443/2890] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:55:58 2021] DELETE /identity/v3/users/4c56be15a0244653aa75aca2272794e0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:55:59.040528 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25732b1e-e55c-41d3-904f-ce62086d26e4 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:59.042004 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-25732b1e-e55c-41d3-904f-ce62086d26e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:59.055297 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25732b1e-e55c-41d3-904f-ce62086d26e4 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:59.122278 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca035057-7fbf-4788-ada4-10d42ae655da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:59.123083 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca035057-7fbf-4788-ada4-10d42ae655da admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:59.123362 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca035057-7fbf-4788-ada4-10d42ae655da admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:59.123633 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca035057-7fbf-4788-ada4-10d42ae655da admin admin] PATH_INFO: `/v3/projects/7eb3b68d54c54773b635fe4c523f9a24` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:59.124850 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca035057-7fbf-4788-ada4-10d42ae655da admin admin] RBAC: Authorizing `identity:delete_project(project_id=7eb3b68d54c54773b635fe4c523f9a24)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:59.126738 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca035057-7fbf-4788-ada4-10d42ae655da admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:59.180539 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ca035057-7fbf-4788-ada4-10d42ae655da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7eb3b68d54c54773b635fe4c523f9a24', 'request_id': 'req-ca035057-7fbf-4788-ada4-10d42ae655da'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:59.187275 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ca035057-7fbf-4788-ada4-10d42ae655da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7eb3b68d54c54773b635fe4c523f9a24', 'request_id': 'req-ca035057-7fbf-4788-ada4-10d42ae655da'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:59.195564 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ca035057-7fbf-4788-ada4-10d42ae655da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7eb3b68d54c54773b635fe4c523f9a24', 'request_id': 'req-ca035057-7fbf-4788-ada4-10d42ae655da'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:59.207390 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ca035057-7fbf-4788-ada4-10d42ae655da admin admin] The token cache is being invalidate because project 7eb3b68d54c54773b635fe4c523f9a24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:55:59.207665 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ca035057-7fbf-4788-ada4-10d42ae655da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:59.208280 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-ca035057-7fbf-4788-ada4-10d42ae655da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:55:59.209852 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1448/2891] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:55:59 2021] DELETE /identity/v3/projects/7eb3b68d54c54773b635fe4c523f9a24 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:55:59.215538 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa937706-e311-4451-897d-f269c12ddbe1 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:59.216047 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa937706-e311-4451-897d-f269c12ddbe1 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:59.216047 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa937706-e311-4451-897d-f269c12ddbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:59.233936 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-aa937706-e311-4451-897d-f269c12ddbe1 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:55:59.235143 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-aa937706-e311-4451-897d-f269c12ddbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:59.299827 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1444/2892] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:55:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:55:59.308845 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278448b-c980-4f18-a13c-41e8c529614e None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:59.309215 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278448b-c980-4f18-a13c-41e8c529614e None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:59.309540 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a278448b-c980-4f18-a13c-41e8c529614e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:59.336302 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-a278448b-c980-4f18-a13c-41e8c529614e None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:55:59.337503 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-a278448b-c980-4f18-a13c-41e8c529614e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:59.346970 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1449/2893] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:55:59 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:55:59.351542 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa937706-e311-4451-897d-f269c12ddbe1 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:59.361857 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa937706-e311-4451-897d-f269c12ddbe1 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:59.367798 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1b02a-2ede-480c-9b7a-46f8259546a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:59.368454 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1b02a-2ede-480c-9b7a-46f8259546a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:59.368734 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1b02a-2ede-480c-9b7a-46f8259546a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:59.369003 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1b02a-2ede-480c-9b7a-46f8259546a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:59.369738 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b1b02a-2ede-480c-9b7a-46f8259546a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:55:59.370053 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b1b02a-2ede-480c-9b7a-46f8259546a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:59.371693 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b1b02a-2ede-480c-9b7a-46f8259546a9 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:59.384041 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1445/2894] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:55:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:55:59.389676 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278448b-c980-4f18-a13c-41e8c529614e None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:59.399516 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a278448b-c980-4f18-a13c-41e8c529614e None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:59.404820 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef99102-9fad-40e5-891a-bf12ca6bc376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:59.405467 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef99102-9fad-40e5-891a-bf12ca6bc376 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:59.405745 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef99102-9fad-40e5-891a-bf12ca6bc376 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:59.406018 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef99102-9fad-40e5-891a-bf12ca6bc376 admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:59.406715 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef99102-9fad-40e5-891a-bf12ca6bc376 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:59.409324 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef99102-9fad-40e5-891a-bf12ca6bc376 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:59.444423 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1450/2895] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:55:59 2021] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:55:59.448589 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1b02a-2ede-480c-9b7a-46f8259546a9 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:59.459283 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1b02a-2ede-480c-9b7a-46f8259546a9 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:59.531183 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb444e-93d5-4e55-add6-346f292fc6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:59.531850 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb444e-93d5-4e55-add6-346f292fc6f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:59.532131 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb444e-93d5-4e55-add6-346f292fc6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:59.532405 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb444e-93d5-4e55-add6-346f292fc6f3 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:59.533095 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb444e-93d5-4e55-add6-346f292fc6f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:59.535038 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb444e-93d5-4e55-add6-346f292fc6f3 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:59.556629 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1446/2896] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:55:59 2021] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:55:59.560903 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef99102-9fad-40e5-891a-bf12ca6bc376 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:59.571318 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef99102-9fad-40e5-891a-bf12ca6bc376 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:59.576331 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb45d64-7990-490a-9cad-406569c35fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:59.576979 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb45d64-7990-490a-9cad-406569c35fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:59.577263 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb45d64-7990-490a-9cad-406569c35fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:59.577537 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb45d64-7990-490a-9cad-406569c35fd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:59.578278 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb45d64-7990-490a-9cad-406569c35fd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:59.580221 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb45d64-7990-490a-9cad-406569c35fd4 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:59.590546 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1451/2897] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:55:59 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:55:59.594433 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb444e-93d5-4e55-add6-346f292fc6f3 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:59.604590 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb444e-93d5-4e55-add6-346f292fc6f3 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:59.609520 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd6004c-4181-40e4-91b5-7a4de7f6b679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:59.610166 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6004c-4181-40e4-91b5-7a4de7f6b679 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:59.610445 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6004c-4181-40e4-91b5-7a4de7f6b679 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:59.610717 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6004c-4181-40e4-91b5-7a4de7f6b679 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:59.611479 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd6004c-4181-40e4-91b5-7a4de7f6b679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:59.613061 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd6004c-4181-40e4-91b5-7a4de7f6b679 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:59.623045 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1447/2898] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:55:59 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:55:59.627250 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb45d64-7990-490a-9cad-406569c35fd4 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:59.637618 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb45d64-7990-490a-9cad-406569c35fd4 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:59.643143 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac558b-8da2-4cd3-92c4-464fc7bf1629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:59.644038 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac558b-8da2-4cd3-92c4-464fc7bf1629 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:59.644319 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac558b-8da2-4cd3-92c4-464fc7bf1629 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:59.644584 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac558b-8da2-4cd3-92c4-464fc7bf1629 admin admin] PATH_INFO: `/v3/projects/5fc584ed303f4590a9dfb38f7db9806a/users/81a0076db8884f34974d431a2a83cd0a/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:59.660317 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac558b-8da2-4cd3-92c4-464fc7bf1629 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fc584ed303f4590a9dfb38f7db9806a, user_id=81a0076db8884f34974d431a2a83cd0a, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:59.663105 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac558b-8da2-4cd3-92c4-464fc7bf1629 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:59.678977 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1452/2899] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:55:59 2021] PUT /identity/v3/projects/5fc584ed303f4590a9dfb38f7db9806a/users/81a0076db8884f34974d431a2a83cd0a/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:55:59.689072 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09899ef1-7d8a-4c24-bba6-77ce7a8b9e3c None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:59.689369 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09899ef1-7d8a-4c24-bba6-77ce7a8b9e3c None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:59.689698 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09899ef1-7d8a-4c24-bba6-77ce7a8b9e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:59.722648 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-09899ef1-7d8a-4c24-bba6-77ce7a8b9e3c None None] MFA Rules not processed for user `81a0076db8884f34974d431a2a83cd0a`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:55:59.724494 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-09899ef1-7d8a-4c24-bba6-77ce7a8b9e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:59.794119 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1448/2900] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:55:59 2021] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:55:59.809143 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac558b-8da2-4cd3-92c4-464fc7bf1629 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:59.811938 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-10ac558b-8da2-4cd3-92c4-464fc7bf1629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:55:59.876718 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac558b-8da2-4cd3-92c4-464fc7bf1629 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:59.882877 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b0a13-2b79-4a0e-82f3-fbf16bba5230 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:59.883484 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b0a13-2b79-4a0e-82f3-fbf16bba5230 service cinder] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:59.883764 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b0a13-2b79-4a0e-82f3-fbf16bba5230 service cinder] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:59.884032 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b0a13-2b79-4a0e-82f3-fbf16bba5230 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:55:59.893841 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b0a13-2b79-4a0e-82f3-fbf16bba5230 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:55:59.895695 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b0a13-2b79-4a0e-82f3-fbf16bba5230 service cinder] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:55:59.905110 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1453/2901] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:55:59 2021] GET /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:55:59.925163 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09899ef1-7d8a-4c24-bba6-77ce7a8b9e3c None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:55:59.992160 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09899ef1-7d8a-4c24-bba6-77ce7a8b9e3c None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:55:59.997798 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a33bd-05fe-4216-b4d9-6b38eacd8e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:55:59.998663 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a33bd-05fe-4216-b4d9-6b38eacd8e89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:55:59.998968 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a33bd-05fe-4216-b4d9-6b38eacd8e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:55:59.999265 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742a33bd-05fe-4216-b4d9-6b38eacd8e89 admin admin] PATH_INFO: `/v3/users/81a0076db8884f34974d431a2a83cd0a` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:56:00.000563 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a33bd-05fe-4216-b4d9-6b38eacd8e89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81a0076db8884f34974d431a2a83cd0a)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:56:00.002554 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742a33bd-05fe-4216-b4d9-6b38eacd8e89 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:56:00.054427 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-742a33bd-05fe-4216-b4d9-6b38eacd8e89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81a0076db8884f34974d431a2a83cd0a'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:56:00.061018 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-742a33bd-05fe-4216-b4d9-6b38eacd8e89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81a0076db8884f34974d431a2a83cd0a'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:56:00.072414 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-742a33bd-05fe-4216-b4d9-6b38eacd8e89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81a0076db8884f34974d431a2a83cd0a'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:56:00.073255 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-742a33bd-05fe-4216-b4d9-6b38eacd8e89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81a0076db8884f34974d431a2a83cd0a'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:56:00.074021 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-742a33bd-05fe-4216-b4d9-6b38eacd8e89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81a0076db8884f34974d431a2a83cd0a'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:56:00.089484 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1449/2902] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:55:59 2021] DELETE /identity/v3/users/81a0076db8884f34974d431a2a83cd0a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:56:00.094341 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573b078-9131-49b1-b2d4-1ff8bf7a8a42 None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:56:00.094865 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573b078-9131-49b1-b2d4-1ff8bf7a8a42 None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:56:00.094980 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573b078-9131-49b1-b2d4-1ff8bf7a8a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:56:00.113496 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-f573b078-9131-49b1-b2d4-1ff8bf7a8a42 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:56:00.114821 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-f573b078-9131-49b1-b2d4-1ff8bf7a8a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:56:00.172000 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1454/2903] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:56:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:56:00.182036 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a33bd-05fe-4216-b4d9-6b38eacd8e89 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:56:00.183663 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-742a33bd-05fe-4216-b4d9-6b38eacd8e89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:56:00.254271 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742a33bd-05fe-4216-b4d9-6b38eacd8e89 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:56:00.258251 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3df2e1-6b95-4eee-bdfd-a6e215280ce7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:56:00.258883 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3df2e1-6b95-4eee-bdfd-a6e215280ce7 service neutron] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:56:00.259194 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3df2e1-6b95-4eee-bdfd-a6e215280ce7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:56:00.259473 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3df2e1-6b95-4eee-bdfd-a6e215280ce7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:56:00.268802 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3df2e1-6b95-4eee-bdfd-a6e215280ce7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:56:00.270561 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3df2e1-6b95-4eee-bdfd-a6e215280ce7 service neutron] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:56:00.280208 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1450/2904] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:56:00 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:56:00.557959 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573b078-9131-49b1-b2d4-1ff8bf7a8a42 None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:56:00.559619 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-f573b078-9131-49b1-b2d4-1ff8bf7a8a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:56:00.573611 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573b078-9131-49b1-b2d4-1ff8bf7a8a42 None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:56:00.578909 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e0cdfe-2427-4f2c-9582-f551b2904352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:56:00.580276 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0cdfe-2427-4f2c-9582-f551b2904352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:56:00.580660 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0cdfe-2427-4f2c-9582-f551b2904352 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:56:00.580826 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0cdfe-2427-4f2c-9582-f551b2904352 admin admin] PATH_INFO: `/v3/projects/5fc584ed303f4590a9dfb38f7db9806a` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:56:00.583251 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e0cdfe-2427-4f2c-9582-f551b2904352 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fc584ed303f4590a9dfb38f7db9806a)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:56:00.585166 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e0cdfe-2427-4f2c-9582-f551b2904352 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:56:00.634502 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-54e0cdfe-2427-4f2c-9582-f551b2904352 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fc584ed303f4590a9dfb38f7db9806a', 'request_id': 'req-54e0cdfe-2427-4f2c-9582-f551b2904352'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:56:00.640787 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-54e0cdfe-2427-4f2c-9582-f551b2904352 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fc584ed303f4590a9dfb38f7db9806a', 'request_id': 'req-54e0cdfe-2427-4f2c-9582-f551b2904352'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:56:00.654334 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-54e0cdfe-2427-4f2c-9582-f551b2904352 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fc584ed303f4590a9dfb38f7db9806a', 'request_id': 'req-54e0cdfe-2427-4f2c-9582-f551b2904352'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:56:00.661718 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-54e0cdfe-2427-4f2c-9582-f551b2904352 admin admin] The token cache is being invalidate because project 5fc584ed303f4590a9dfb38f7db9806a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79168) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:56:00.662075 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-54e0cdfe-2427-4f2c-9582-f551b2904352 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:56:00.662891 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-54e0cdfe-2427-4f2c-9582-f551b2904352 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:56:00.664606 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1455/2905] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:56:00 2021] DELETE /identity/v3/projects/5fc584ed303f4590a9dfb38f7db9806a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:56:00.670623 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453732d-7d1b-46a9-b7d2-893eb80e82fb None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:56:00.670958 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453732d-7d1b-46a9-b7d2-893eb80e82fb None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:56:00.671238 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453732d-7d1b-46a9-b7d2-893eb80e82fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:56:00.690188 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-a453732d-7d1b-46a9-b7d2-893eb80e82fb None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:56:00.691381 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-a453732d-7d1b-46a9-b7d2-893eb80e82fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:56:00.756668 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1451/2906] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:56:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:56:00.765508 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9296a6-170c-490d-8f01-57688200321d None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:56:00.765946 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9296a6-170c-490d-8f01-57688200321d None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:56:00.766309 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9296a6-170c-490d-8f01-57688200321d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:56:00.788648 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-ba9296a6-170c-490d-8f01-57688200321d None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:56:00.789866 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-ba9296a6-170c-490d-8f01-57688200321d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:56:00.799786 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1456/2907] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:56:00 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:56:00.804370 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453732d-7d1b-46a9-b7d2-893eb80e82fb None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:56:00.814707 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453732d-7d1b-46a9-b7d2-893eb80e82fb None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:56:00.820084 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0cb838-209a-45a9-b3d5-adea9533e973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:56:00.820896 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cb838-209a-45a9-b3d5-adea9533e973 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:56:00.821096 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cb838-209a-45a9-b3d5-adea9533e973 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:56:00.821405 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cb838-209a-45a9-b3d5-adea9533e973 admin admin] PATH_INFO: `/v3/domains` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:56:00.822153 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0cb838-209a-45a9-b3d5-adea9533e973 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79167) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Nov 29 20:56:00.822482 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0cb838-209a-45a9-b3d5-adea9533e973 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:56:00.824227 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0cb838-209a-45a9-b3d5-adea9533e973 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:56:00.837021 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1452/2908] 10.222.0.15 () {58 vars in 1152 bytes} [Mon Nov 29 20:56:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Nov 29 20:56:00.841552 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9296a6-170c-490d-8f01-57688200321d None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:56:00.851365 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9296a6-170c-490d-8f01-57688200321d None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:56:00.857342 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8517721-cfab-411a-849c-5ee8ee52d630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:56:00.858004 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8517721-cfab-411a-849c-5ee8ee52d630 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:56:00.858312 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8517721-cfab-411a-849c-5ee8ee52d630 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:56:00.859068 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8517721-cfab-411a-849c-5ee8ee52d630 admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:56:00.859316 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8517721-cfab-411a-849c-5ee8ee52d630 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:56:00.861420 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8517721-cfab-411a-849c-5ee8ee52d630 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:56:00.891366 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1457/2909] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:56:00 2021] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Nov 29 20:56:00.896051 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0cb838-209a-45a9-b3d5-adea9533e973 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:56:00.906691 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0cb838-209a-45a9-b3d5-adea9533e973 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:56:00.961132 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158f5d3-1916-47ef-99dd-5284dc7bc506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:56:00.961794 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158f5d3-1916-47ef-99dd-5284dc7bc506 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:56:00.962075 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158f5d3-1916-47ef-99dd-5284dc7bc506 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:56:00.962349 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158f5d3-1916-47ef-99dd-5284dc7bc506 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:56:00.963067 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0158f5d3-1916-47ef-99dd-5284dc7bc506 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:56:00.964979 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0158f5d3-1916-47ef-99dd-5284dc7bc506 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:56:00.987867 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1453/2910] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:56:00 2021] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:56:00.992105 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8517721-cfab-411a-849c-5ee8ee52d630 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:56:01.002463 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8517721-cfab-411a-849c-5ee8ee52d630 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:56:01.007541 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a33720-23a6-4362-abd7-66beca73b41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:56:01.008199 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a33720-23a6-4362-abd7-66beca73b41b admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:56:01.008478 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a33720-23a6-4362-abd7-66beca73b41b admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:56:01.008751 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a33720-23a6-4362-abd7-66beca73b41b admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:56:01.009486 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a33720-23a6-4362-abd7-66beca73b41b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:56:01.011117 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a33720-23a6-4362-abd7-66beca73b41b admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:56:01.022791 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1458/2911] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:56:00 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:56:01.026833 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158f5d3-1916-47ef-99dd-5284dc7bc506 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:56:01.037021 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158f5d3-1916-47ef-99dd-5284dc7bc506 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:56:01.041994 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b58f3-01e1-44e3-9ba5-1d8c35c5d0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:56:01.042640 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b58f3-01e1-44e3-9ba5-1d8c35c5d0d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:56:01.042951 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b58f3-01e1-44e3-9ba5-1d8c35c5d0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:56:01.043222 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b58f3-01e1-44e3-9ba5-1d8c35c5d0d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:56:01.043951 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b58f3-01e1-44e3-9ba5-1d8c35c5d0d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:56:01.045557 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b58f3-01e1-44e3-9ba5-1d8c35c5d0d1 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:56:01.055433 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1454/2912] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:56:01 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:56:01.059743 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a33720-23a6-4362-abd7-66beca73b41b admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:56:01.070204 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a33720-23a6-4362-abd7-66beca73b41b admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:56:01.075963 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b0749-6ab7-480a-bd03-d390ea1f7fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:56:01.076846 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b0749-6ab7-480a-bd03-d390ea1f7fe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:56:01.077123 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b0749-6ab7-480a-bd03-d390ea1f7fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:56:01.077398 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b0749-6ab7-480a-bd03-d390ea1f7fe2 admin admin] PATH_INFO: `/v3/projects/c6ed57a3f1374f2aa7abf0450261a4fa/users/3b0c6dbb7c9947c4acf6337291f1670e/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:56:01.093110 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b0749-6ab7-480a-bd03-d390ea1f7fe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6ed57a3f1374f2aa7abf0450261a4fa, user_id=3b0c6dbb7c9947c4acf6337291f1670e, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:56:01.095829 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b0749-6ab7-480a-bd03-d390ea1f7fe2 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:56:01.111176 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1459/2913] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:56:01 2021] PUT /identity/v3/projects/c6ed57a3f1374f2aa7abf0450261a4fa/users/3b0c6dbb7c9947c4acf6337291f1670e/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:56:01.122389 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01aac6-60f2-452d-833e-641b3226e96f None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:56:01.122649 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01aac6-60f2-452d-833e-641b3226e96f None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:56:01.122999 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01aac6-60f2-452d-833e-641b3226e96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:56:01.152914 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-ec01aac6-60f2-452d-833e-641b3226e96f None None] MFA Rules not processed for user `3b0c6dbb7c9947c4acf6337291f1670e`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:56:01.154149 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-ec01aac6-60f2-452d-833e-641b3226e96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:56:01.231900 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1455/2914] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:56:01 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:56:01.236438 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b0749-6ab7-480a-bd03-d390ea1f7fe2 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:56:01.300356 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b0749-6ab7-480a-bd03-d390ea1f7fe2 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:56:01.308637 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7d9df-0293-4730-babd-74325de90b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:56:01.309461 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7d9df-0293-4730-babd-74325de90b58 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:56:01.309725 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7d9df-0293-4730-babd-74325de90b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:56:01.310041 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7d9df-0293-4730-babd-74325de90b58 admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:56:01.310800 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7d9df-0293-4730-babd-74325de90b58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:56:01.313537 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7d9df-0293-4730-babd-74325de90b58 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:56:01.352486 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1460/2915] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:56:01 2021] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:56:01.357012 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01aac6-60f2-452d-833e-641b3226e96f None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:56:01.368866 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01aac6-60f2-452d-833e-641b3226e96f None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:56:01.430951 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c8334-2ce1-4390-9e03-022dc9e356f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:56:01.431577 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c8334-2ce1-4390-9e03-022dc9e356f2 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:56:01.431855 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c8334-2ce1-4390-9e03-022dc9e356f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:56:01.432130 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c8334-2ce1-4390-9e03-022dc9e356f2 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:56:01.432871 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c8334-2ce1-4390-9e03-022dc9e356f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:56:01.434807 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c8334-2ce1-4390-9e03-022dc9e356f2 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:56:01.457426 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1456/2916] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:56:01 2021] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:56:01.462025 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7d9df-0293-4730-babd-74325de90b58 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:56:01.472685 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7d9df-0293-4730-babd-74325de90b58 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:56:01.477620 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb89c0-1d3c-44ab-b204-99c276d7ed79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:56:01.478288 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb89c0-1d3c-44ab-b204-99c276d7ed79 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:56:01.478568 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb89c0-1d3c-44ab-b204-99c276d7ed79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:56:01.478841 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb89c0-1d3c-44ab-b204-99c276d7ed79 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:56:01.479621 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afb89c0-1d3c-44ab-b204-99c276d7ed79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:56:01.481218 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afb89c0-1d3c-44ab-b204-99c276d7ed79 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:56:01.491966 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1461/2917] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:56:01 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:56:01.496224 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c8334-2ce1-4390-9e03-022dc9e356f2 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:56:01.507437 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c8334-2ce1-4390-9e03-022dc9e356f2 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:56:01.513254 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b31a95-55c4-439d-963b-85b2e4d5f509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:56:01.514119 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b31a95-55c4-439d-963b-85b2e4d5f509 admin admin] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:56:01.514402 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b31a95-55c4-439d-963b-85b2e4d5f509 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:56:01.514666 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b31a95-55c4-439d-963b-85b2e4d5f509 admin admin] PATH_INFO: `/v3/roles` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:56:01.515453 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b31a95-55c4-439d-963b-85b2e4d5f509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:56:01.517063 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b31a95-55c4-439d-963b-85b2e4d5f509 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:56:01.530178 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1457/2918] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:56:01 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:56:01.535789 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb89c0-1d3c-44ab-b204-99c276d7ed79 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:56:01.551931 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afb89c0-1d3c-44ab-b204-99c276d7ed79 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:56:01.558520 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4149e7c-eab8-4eee-83e0-f9e6eb09a068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:56:01.559446 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4149e7c-eab8-4eee-83e0-f9e6eb09a068 admin admin] REQUEST_METHOD: `PUT` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:56:01.559722 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4149e7c-eab8-4eee-83e0-f9e6eb09a068 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:56:01.560002 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4149e7c-eab8-4eee-83e0-f9e6eb09a068 admin admin] PATH_INFO: `/v3/projects/e8f43d99afe64b969d73f457a0562e1b/users/dc0122cbe3804e6284bca007aecfcfe4/roles/88a0e2c4c85c4449ad4681edcdc57835` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:56:01.577288 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4149e7c-eab8-4eee-83e0-f9e6eb09a068 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8f43d99afe64b969d73f457a0562e1b, user_id=dc0122cbe3804e6284bca007aecfcfe4, role_id=88a0e2c4c85c4449ad4681edcdc57835)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:56:01.580006 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4149e7c-eab8-4eee-83e0-f9e6eb09a068 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:56:01.596803 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1462/2919] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:56:01 2021] PUT /identity/v3/projects/e8f43d99afe64b969d73f457a0562e1b/users/dc0122cbe3804e6284bca007aecfcfe4/roles/88a0e2c4c85c4449ad4681edcdc57835 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:56:01.607706 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2c232-678b-4a34-908d-053216ae2377 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:56:01.608023 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2c232-678b-4a34-908d-053216ae2377 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:56:01.608380 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2c232-678b-4a34-908d-053216ae2377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:56:01.637788 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-2ef2c232-678b-4a34-908d-053216ae2377 None None] MFA Rules not processed for user `dc0122cbe3804e6284bca007aecfcfe4`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:56:01.639049 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-2ef2c232-678b-4a34-908d-053216ae2377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:56:01.709881 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1458/2920] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:56:01 2021] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:56:01.716710 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4149e7c-eab8-4eee-83e0-f9e6eb09a068 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:56:01.795466 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4149e7c-eab8-4eee-83e0-f9e6eb09a068 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:56:01.800615 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cbca6e-00b7-4b60-9bbd-ee8f15d7cdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:56:01.801479 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbca6e-00b7-4b60-9bbd-ee8f15d7cdd1 admin admin] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:56:01.801760 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbca6e-00b7-4b60-9bbd-ee8f15d7cdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:56:01.802029 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cbca6e-00b7-4b60-9bbd-ee8f15d7cdd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:56:01.802781 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cbca6e-00b7-4b60-9bbd-ee8f15d7cdd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:56:01.804773 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cbca6e-00b7-4b60-9bbd-ee8f15d7cdd1 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:56:01.831202 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1463/2921] 10.222.0.15 () {60 vars in 1152 bytes} [Mon Nov 29 20:56:01 2021] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:56:01.835332 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2c232-678b-4a34-908d-053216ae2377 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:56:01.845801 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2c232-678b-4a34-908d-053216ae2377 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:56:01.906889 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cefa96-073d-441f-ada1-66dc663b9c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:56:01.907840 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cefa96-073d-441f-ada1-66dc663b9c48 admin admin] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:56:01.908293 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cefa96-073d-441f-ada1-66dc663b9c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:56:01.908705 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cefa96-073d-441f-ada1-66dc663b9c48 admin admin] PATH_INFO: `/v3/users` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:56:01.909681 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cefa96-073d-441f-ada1-66dc663b9c48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:56:01.912757 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cefa96-073d-441f-ada1-66dc663b9c48 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:56:01.933978 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1459/2922] 10.222.0.15 () {60 vars in 1143 bytes} [Mon Nov 29 20:56:01 2021] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Nov 29 20:56:01.938145 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cbca6e-00b7-4b60-9bbd-ee8f15d7cdd1 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:56:01.948930 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cbca6e-00b7-4b60-9bbd-ee8f15d7cdd1 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:56:01.954599 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633d51a-70ff-470d-a2ed-b7361c0ed77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:56:01.955313 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633d51a-70ff-470d-a2ed-b7361c0ed77c admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:56:01.955590 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633d51a-70ff-470d-a2ed-b7361c0ed77c admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:56:01.955862 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633d51a-70ff-470d-a2ed-b7361c0ed77c admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:56:01.956603 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633d51a-70ff-470d-a2ed-b7361c0ed77c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:56:01.958193 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633d51a-70ff-470d-a2ed-b7361c0ed77c admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:56:01.969902 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1464/2923] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:56:01 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:56:01.974716 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cefa96-073d-441f-ada1-66dc663b9c48 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:56:01.985723 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cefa96-073d-441f-ada1-66dc663b9c48 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:56:01.992056 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1da967-1ec7-49cb-b3ab-115c23b0765e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:56:01.993039 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1da967-1ec7-49cb-b3ab-115c23b0765e admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:56:01.993349 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1da967-1ec7-49cb-b3ab-115c23b0765e admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:56:01.993673 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1da967-1ec7-49cb-b3ab-115c23b0765e admin admin] PATH_INFO: `/v3/projects/5d4e9d5bd92e49d4805860740bf427c5/users/a6c3385b4e17441798b26296366b8fce/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:56:02.011284 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1da967-1ec7-49cb-b3ab-115c23b0765e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d4e9d5bd92e49d4805860740bf427c5, user_id=a6c3385b4e17441798b26296366b8fce, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:56:02.014006 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1da967-1ec7-49cb-b3ab-115c23b0765e admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:56:02.030230 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1460/2924] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:56:01 2021] PUT /identity/v3/projects/5d4e9d5bd92e49d4805860740bf427c5/users/a6c3385b4e17441798b26296366b8fce/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:56:02.034395 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633d51a-70ff-470d-a2ed-b7361c0ed77c admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:56:02.044857 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633d51a-70ff-470d-a2ed-b7361c0ed77c admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:56:02.110396 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a884a6-7102-44e8-93c2-8106a35e0185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:56:02.111114 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a884a6-7102-44e8-93c2-8106a35e0185 admin admin] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:56:02.111284 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a884a6-7102-44e8-93c2-8106a35e0185 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:56:02.111566 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a884a6-7102-44e8-93c2-8106a35e0185 admin admin] PATH_INFO: `/v3/roles` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:56:02.112303 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a884a6-7102-44e8-93c2-8106a35e0185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:56:02.113899 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a884a6-7102-44e8-93c2-8106a35e0185 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:56:02.124399 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1465/2925] 10.222.0.15 () {58 vars in 1121 bytes} [Mon Nov 29 20:56:02 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Nov 29 20:56:02.130029 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1da967-1ec7-49cb-b3ab-115c23b0765e admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:56:02.139874 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1da967-1ec7-49cb-b3ab-115c23b0765e admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:56:02.144884 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f61713-c242-4f95-9efd-a6bfa20cae86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:56:02.146079 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f61713-c242-4f95-9efd-a6bfa20cae86 admin admin] REQUEST_METHOD: `PUT` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:56:02.146358 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f61713-c242-4f95-9efd-a6bfa20cae86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:56:02.146629 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f61713-c242-4f95-9efd-a6bfa20cae86 admin admin] PATH_INFO: `/v3/projects/5d4e9d5bd92e49d4805860740bf427c5/users/a6c3385b4e17441798b26296366b8fce/roles/33d95c7861b64f1a95af8a333bd626ea` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:56:02.148777 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f61713-c242-4f95-9efd-a6bfa20cae86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d4e9d5bd92e49d4805860740bf427c5, user_id=a6c3385b4e17441798b26296366b8fce, role_id=33d95c7861b64f1a95af8a333bd626ea)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:56:02.151463 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f61713-c242-4f95-9efd-a6bfa20cae86 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:56:02.162610 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1461/2926] 10.222.0.15 () {60 vars in 1482 bytes} [Mon Nov 29 20:56:02 2021] PUT /identity/v3/projects/5d4e9d5bd92e49d4805860740bf427c5/users/a6c3385b4e17441798b26296366b8fce/roles/33d95c7861b64f1a95af8a333bd626ea => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:56:02.173254 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a7c80-8d07-4d0a-adc4-191e6a3d9a3d None None] REQUEST_METHOD: `POST` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:56:02.173552 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a7c80-8d07-4d0a-adc4-191e6a3d9a3d None None] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:56:02.173819 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a7c80-8d07-4d0a-adc4-191e6a3d9a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:56:02.203360 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.auth.core [None req-573a7c80-8d07-4d0a-adc4-191e6a3d9a3d None None] MFA Rules not processed for user `a6c3385b4e17441798b26296366b8fce`. Rule list: `[]` (Enabled: `True`). {{(pid=79168) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:56:02.204622 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-573a7c80-8d07-4d0a-adc4-191e6a3d9a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:56:02.285076 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1466/2927] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:56:02 2021] POST /identity/v3/auth/tokens => generated 3311 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:56:02.296910 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f61713-c242-4f95-9efd-a6bfa20cae86 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:56:02.299076 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-c7f61713-c242-4f95-9efd-a6bfa20cae86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:56:02.367556 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f61713-c242-4f95-9efd-a6bfa20cae86 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:56:02.372168 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b91bc-fc24-4040-a285-80e4cd6a939e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:56:02.372822 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b91bc-fc24-4040-a285-80e4cd6a939e service cinder] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:56:02.373095 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b91bc-fc24-4040-a285-80e4cd6a939e service cinder] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:56:02.373362 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638b91bc-fc24-4040-a285-80e4cd6a939e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:56:02.438208 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b91bc-fc24-4040-a285-80e4cd6a939e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:56:02.439951 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638b91bc-fc24-4040-a285-80e4cd6a939e service cinder] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:56:02.453829 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1462/2928] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:56:02 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:56:03.936545 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a7c80-8d07-4d0a-adc4-191e6a3d9a3d None None] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:56:03.938787 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-573a7c80-8d07-4d0a-adc4-191e6a3d9a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:56:03.957932 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a7c80-8d07-4d0a-adc4-191e6a3d9a3d None None] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:56:03.963181 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c83cf-d4c8-42a5-8e57-ed2dca3e3b09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:56:03.963897 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c83cf-d4c8-42a5-8e57-ed2dca3e3b09 service cinder] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:56:03.964274 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c83cf-d4c8-42a5-8e57-ed2dca3e3b09 service cinder] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:56:03.964723 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c83cf-d4c8-42a5-8e57-ed2dca3e3b09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:56:04.031700 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c83cf-d4c8-42a5-8e57-ed2dca3e3b09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:56:04.033065 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c83cf-d4c8-42a5-8e57-ed2dca3e3b09 service cinder] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:56:04.042403 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1467/2929] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:56:03 2021] GET /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:56:04.592505 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b91bc-fc24-4040-a285-80e4cd6a939e service cinder] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:56:04.601346 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638b91bc-fc24-4040-a285-80e4cd6a939e service cinder] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:56:04.605319 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d68acd-3b14-4b73-bcaa-d8f296af7fc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9508e6f2ac414098872e2584f1ed7393', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:56:04.605987 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d68acd-3b14-4b73-bcaa-d8f296af7fc6 service cinder] REQUEST_METHOD: `GET` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:56:04.606272 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d68acd-3b14-4b73-bcaa-d8f296af7fc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:56:04.606548 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d68acd-3b14-4b73-bcaa-d8f296af7fc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:56:04.615972 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d68acd-3b14-4b73-bcaa-d8f296af7fc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:56:04.617408 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d68acd-3b14-4b73-bcaa-d8f296af7fc6 service cinder] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:56:04.626988 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1463/2930] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:56:04 2021] GET /identity/v3/auth/tokens => generated 3311 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:56:08.500242 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c83cf-d4c8-42a5-8e57-ed2dca3e3b09 service cinder] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:56:08.569985 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c83cf-d4c8-42a5-8e57-ed2dca3e3b09 service cinder] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:56:08.575514 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de1f18-fbfe-4047-b7a6-2d64166d5aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:56:08.577468 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de1f18-fbfe-4047-b7a6-2d64166d5aaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:56:08.577468 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de1f18-fbfe-4047-b7a6-2d64166d5aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:56:08.577468 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de1f18-fbfe-4047-b7a6-2d64166d5aaa admin admin] PATH_INFO: `/v3/users/3b0c6dbb7c9947c4acf6337291f1670e` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:56:08.578774 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de1f18-fbfe-4047-b7a6-2d64166d5aaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b0c6dbb7c9947c4acf6337291f1670e)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:56:08.581716 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de1f18-fbfe-4047-b7a6-2d64166d5aaa admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:56:08.636794 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-06de1f18-fbfe-4047-b7a6-2d64166d5aaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b0c6dbb7c9947c4acf6337291f1670e'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:56:08.644091 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-06de1f18-fbfe-4047-b7a6-2d64166d5aaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b0c6dbb7c9947c4acf6337291f1670e'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:56:08.653158 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-06de1f18-fbfe-4047-b7a6-2d64166d5aaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b0c6dbb7c9947c4acf6337291f1670e'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:56:08.667606 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-06de1f18-fbfe-4047-b7a6-2d64166d5aaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b0c6dbb7c9947c4acf6337291f1670e'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:56:08.668375 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-06de1f18-fbfe-4047-b7a6-2d64166d5aaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b0c6dbb7c9947c4acf6337291f1670e'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:56:08.674775 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1468/2931] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:56:08 2021] DELETE /identity/v3/users/3b0c6dbb7c9947c4acf6337291f1670e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:56:08.680664 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea2c96-02ad-4486-8fb7-6eecf8efb401 None None] REQUEST_METHOD: `POST` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:56:08.681145 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea2c96-02ad-4486-8fb7-6eecf8efb401 None None] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:56:08.681277 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea2c96-02ad-4486-8fb7-6eecf8efb401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:56:08.699371 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.auth.core [None req-f3ea2c96-02ad-4486-8fb7-6eecf8efb401 None None] MFA Rules not processed for user `d89548cfaf2149148790fd3546ef2b15`. Rule list: `[]` (Enabled: `True`). {{(pid=79167) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Nov 29 20:56:08.700578 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-f3ea2c96-02ad-4486-8fb7-6eecf8efb401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:56:08.765729 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1464/2932] 10.222.0.15 () {58 vars in 957 bytes} [Mon Nov 29 20:56:08 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Nov 29 20:56:08.777720 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de1f18-fbfe-4047-b7a6-2d64166d5aaa admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:56:08.779376 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-06de1f18-fbfe-4047-b7a6-2d64166d5aaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:56:08.843103 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de1f18-fbfe-4047-b7a6-2d64166d5aaa admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:56:08.848808 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f401a5d-7b04-4461-9fdd-abbb10d18ed6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '821fb4ce82de47ca873fc22d29d4f957', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:56:08.849699 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f401a5d-7b04-4461-9fdd-abbb10d18ed6 service neutron] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:56:08.850090 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f401a5d-7b04-4461-9fdd-abbb10d18ed6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:56:08.850537 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f401a5d-7b04-4461-9fdd-abbb10d18ed6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:56:08.861857 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f401a5d-7b04-4461-9fdd-abbb10d18ed6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:56:08.863352 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f401a5d-7b04-4461-9fdd-abbb10d18ed6 service neutron] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:56:08.874541 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1469/2933] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:56:08 2021] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Nov 29 20:56:09.152097 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea2c96-02ad-4486-8fb7-6eecf8efb401 None None] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:56:09.153730 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-f3ea2c96-02ad-4486-8fb7-6eecf8efb401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:56:09.166246 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea2c96-02ad-4486-8fb7-6eecf8efb401 None None] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:56:09.171213 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527ebb9-d349-44c6-b410-2fa7ce781d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:56:09.172081 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527ebb9-d349-44c6-b410-2fa7ce781d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:56:09.172358 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527ebb9-d349-44c6-b410-2fa7ce781d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:56:09.172601 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527ebb9-d349-44c6-b410-2fa7ce781d22 admin admin] PATH_INFO: `/v3/projects/c6ed57a3f1374f2aa7abf0450261a4fa` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:56:09.173885 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4527ebb9-d349-44c6-b410-2fa7ce781d22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6ed57a3f1374f2aa7abf0450261a4fa)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:56:09.175857 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4527ebb9-d349-44c6-b410-2fa7ce781d22 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:56:09.230100 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-4527ebb9-d349-44c6-b410-2fa7ce781d22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6ed57a3f1374f2aa7abf0450261a4fa', 'request_id': 'req-4527ebb9-d349-44c6-b410-2fa7ce781d22'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:56:09.236364 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-4527ebb9-d349-44c6-b410-2fa7ce781d22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6ed57a3f1374f2aa7abf0450261a4fa', 'request_id': 'req-4527ebb9-d349-44c6-b410-2fa7ce781d22'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:56:09.242265 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-4527ebb9-d349-44c6-b410-2fa7ce781d22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6ed57a3f1374f2aa7abf0450261a4fa', 'request_id': 'req-4527ebb9-d349-44c6-b410-2fa7ce781d22'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:56:09.258466 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-4527ebb9-d349-44c6-b410-2fa7ce781d22 admin admin] The token cache is being invalidate because project c6ed57a3f1374f2aa7abf0450261a4fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:56:09.258746 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-4527ebb9-d349-44c6-b410-2fa7ce781d22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:56:09.259396 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-4527ebb9-d349-44c6-b410-2fa7ce781d22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:56:09.260938 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1465/2934] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:56:09 2021] DELETE /identity/v3/projects/c6ed57a3f1374f2aa7abf0450261a4fa => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Nov 29 20:56:09.265847 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f401a5d-7b04-4461-9fdd-abbb10d18ed6 service neutron] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:56:09.275301 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f401a5d-7b04-4461-9fdd-abbb10d18ed6 service neutron] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:56:09.334502 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143832ca-c128-4d16-bda8-6599cf33f5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:56:09.335571 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143832ca-c128-4d16-bda8-6599cf33f5ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:56:09.335836 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143832ca-c128-4d16-bda8-6599cf33f5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:56:09.336110 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143832ca-c128-4d16-bda8-6599cf33f5ac admin admin] PATH_INFO: `/v3/users/dc0122cbe3804e6284bca007aecfcfe4` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:56:09.337511 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143832ca-c128-4d16-bda8-6599cf33f5ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc0122cbe3804e6284bca007aecfcfe4)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:56:09.339561 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143832ca-c128-4d16-bda8-6599cf33f5ac admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:56:09.390162 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-143832ca-c128-4d16-bda8-6599cf33f5ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc0122cbe3804e6284bca007aecfcfe4'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:56:09.401652 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-143832ca-c128-4d16-bda8-6599cf33f5ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc0122cbe3804e6284bca007aecfcfe4'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:56:09.414285 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-143832ca-c128-4d16-bda8-6599cf33f5ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc0122cbe3804e6284bca007aecfcfe4'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:56:09.429586 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-143832ca-c128-4d16-bda8-6599cf33f5ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc0122cbe3804e6284bca007aecfcfe4'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:56:09.430810 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-143832ca-c128-4d16-bda8-6599cf33f5ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc0122cbe3804e6284bca007aecfcfe4'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:56:09.437183 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1470/2935] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:56:09 2021] DELETE /identity/v3/users/dc0122cbe3804e6284bca007aecfcfe4 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:56:09.739291 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527ebb9-d349-44c6-b410-2fa7ce781d22 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:56:09.740902 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-4527ebb9-d349-44c6-b410-2fa7ce781d22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:56:09.754409 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527ebb9-d349-44c6-b410-2fa7ce781d22 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:56:09.819012 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac5e45-879d-4a0b-b033-306f71fcac61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:56:09.819824 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac5e45-879d-4a0b-b033-306f71fcac61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:56:09.820100 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac5e45-879d-4a0b-b033-306f71fcac61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:56:09.820355 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac5e45-879d-4a0b-b033-306f71fcac61 admin admin] PATH_INFO: `/v3/projects/e8f43d99afe64b969d73f457a0562e1b` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:56:09.821687 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac5e45-879d-4a0b-b033-306f71fcac61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8f43d99afe64b969d73f457a0562e1b)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:56:09.823656 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac5e45-879d-4a0b-b033-306f71fcac61 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:56:09.882723 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-faac5e45-879d-4a0b-b033-306f71fcac61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8f43d99afe64b969d73f457a0562e1b', 'request_id': 'req-faac5e45-879d-4a0b-b033-306f71fcac61'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:56:09.889626 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-faac5e45-879d-4a0b-b033-306f71fcac61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8f43d99afe64b969d73f457a0562e1b', 'request_id': 'req-faac5e45-879d-4a0b-b033-306f71fcac61'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:56:09.896425 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-faac5e45-879d-4a0b-b033-306f71fcac61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8f43d99afe64b969d73f457a0562e1b', 'request_id': 'req-faac5e45-879d-4a0b-b033-306f71fcac61'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:56:09.913438 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-faac5e45-879d-4a0b-b033-306f71fcac61 admin admin] The token cache is being invalidate because project e8f43d99afe64b969d73f457a0562e1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:56:09.913750 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-faac5e45-879d-4a0b-b033-306f71fcac61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:56:09.916280 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-faac5e45-879d-4a0b-b033-306f71fcac61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:56:09.916280 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1466/2936] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:56:09 2021] DELETE /identity/v3/projects/e8f43d99afe64b969d73f457a0562e1b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:56:09.920420 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143832ca-c128-4d16-bda8-6599cf33f5ac admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:56:09.921948 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-143832ca-c128-4d16-bda8-6599cf33f5ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:56:09.935557 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143832ca-c128-4d16-bda8-6599cf33f5ac admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:56:10.000820 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f52c78-069f-4a94-8859-bf6de0d09cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:56:10.001723 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f52c78-069f-4a94-8859-bf6de0d09cc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:56:10.001998 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f52c78-069f-4a94-8859-bf6de0d09cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:56:10.002273 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f52c78-069f-4a94-8859-bf6de0d09cc5 admin admin] PATH_INFO: `/v3/users/a6c3385b4e17441798b26296366b8fce` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:56:10.003532 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f52c78-069f-4a94-8859-bf6de0d09cc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6c3385b4e17441798b26296366b8fce)` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:56:10.005460 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f52c78-069f-4a94-8859-bf6de0d09cc5 admin admin] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:56:10.058516 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-66f52c78-069f-4a94-8859-bf6de0d09cc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6c3385b4e17441798b26296366b8fce'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:56:10.066348 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-66f52c78-069f-4a94-8859-bf6de0d09cc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6c3385b4e17441798b26296366b8fce'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:56:10.075993 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-66f52c78-069f-4a94-8859-bf6de0d09cc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6c3385b4e17441798b26296366b8fce'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:56:10.089091 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-66f52c78-069f-4a94-8859-bf6de0d09cc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6c3385b4e17441798b26296366b8fce'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:56:10.089826 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.notifications [None req-66f52c78-069f-4a94-8859-bf6de0d09cc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6c3385b4e17441798b26296366b8fce'} {{(pid=79168) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:56:10.095843 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1471/2937] 10.222.0.15 () {58 vars in 1223 bytes} [Mon Nov 29 20:56:09 2021] DELETE /identity/v3/users/a6c3385b4e17441798b26296366b8fce => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:56:10.392158 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac5e45-879d-4a0b-b033-306f71fcac61 admin admin] Authenticating user token {{(pid=79167) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:56:10.393882 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.fernet_utils [None req-faac5e45-879d-4a0b-b033-306f71fcac61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79167) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:56:10.410115 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac5e45-879d-4a0b-b033-306f71fcac61 admin admin] Validating token access rules against request {{(pid=79167) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:56:10.468071 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d565ebd0-4b35-46fe-b928-263a6be01937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd89548cfaf2149148790fd3546ef2b15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a13adf9036b4a4f9b01aa94a92cd3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79167) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:56:10.469008 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565ebd0-4b35-46fe-b928-263a6be01937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:56:10.469332 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565ebd0-4b35-46fe-b928-263a6be01937 admin admin] SCRIPT_NAME: `/identity` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:56:10.469638 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565ebd0-4b35-46fe-b928-263a6be01937 admin admin] PATH_INFO: `/v3/projects/5d4e9d5bd92e49d4805860740bf427c5` {{(pid=79167) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:56:10.471191 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d565ebd0-4b35-46fe-b928-263a6be01937 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d4e9d5bd92e49d4805860740bf427c5)` {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:56:10.473416 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d565ebd0-4b35-46fe-b928-263a6be01937 admin admin] RBAC: Authorization granted {{(pid=79167) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:56:10.532406 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-d565ebd0-4b35-46fe-b928-263a6be01937 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d4e9d5bd92e49d4805860740bf427c5', 'request_id': 'req-d565ebd0-4b35-46fe-b928-263a6be01937'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:56:10.539086 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-d565ebd0-4b35-46fe-b928-263a6be01937 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d4e9d5bd92e49d4805860740bf427c5', 'request_id': 'req-d565ebd0-4b35-46fe-b928-263a6be01937'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:56:10.545449 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-d565ebd0-4b35-46fe-b928-263a6be01937 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d4e9d5bd92e49d4805860740bf427c5', 'request_id': 'req-d565ebd0-4b35-46fe-b928-263a6be01937'} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:56:10.561273 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-d565ebd0-4b35-46fe-b928-263a6be01937 admin admin] The token cache is being invalidate because project 5d4e9d5bd92e49d4805860740bf427c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79167) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Nov 29 20:56:10.561613 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-d565ebd0-4b35-46fe-b928-263a6be01937 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:56:10.562541 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: DEBUG keystone.notifications [None req-d565ebd0-4b35-46fe-b928-263a6be01937 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79167) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Nov 29 20:56:10.564784 dv-cinder-819669-1-iscsi devstack@keystone.service[79167]: [pid: 79167|app: 0|req: 1467/2938] 10.222.0.15 () {58 vars in 1232 bytes} [Mon Nov 29 20:56:10 2021] DELETE /identity/v3/projects/5d4e9d5bd92e49d4805860740bf427c5 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Nov 29 20:59:19.023848 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f52c78-069f-4a94-8859-bf6de0d09cc5 admin admin] Authenticating user token {{(pid=79168) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Nov 29 20:59:19.025538 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-66f52c78-069f-4a94-8859-bf6de0d09cc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:59:19.096637 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f52c78-069f-4a94-8859-bf6de0d09cc5 admin admin] Validating token access rules against request {{(pid=79168) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Nov 29 20:59:19.155056 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d1e27-d776-4d5d-a071-e45efe21fcd4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b954c18d7e9349e899f4c1cd42b89166', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f4cba10fe824640b2ed37aab02346ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79168) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Nov 29 20:59:19.155705 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d1e27-d776-4d5d-a071-e45efe21fcd4 service placement] REQUEST_METHOD: `GET` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Nov 29 20:59:19.155986 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d1e27-d776-4d5d-a071-e45efe21fcd4 service placement] SCRIPT_NAME: `/identity` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Nov 29 20:59:19.156246 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d1e27-d776-4d5d-a071-e45efe21fcd4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79168) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Nov 29 20:59:19.158145 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.fernet_utils [None req-026d1e27-d776-4d5d-a071-e45efe21fcd4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79168) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Nov 29 20:59:19.169843 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026d1e27-d776-4d5d-a071-e45efe21fcd4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Nov 29 20:59:19.171470 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026d1e27-d776-4d5d-a071-e45efe21fcd4 service placement] RBAC: Authorization granted {{(pid=79168) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Nov 29 20:59:19.181501 dv-cinder-819669-1-iscsi devstack@keystone.service[79168]: [pid: 79168|app: 0|req: 1472/2939] 10.222.0.15 () {60 vars in 1365 bytes} [Mon Nov 29 20:59:19 2021] GET /identity/v3/auth/tokens => generated 3298 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)